-- Logs begin at Mon 2022-08-01 15:37:19 UTC, end at Mon 2022-08-01 17:13:51 UTC. -- Aug 01 16:37:32.388060 dv-cinder-849890-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 16:37:32 2022] *** Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: nodename: dv-cinder-849890-2-smb Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: machine: x86_64 Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: clock source: unix Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: pcre jit disabled Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: detected number of CPU cores: 4 Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: current working directory: / Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: detected binary path: /usr/bin/uwsgi-core Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: your processes number limit is 47680 Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: your memory page size is 4096 bytes Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: detected max file descriptor number: 2048 Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: lock engine: pthread robust mutexes Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: thunder lock: enabled Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 01 16:37:32.400871 dv-cinder-849890-2-smb devstack@keystone.service[92110]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 16:37:32.438711 dv-cinder-849890-2-smb devstack@keystone.service[92110]: Python main interpreter initialized at 0x55fb3a74c9c0 Aug 01 16:37:32.438711 dv-cinder-849890-2-smb devstack@keystone.service[92110]: python threads support enabled Aug 01 16:37:32.438711 dv-cinder-849890-2-smb devstack@keystone.service[92110]: your server socket listen backlog is limited to 100 connections Aug 01 16:37:32.438711 dv-cinder-849890-2-smb devstack@keystone.service[92110]: your mercy for graceful operations on workers is 90 seconds Aug 01 16:37:32.439150 dv-cinder-849890-2-smb devstack@keystone.service[92110]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 16:37:32.439226 dv-cinder-849890-2-smb devstack@keystone.service[92110]: *** Operational MODE: preforking *** Aug 01 16:37:32.439480 dv-cinder-849890-2-smb devstack@keystone.service[92110]: *** uWSGI is running in multiple interpreter mode *** Aug 01 16:37:32.439480 dv-cinder-849890-2-smb devstack@keystone.service[92110]: spawned uWSGI master process (pid: 92110) Aug 01 16:37:32.439745 dv-cinder-849890-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 01 16:37:32.440581 dv-cinder-849890-2-smb devstack@keystone.service[92110]: spawned uWSGI worker 1 (pid: 92120, cores: 1) Aug 01 16:37:32.442418 dv-cinder-849890-2-smb devstack@keystone.service[92110]: spawned uWSGI worker 2 (pid: 92121, cores: 1) Aug 01 16:37:32.442418 dv-cinder-849890-2-smb devstack@keystone.service[92110]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 16:37:37.959023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:37:37.959023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: from cryptography.utils import int_from_bytes Aug 01 16:37:37.959830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:37:37.959830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: from cryptography.utils import int_from_bytes Aug 01 16:37:37.986111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:37:37.986111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: from cryptography.utils import int_from_bytes Aug 01 16:37:37.986701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:37:37.986701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: from cryptography.utils import int_from_bytes Aug 01 16:37:38.010246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:37:38.010450 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:37:38.010581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] command line args: [] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:37:38.010891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:37:38.011049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ================================================================================ {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:37:38.011346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] admin_token = **** {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.011594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] config_dir = [] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.011755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.011945 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] config_source = [] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.012112 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] debug = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.012330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.012668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.012882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.013099 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.013368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.013568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] list_limit = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.013744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] log_config_append = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.013902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.014110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] log_dir = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.014311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] log_file = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.014458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.014721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.014935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.015228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.015410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.015526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.015779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.016020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.016249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.016466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.016704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.016935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.017187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.017427 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.017702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.018219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.124/identity {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.018394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] publish_errors = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.018628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.018856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.019061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.019306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.019538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.019768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] standard_threads = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.019996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.020223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.020398 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.020572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] use_journal = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.020746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] use_json = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.020918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] use_stderr = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.021090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] use_syslog = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.021317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.021569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.021810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.022064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.022298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.022543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.022776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.023041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.023281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.023525 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.023768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.024013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.024242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.024484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.024770 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.025015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.025259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.025490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.025742 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.025990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.026231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.026463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.026712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.026986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.027240 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.027485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.027714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.027943 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.028171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.028402 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.028650 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.028894 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.029120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.029347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.029589 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.029831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.030063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.030305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.030531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.030761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.031015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.031244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.031506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.031698 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.031925 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.032157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.032485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.032645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.032926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.033121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.033308 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.033539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.033784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.034013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.034251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.034480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.034714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.034959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.035185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:37:38.035312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.035424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:37:38.035534 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.035651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] command line args: [] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:37:38.035763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.035869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:37:38.035980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.036089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ================================================================================ {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:37:38.036205 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.036316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] admin_token = **** {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.036425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.036543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] config_dir = [] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.036665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.036784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.036896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.037006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] config_source = [] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.037006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] debug = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.037217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.037328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.037466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.037582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.037699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.037885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.038005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.038122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.038231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.038346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.038464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.038583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] list_limit = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.038774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.038889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] log_config_append = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.039025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.039135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.039135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] log_dir = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.039354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.039473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] log_file = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.039590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.039701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.039811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.039920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.040213 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.040337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.040455 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.040568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.040687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.040800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.040911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.041021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.041130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.041246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.041246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.041464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.041574 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.041690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.041806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.041918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.042038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.042150 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.042259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.042368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.042476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.042585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.042703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.042813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.042923 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.043078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.043197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.043197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.043197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.043587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.124/identity {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.043587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] publish_errors = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.043793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.043911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.044023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.044133 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.044242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.044358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.044469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.044591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.044703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.044812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.044921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.045031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] standard_threads = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.045140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.045262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.045378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.045495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.045612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.045723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.045832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.045949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] use_journal = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.045949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] use_json = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.046170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.046281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] use_stderr = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.046390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] auth.external = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.046490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] use_syslog = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.046593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.046695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:37:38.046787 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.046886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.047051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.047168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.047271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] auth.password = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.047374 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.047469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] auth.token = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.047562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.047664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.047773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.047891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.048002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.048116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.048228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.048344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.048463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.048584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.048703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.048814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.048930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.049042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.049142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.049251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] credential.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.049370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.049487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.049646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.049755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.049873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.049996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.050099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.050207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.050317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.050427 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.050527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.050646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.050758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.050866 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.051011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.051124 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.051233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.051357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.051475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.051587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.051697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.051807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.051916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.052034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.052146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.052256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.052367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.052478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.052587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.052706 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.052824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.052936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] federation.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.053046 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.053155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.053265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.053384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.053499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.053609 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.053718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.053828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.053937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.054055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.054168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.054278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.054388 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.054499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.054609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.054727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.054839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.054967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.055080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.055200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.055312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.055312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.055605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.055726 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.055982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.056097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.056208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.056319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.056439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.056552 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.056664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.056664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.056872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.056982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.056982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.057200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.057319 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.057435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.057545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.057642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.057940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.058119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.058242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.058360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.058472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.058584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.058708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.058824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.058935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.059071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.059181 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.059299 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.059454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.059577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.059700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.059816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.059928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.060053 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.060167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.060278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.060398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.060511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.060623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.060734 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.060846 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.060957 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.061082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.061195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.061306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.061418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.061529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.061625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.061727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.061823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.061929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.062025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.062127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.062236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.062381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.062526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.062641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.062737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.062831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.062926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.063104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.063204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.063339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.063481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.063580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.063674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.063784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.063881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.063975 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.064069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.064162 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.064261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.064364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.064460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.064623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.064784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.064889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.064988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.065096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.065208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.065306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.065399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.065501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.065602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067213 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067527 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067835 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.067955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068213 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068332 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.068896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.069197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.069328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.069399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.069459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.069570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.069685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.069810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.069924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.070037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.070147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.070258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.070368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.070488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.070600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.070710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.070820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.070929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.071064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.071192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] auth.external = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.071307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.071447 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.071630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.071774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.071886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.072080 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.072251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.072376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.072515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.072632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] auth.password = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.072745 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.072872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] auth.token = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.072991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.073104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.073216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.073328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.073440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.073561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.073675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.073795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.073909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.074021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.074132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.074252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.074365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.074477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.074589 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.074701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] credential.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.074812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.074932 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.075071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.075184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.075296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.075408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.075521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.075651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.075765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.075876 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.075987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.076104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.076217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] resource.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.076337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.076450 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.076563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.076675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.076786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.076897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.077017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.077129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.077241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.077353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.077494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.077612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.077767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.077883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.077995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.078106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.078225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.078337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.078458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] role.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.078572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] federation.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.078684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] role.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.078796 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.078999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.079179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.079321 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.079436 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.079548 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.079661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.079783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.079897 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.080018 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.080131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.080242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.080353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.080465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.080584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.080698 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.080809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.080921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.081032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.081142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.081265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.081379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.081490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.081601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.081713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.081827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.081948 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.082061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.082173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.082173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.082382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.082493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.082612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.082727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.082840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.082967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.083081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.083204 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.083326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.083440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.083553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.083663 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.083774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.083886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.084005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.084119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.084230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.084341 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.084452 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.084564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.084683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.084796 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.084908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.085019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.085130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.085240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.085360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.085473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.085584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.085694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.085805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.085916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.086038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.086151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.086261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.086372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.086483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.086593 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.086720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] token.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.086834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.087001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.087188 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.087306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.087425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.087550 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.087796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.087912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.088047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.088200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.088316 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.088465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.088583 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.088721 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.088837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.088949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.089071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.089184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.089294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.089405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.089517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.089628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.089747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.089861 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.089976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.090111 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.090228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.090340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.090474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.090589 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.090701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.090812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.090921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.091053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.091240 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.connection = **** {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.091366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.091492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.091606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.091720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.091830 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.091941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.092052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.092177 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.092292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.092394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.092502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.092614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.092724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.092844 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.092957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.093068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.093178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.093290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.093401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.093521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.093981 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.094096 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.094207 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.094320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.094431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.094551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.094664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.094776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.094886 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.095114 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.095230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.095356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.095471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.095573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.095683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.095794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.095905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:37:38.096025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.096025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.096258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.096496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.096730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.096981 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.097231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.097480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.097727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.098035 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.098212 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.098443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.098748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.098916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.099176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.099412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.099658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.099910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.100147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.100405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.100639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.100885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.101120 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.101356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.101737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.101991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.102249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.102486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.102803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.103167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] resource.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.103605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.103959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.104206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.104462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.104718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.104960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.105212 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.105451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.105698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.105937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] role.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.106187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] role.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.106421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.106672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.106924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.107197 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.107446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.107695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.107944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.108191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.108440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.108674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.108923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.109172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.109421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.109669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.110092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.110328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.110576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.110827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.111100 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.111352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.111591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.111844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.112097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.112336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.112569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.112802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.113037 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.113289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.113547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.113796 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.114034 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.114274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.114570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.114757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] token.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.115020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.115274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.115514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.115778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.116027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.116266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.116509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.116753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.117003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.117240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.117478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.117714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.117961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.118353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.118526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.118786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.119331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.119650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.connection = **** {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.119900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.120151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.120392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.120636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.120874 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.121112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.121350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.121589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.121835 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.122072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.122320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.122556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.122806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.123066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.123314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.123547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.123788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.124024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:37:38.124196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:37:38.125264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.125495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.125740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.134258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.149602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.149911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.150284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.158996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.164439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.164635 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.179376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.179584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.218049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.223263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.269455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.269664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.271142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.271382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.335960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.336161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.336290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.336379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.336471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.336550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.336613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.336737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.336815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.336965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.337098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.337313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.361307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.361547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.361768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.362057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.362143 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.362285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.362369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.362504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.362598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.362730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.362813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.362992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.363215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.363434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.374117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.374843 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.387265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.387563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.387759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.387917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.388004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.388081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.388200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.388290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.388435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.388516 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.388579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.388651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.388799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.389017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:37:38.405850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.406034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 16:37:38.406380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.406524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.406667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 16:37:38.406771 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 16:37:38.406894 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.406999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.407121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.407199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 16:37:38.407366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.407493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.407631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.407712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.407914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.408172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.417570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.417846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.418113 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.418325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.418498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.418609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.418863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.419184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.425311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.426121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.430067 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.430350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.430629 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.430994 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.431118 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.431490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.431638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.431767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.431849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.432098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.432224 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.432373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.432461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.432655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.432782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.432919 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.433000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.433176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.433303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.433454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.433724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.433995 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.456208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.457446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.457695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.457973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.458971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.459248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.462660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.463075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.463360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.464279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.464544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.464845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.470367 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.470586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.471814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.472107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.474744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.475057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.475342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.475623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.475899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.476167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.476294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.476434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.476514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.476698 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.476843 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.476981 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.477258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.477653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.478106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.478553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.492703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.492990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.494669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.494982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.498460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.498853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.501582 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.501582 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.501996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.502284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.504920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.506654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.508130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.510239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.511344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.511639 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.511921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.512207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.512481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.512779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.513445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.513741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.514032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.514321 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.514614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.514898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.528913 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.529197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.529460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.529718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.531441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.531750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.531998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.532261 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.536649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.538204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.538476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.539185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.541144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.541435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.541563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.541702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.542020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.542306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.542590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.544320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.544611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.544913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.545197 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.545494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.554013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.554296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.554575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.554847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.555153 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.555422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.555696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.557353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.557635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.557918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.558203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.558488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.558767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.559086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.571346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.574418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.575197 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.577388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.578675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.579960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.581144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.581551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.581830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.582108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.583804 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.585327 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.585627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.585936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.588827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.590437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.593018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.593454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.594058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.594339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.594622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.594987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.597930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.598222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.598511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.598785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.602690 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.603105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.603401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.607354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.607641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.607925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.610194 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.610468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.610746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.611054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.611338 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.611614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.611891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.612170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.612539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.612819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.613103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.613365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.613646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.613906 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.614811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:37:38.615119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.615402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.615699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.615984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.616256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.616528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.616792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.617163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.617451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.617734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.618008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.618291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.618697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:37:38.647465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fb3a74c9c0 pid: 92121 (default app) Aug 01 16:37:38.651416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5e94-5005-4828-8feb-7a4233b66572 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:38.651707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5e94-5005-4828-8feb-7a4233b66572 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:38.651983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5e94-5005-4828-8feb-7a4233b66572 None None] PATH_INFO: `/v3` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:38.653304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fb3a74c9c0 pid: 92120 (default app) Aug 01 16:37:38.656382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1/1] 10.222.0.124 () {50 vars in 796 bytes} [Mon Aug 1 16:37:38 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:37:46.474463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375a556-df42-409d-bd48-02ae3fa8d4ec None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:46.475433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375a556-df42-409d-bd48-02ae3fa8d4ec None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:46.475433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375a556-df42-409d-bd48-02ae3fa8d4ec None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:46.481379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1/2] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:46 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:37:46.487514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aafcaf-01bb-45eb-9dce-e7c1fbf8a7ac None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:46.487972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aafcaf-01bb-45eb-9dce-e7c1fbf8a7ac None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:46.488064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aafcaf-01bb-45eb-9dce-e7c1fbf8a7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:46.562968 dv-cinder-849890-2-smb devstack@keystone.service[92121]: INFO dbcounter [None req-a1aafcaf-01bb-45eb-9dce-e7c1fbf8a7ac None None] Registered counter for database keystone Aug 01 16:37:46.585003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG oslo_db.sqlalchemy.engines [None req-a1aafcaf-01bb-45eb-9dce-e7c1fbf8a7ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:37:46.597559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writer thread running {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:37:46.791276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG passlib.handlers.bcrypt [None req-a1aafcaf-01bb-45eb-9dce-e7c1fbf8a7ac None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92121) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 16:37:46.791843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG passlib.handlers.bcrypt [None req-a1aafcaf-01bb-45eb-9dce-e7c1fbf8a7ac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92121) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 16:37:46.849175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a1aafcaf-01bb-45eb-9dce-e7c1fbf8a7ac None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:46.851118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a1aafcaf-01bb-45eb-9dce-e7c1fbf8a7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:46.996636 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 2/3] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:46 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 01 16:37:47.164023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375a556-df42-409d-bd48-02ae3fa8d4ec None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:47.236996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: INFO dbcounter [None req-f375a556-df42-409d-bd48-02ae3fa8d4ec None None] Registered counter for database keystone Aug 01 16:37:47.262416 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG oslo_db.sqlalchemy.engines [None req-f375a556-df42-409d-bd48-02ae3fa8d4ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:37:47.270908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writer thread running {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:37:47.391554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375a556-df42-409d-bd48-02ae3fa8d4ec None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:47.397041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdce3d6-1d2a-4362-bf60-859c4a8a423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:47.397715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdce3d6-1d2a-4362-bf60-859c4a8a423d admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:47.397998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdce3d6-1d2a-4362-bf60-859c4a8a423d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:47.398269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdce3d6-1d2a-4362-bf60-859c4a8a423d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:47.407454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdce3d6-1d2a-4362-bf60-859c4a8a423d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:47.460008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9cdce3d6-1d2a-4362-bf60-859c4a8a423d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 16:37:47.460264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdce3d6-1d2a-4362-bf60-859c4a8a423d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:47.471778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 2/4] 10.222.0.124 () {58 vars in 1329 bytes} [Mon Aug 1 16:37:47 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:37:47.481874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aafcaf-01bb-45eb-9dce-e7c1fbf8a7ac None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:47.502464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aafcaf-01bb-45eb-9dce-e7c1fbf8a7ac None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:47.508625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccb5ed-f356-4b5e-99a3-37bd960fb7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:47.509794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccb5ed-f356-4b5e-99a3-37bd960fb7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:47.510077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccb5ed-f356-4b5e-99a3-37bd960fb7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:47.510344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccb5ed-f356-4b5e-99a3-37bd960fb7d2 admin admin] PATH_INFO: `/v3/projects/587d85cd8aa24181b672e7ee967eed1e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:47.512074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccb5ed-f356-4b5e-99a3-37bd960fb7d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=587d85cd8aa24181b672e7ee967eed1e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:47.563753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0fccb5ed-f356-4b5e-99a3-37bd960fb7d2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 16:37:47.564083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccb5ed-f356-4b5e-99a3-37bd960fb7d2 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:47.568921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 3/5] 10.222.0.124 () {56 vars in 1212 bytes} [Mon Aug 1 16:37:47 2022] GET /identity/v3/projects/587d85cd8aa24181b672e7ee967eed1e => generated 345 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:37:49.553874 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b4e4e-422f-4aa7-94b3-1270ad636039 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:49.554653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b4e4e-422f-4aa7-94b3-1270ad636039 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:49.554653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b4e4e-422f-4aa7-94b3-1270ad636039 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:49.562147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 3/6] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:49 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:37:49.570240 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957b6fd-2a2e-4625-a639-247c51fe6f06 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:49.570708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957b6fd-2a2e-4625-a639-247c51fe6f06 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:49.570800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957b6fd-2a2e-4625-a639-247c51fe6f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:49.596529 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f957b6fd-2a2e-4625-a639-247c51fe6f06 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:49.598861 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f957b6fd-2a2e-4625-a639-247c51fe6f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:49.609955 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 4/7] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:49 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 01 16:37:49.632748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b4e4e-422f-4aa7-94b3-1270ad636039 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:49.646421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b4e4e-422f-4aa7-94b3-1270ad636039 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:49.651280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bccaa-838e-4f4c-9273-5c24cca501a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:49.651906 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bccaa-838e-4f4c-9273-5c24cca501a6 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:49.652225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bccaa-838e-4f4c-9273-5c24cca501a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:49.652503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bccaa-838e-4f4c-9273-5c24cca501a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:49.662917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bccaa-838e-4f4c-9273-5c24cca501a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:49.664765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bccaa-838e-4f4c-9273-5c24cca501a6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:49.674545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 4/8] 10.222.0.124 () {58 vars in 1329 bytes} [Mon Aug 1 16:37:49 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:37:49.680715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957b6fd-2a2e-4625-a639-247c51fe6f06 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:49.691095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957b6fd-2a2e-4625-a639-247c51fe6f06 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:49.696535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e5bc5-a16b-44df-813b-7cc1e7cb8211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:49.697178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e5bc5-a16b-44df-813b-7cc1e7cb8211 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:49.697458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e5bc5-a16b-44df-813b-7cc1e7cb8211 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:49.697729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e5bc5-a16b-44df-813b-7cc1e7cb8211 admin admin] PATH_INFO: `/v3/users/92fdc7d8d37b46dea64f38c142a071b0` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:49.699262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e5bc5-a16b-44df-813b-7cc1e7cb8211 admin admin] RBAC: Authorizing `identity:get_user(user_id=92fdc7d8d37b46dea64f38c142a071b0)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:49.701122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e5bc5-a16b-44df-813b-7cc1e7cb8211 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:49.702701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 5/9] 10.222.0.124 () {56 vars in 1203 bytes} [Mon Aug 1 16:37:49 2022] GET /identity/v3/users/92fdc7d8d37b46dea64f38c142a071b0 => generated 248 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:37:51.803817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee13ee9-cf2e-4272-b73e-cf96343117c5 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:51.804366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee13ee9-cf2e-4272-b73e-cf96343117c5 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:51.804366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee13ee9-cf2e-4272-b73e-cf96343117c5 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:51.805697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 5/10] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:37:51.811260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46593fe0-68a1-4972-8d1e-9b4df36e8920 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:51.811726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46593fe0-68a1-4972-8d1e-9b4df36e8920 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:51.811855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46593fe0-68a1-4972-8d1e-9b4df36e8920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:51.821240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c8c8c-3cd7-4f0a-b176-30410a2e31fa None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:51.821525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c8c8c-3cd7-4f0a-b176-30410a2e31fa None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:51.821817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c8c8c-3cd7-4f0a-b176-30410a2e31fa None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:51.823299 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 6/11] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:37:51.828786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f482fe-b16d-474a-a677-8f30b043f98a None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:51.829067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f482fe-b16d-474a-a677-8f30b043f98a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:51.829345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f482fe-b16d-474a-a677-8f30b043f98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:51.833141 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-46593fe0-68a1-4972-8d1e-9b4df36e8920 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:51.834329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-46593fe0-68a1-4972-8d1e-9b4df36e8920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:51.874825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG passlib.handlers.bcrypt [None req-49f482fe-b16d-474a-a677-8f30b043f98a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92120) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 16:37:51.875288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG passlib.handlers.bcrypt [None req-49f482fe-b16d-474a-a677-8f30b043f98a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92120) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 16:37:51.916393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 6/12] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:37:51.920941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-49f482fe-b16d-474a-a677-8f30b043f98a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:51.922565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-49f482fe-b16d-474a-a677-8f30b043f98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:51.939947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46593fe0-68a1-4972-8d1e-9b4df36e8920 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:51.966318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:52.029962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 7/13] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:37:52.051880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46593fe0-68a1-4972-8d1e-9b4df36e8920 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:52.053457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f482fe-b16d-474a-a677-8f30b043f98a None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:52.086508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779ecd-a505-487e-807c-7803f285d48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:52.087098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779ecd-a505-487e-807c-7803f285d48f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:52.087388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779ecd-a505-487e-807c-7803f285d48f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:52.087629 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779ecd-a505-487e-807c-7803f285d48f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:52.100618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7779ecd-a505-487e-807c-7803f285d48f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-c7779ecd-a505-487e-807c-7803f285d48f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:37:52.109503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:37:52.110544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:37:52.111419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 7/14] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:37:52.117044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779ecd-a505-487e-807c-7803f285d48f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:52.161019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f482fe-b16d-474a-a677-8f30b043f98a None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:52.163378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:52.198126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23408b-b410-485f-b428-2b56066c6108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:52.199051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23408b-b410-485f-b428-2b56066c6108 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:52.199342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23408b-b410-485f-b428-2b56066c6108 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:52.199619 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23408b-b410-485f-b428-2b56066c6108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:52.201742 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:52.221564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779ecd-a505-487e-807c-7803f285d48f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:52.258962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1fa1f-be41-4bef-8c35-aea2fef43205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:52.259621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fa1f-be41-4bef-8c35-aea2fef43205 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:52.259905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fa1f-be41-4bef-8c35-aea2fef43205 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:52.260185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fa1f-be41-4bef-8c35-aea2fef43205 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:52.261328 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1fa1f-be41-4bef-8c35-aea2fef43205 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:37:52.261670 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1fa1f-be41-4bef-8c35-aea2fef43205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:52.263116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1fa1f-be41-4bef-8c35-aea2fef43205 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:52.272885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23408b-b410-485f-b428-2b56066c6108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:52.274574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23408b-b410-485f-b428-2b56066c6108 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:52.275205 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 8/15] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:37:52 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:37:52.281120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1fa1f-be41-4bef-8c35-aea2fef43205 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:52.379336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 8/16] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:37:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 16:37:52.384012 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1fa1f-be41-4bef-8c35-aea2fef43205 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:52.385510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23408b-b410-485f-b428-2b56066c6108 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:52.390229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:52.518018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23408b-b410-485f-b428-2b56066c6108 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:52.535767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584ce96-d1da-4a06-b30f-4206a313c3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:52.536427 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584ce96-d1da-4a06-b30f-4206a313c3e0 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:52.536740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584ce96-d1da-4a06-b30f-4206a313c3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:52.537015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584ce96-d1da-4a06-b30f-4206a313c3e0 None admin] PATH_INFO: `/v3/users/92fdc7d8d37b46dea64f38c142a071b0` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:52.538185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584ce96-d1da-4a06-b30f-4206a313c3e0 None admin] RBAC: Authorizing `identity:get_user(user_id=92fdc7d8d37b46dea64f38c142a071b0)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:52.539691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584ce96-d1da-4a06-b30f-4206a313c3e0 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:52.541317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 9/17] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:37:52 2022] GET /identity/v3/users/92fdc7d8d37b46dea64f38c142a071b0 => generated 248 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:37:52.547066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584ce96-d1da-4a06-b30f-4206a313c3e0 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:52.556922 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69994d-f7d0-4943-9b91-e698c134e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:52.557822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69994d-f7d0-4943-9b91-e698c134e64f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:52.558089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69994d-f7d0-4943-9b91-e698c134e64f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:52.558364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69994d-f7d0-4943-9b91-e698c134e64f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:52.562371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:52.577766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69994d-f7d0-4943-9b91-e698c134e64f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:52.579297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69994d-f7d0-4943-9b91-e698c134e64f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-ce69994d-f7d0-4943-9b91-e698c134e64f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:37:52.597702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:37:52.598724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:37:52.599960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:37:52.599960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:37:52.599960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:37:52.599960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:37:52.599960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 9/18] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:37:52.605238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69994d-f7d0-4943-9b91-e698c134e64f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:52.650317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584ce96-d1da-4a06-b30f-4206a313c3e0 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:52.666648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:52.691727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2f9a-fb40-42a0-9871-94816060de8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:52.692384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2f9a-fb40-42a0-9871-94816060de8f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:52.692669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2f9a-fb40-42a0-9871-94816060de8f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:52.692944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2f9a-fb40-42a0-9871-94816060de8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:52.694124 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c2f9a-fb40-42a0-9871-94816060de8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:52.695669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c2f9a-fb40-42a0-9871-94816060de8f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:52.697264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 10/19] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:37:52 2022] GET /identity/v3/domains/default => generated 200 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:37:52.703366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2f9a-fb40-42a0-9871-94816060de8f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:52.714369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69994d-f7d0-4943-9b91-e698c134e64f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:52.750056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162734-940a-4617-9712-ac0fb04948b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:52.750692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162734-940a-4617-9712-ac0fb04948b1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:52.751002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162734-940a-4617-9712-ac0fb04948b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:52.751278 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162734-940a-4617-9712-ac0fb04948b1 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:52.751995 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f162734-940a-4617-9712-ac0fb04948b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:37:52.752301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f162734-940a-4617-9712-ac0fb04948b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:52.754192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f162734-940a-4617-9712-ac0fb04948b1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:52.773483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 10/20] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:37:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:37:52.792470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:52.817392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2f9a-fb40-42a0-9871-94816060de8f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:52.856566 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb203e-0125-4fed-bf57-6e116bb3374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:52.857221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb203e-0125-4fed-bf57-6e116bb3374c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:52.857501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb203e-0125-4fed-bf57-6e116bb3374c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:52.857779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb203e-0125-4fed-bf57-6e116bb3374c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:52.859284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb203e-0125-4fed-bf57-6e116bb3374c None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.domain.id=default, user.id=92fdc7d8d37b46dea64f38c142a071b0) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:37:52.859284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb203e-0125-4fed-bf57-6e116bb3374c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:52.860475 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb203e-0125-4fed-bf57-6e116bb3374c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:52.868674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 11/21] 10.222.0.124 () {56 vars in 1327 bytes} [Mon Aug 1 16:37:52 2022] GET /identity/v3/role_assignments?user.id=92fdc7d8d37b46dea64f38c142a071b0&scope.domain.id=default&role.id=390e487a45f74246ba84773e8760bc7c => generated 234 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:37:55.267277 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe24f3-9733-45c9-9018-569a28ee7395 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:55.267817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe24f3-9733-45c9-9018-569a28ee7395 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:55.267817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe24f3-9733-45c9-9018-569a28ee7395 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:55.269590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 11/22] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:37:55.279465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63751a-0652-4c31-b2db-1e3282182a83 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:55.281482 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63751a-0652-4c31-b2db-1e3282182a83 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:55.281958 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63751a-0652-4c31-b2db-1e3282182a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:55.306039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-dc63751a-0652-4c31-b2db-1e3282182a83 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:55.307753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-dc63751a-0652-4c31-b2db-1e3282182a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:55.315574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67e23-2b8d-47ba-8cab-339e5eb2bab4 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:55.316110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67e23-2b8d-47ba-8cab-339e5eb2bab4 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:55.316574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67e23-2b8d-47ba-8cab-339e5eb2bab4 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:55.318094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 12/23] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:37:55.335078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7f79f-9c78-4c29-b1fd-6b4d5d43e9a8 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:55.335636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7f79f-9c78-4c29-b1fd-6b4d5d43e9a8 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:55.336073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7f79f-9c78-4c29-b1fd-6b4d5d43e9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:55.372198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-dde7f79f-9c78-4c29-b1fd-6b4d5d43e9a8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:55.373774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-dde7f79f-9c78-4c29-b1fd-6b4d5d43e9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:55.411716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 12/24] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:37:55.413469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73884649-c2d3-4fbc-9aef-e95983f171b5 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:55.414304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73884649-c2d3-4fbc-9aef-e95983f171b5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:55.414741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73884649-c2d3-4fbc-9aef-e95983f171b5 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:55.417127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 13/25] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:55 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:37:55.426878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bc447-6cd2-448a-be2b-0d859c532213 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:55.427492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bc447-6cd2-448a-be2b-0d859c532213 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:55.427969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bc447-6cd2-448a-be2b-0d859c532213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:55.464435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-cc5bc447-6cd2-448a-be2b-0d859c532213 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:55.466006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cc5bc447-6cd2-448a-be2b-0d859c532213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:55.511092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 13/26] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:37:55.511997 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7f79f-9c78-4c29-b1fd-6b4d5d43e9a8 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:55.593583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:55.605598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 14/27] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:37:55.606486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bc447-6cd2-448a-be2b-0d859c532213 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:55.612479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:55.681077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7f79f-9c78-4c29-b1fd-6b4d5d43e9a8 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:55.736681 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979ebaa-999c-41ca-8133-92f36f62400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:55.737894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979ebaa-999c-41ca-8133-92f36f62400c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:55.738318 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979ebaa-999c-41ca-8133-92f36f62400c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:55.738755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979ebaa-999c-41ca-8133-92f36f62400c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:55.760410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979ebaa-999c-41ca-8133-92f36f62400c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:55.762351 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979ebaa-999c-41ca-8133-92f36f62400c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-5979ebaa-999c-41ca-8133-92f36f62400c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:37:55.787808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:37:55.788895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:37:55.789854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:37:55.789854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:37:55.789854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:37:55.789854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:37:55.796792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 14/28] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:37:55.798061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979ebaa-999c-41ca-8133-92f36f62400c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:55.818252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bc447-6cd2-448a-be2b-0d859c532213 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:55.890485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba20733-1e7a-4c84-abd7-703c925de4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:55.891136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba20733-1e7a-4c84-abd7-703c925de4d2 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:55.891572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba20733-1e7a-4c84-abd7-703c925de4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:55.891989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba20733-1e7a-4c84-abd7-703c925de4d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:55.904135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba20733-1e7a-4c84-abd7-703c925de4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-2ba20733-1e7a-4c84-abd7-703c925de4d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:37:55.909417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:37:55.910320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:37:55.911127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:37:55.913920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 15/29] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:37:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:37:55.915105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba20733-1e7a-4c84-abd7-703c925de4d2 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:55.949235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:55.953292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979ebaa-999c-41ca-8133-92f36f62400c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:55.995376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:56.034061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba20733-1e7a-4c84-abd7-703c925de4d2 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:56.078323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f74e08-bb05-4cf5-9729-ffe90babc106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:56.079406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f74e08-bb05-4cf5-9729-ffe90babc106 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:56.079907 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f74e08-bb05-4cf5-9729-ffe90babc106 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:56.080467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f74e08-bb05-4cf5-9729-ffe90babc106 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:56.081386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f74e08-bb05-4cf5-9729-ffe90babc106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:37:56.081884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f74e08-bb05-4cf5-9729-ffe90babc106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:56.083533 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f74e08-bb05-4cf5-9729-ffe90babc106 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:56.103429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 16/30] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:37:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:37:56.105571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67fe3-60fd-488a-95f6-54e66050c9ed None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:56.106087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67fe3-60fd-488a-95f6-54e66050c9ed None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:56.106557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67fe3-60fd-488a-95f6-54e66050c9ed None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:56.108236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 17/31] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:37:56.109236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a67fe3-60fd-488a-95f6-54e66050c9ed None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:56.114328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122b0aa-81fb-45a8-a264-aaffea681d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:56.115044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122b0aa-81fb-45a8-a264-aaffea681d6f None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:56.115335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122b0aa-81fb-45a8-a264-aaffea681d6f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:56.115656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122b0aa-81fb-45a8-a264-aaffea681d6f None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:56.116448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122b0aa-81fb-45a8-a264-aaffea681d6f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:56.117877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122b0aa-81fb-45a8-a264-aaffea681d6f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:56.230148 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a67fe3-60fd-488a-95f6-54e66050c9ed None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:56.259585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:56.261822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 15/32] 10.222.0.124 () {60 vars in 1136 bytes} [Mon Aug 1 16:37:55 2022] POST /identity/v3/roles => generated 220 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:37:56.263147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122b0aa-81fb-45a8-a264-aaffea681d6f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:56.273001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968cb4b-a929-48c6-bacb-11f3992e8174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:56.273758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968cb4b-a929-48c6-bacb-11f3992e8174 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:56.274108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968cb4b-a929-48c6-bacb-11f3992e8174 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:56.274460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968cb4b-a929-48c6-bacb-11f3992e8174 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:56.275309 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968cb4b-a929-48c6-bacb-11f3992e8174 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:37:56.275829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968cb4b-a929-48c6-bacb-11f3992e8174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:56.277837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968cb4b-a929-48c6-bacb-11f3992e8174 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:56.299853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 18/33] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:37:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:37:56.305006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cab91-4073-4fe4-9850-8d09b4e5fc2e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:56.305762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cab91-4073-4fe4-9850-8d09b4e5fc2e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:56.306434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cab91-4073-4fe4-9850-8d09b4e5fc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:56.396236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1c6cab91-4073-4fe4-9850-8d09b4e5fc2e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:56.397785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1c6cab91-4073-4fe4-9850-8d09b4e5fc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:56.471545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122b0aa-81fb-45a8-a264-aaffea681d6f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:56.533066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac79e3-eeb2-4000-adb4-a6a847133c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:56.534243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac79e3-eeb2-4000-adb4-a6a847133c3d None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:56.534749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac79e3-eeb2-4000-adb4-a6a847133c3d None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:56.535161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac79e3-eeb2-4000-adb4-a6a847133c3d None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:56.536373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac79e3-eeb2-4000-adb4-a6a847133c3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:56.538204 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac79e3-eeb2-4000-adb4-a6a847133c3d None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:56.538819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 19/34] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:37:56.539960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cab91-4073-4fe4-9850-8d09b4e5fc2e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:56.594515 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 16/35] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:37:56 2022] POST /identity/v3/projects => generated 302 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:37:56.595993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac79e3-eeb2-4000-adb4-a6a847133c3d None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:56.610340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:56.704993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cab91-4073-4fe4-9850-8d09b4e5fc2e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:56.739466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:56.742756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac79e3-eeb2-4000-adb4-a6a847133c3d None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:56.774092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43485068-4513-41ca-b9c7-cfdd6f96b6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:56.775061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43485068-4513-41ca-b9c7-cfdd6f96b6c2 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:56.776392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43485068-4513-41ca-b9c7-cfdd6f96b6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:56.777092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43485068-4513-41ca-b9c7-cfdd6f96b6c2 None admin] PATH_INFO: `/v3/users/92fdc7d8d37b46dea64f38c142a071b0` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:56.778893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43485068-4513-41ca-b9c7-cfdd6f96b6c2 None admin] RBAC: Authorizing `identity:get_user(user_id=92fdc7d8d37b46dea64f38c142a071b0)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:56.780853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43485068-4513-41ca-b9c7-cfdd6f96b6c2 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:56.782928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 20/36] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:37:56 2022] GET /identity/v3/users/92fdc7d8d37b46dea64f38c142a071b0 => generated 248 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:37:56.794616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43485068-4513-41ca-b9c7-cfdd6f96b6c2 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:56.810911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135dda9-b94a-45c0-ae90-7373a20b3f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:56.811669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135dda9-b94a-45c0-ae90-7373a20b3f1a None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:56.811955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135dda9-b94a-45c0-ae90-7373a20b3f1a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:56.812230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135dda9-b94a-45c0-ae90-7373a20b3f1a None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:56.813065 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135dda9-b94a-45c0-ae90-7373a20b3f1a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:56.814635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135dda9-b94a-45c0-ae90-7373a20b3f1a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:56.846236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 17/37] 10.222.0.124 () {60 vars in 1136 bytes} [Mon Aug 1 16:37:56 2022] POST /identity/v3/roles => generated 226 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:37:56.911278 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9b777-a32f-4c68-9a83-506c22f92545 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:56.911568 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9b777-a32f-4c68-9a83-506c22f92545 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:56.911858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9b777-a32f-4c68-9a83-506c22f92545 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:56.916573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 18/38] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:37:56.924863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bddcc8-9de7-47d7-8042-eda8c18285a8 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:56.925255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bddcc8-9de7-47d7-8042-eda8c18285a8 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:56.925661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bddcc8-9de7-47d7-8042-eda8c18285a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:56.948513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-00bddcc8-9de7-47d7-8042-eda8c18285a8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:56.950280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-00bddcc8-9de7-47d7-8042-eda8c18285a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:56.955761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43485068-4513-41ca-b9c7-cfdd6f96b6c2 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:57.000659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88141c6c-2fd7-4ff7-962b-102d7266cb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:57.001732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141c6c-2fd7-4ff7-962b-102d7266cb82 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:57.002188 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141c6c-2fd7-4ff7-962b-102d7266cb82 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:57.002607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141c6c-2fd7-4ff7-962b-102d7266cb82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:57.004115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88141c6c-2fd7-4ff7-962b-102d7266cb82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:57.006196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88141c6c-2fd7-4ff7-962b-102d7266cb82 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:57.009520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 21/39] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:37:56 2022] GET /identity/v3/domains/default => generated 200 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:37:57.020752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88141c6c-2fd7-4ff7-962b-102d7266cb82 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:57.035405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:57.048843 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 19/40] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:37:57.059626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f719b-ea8d-43fa-beda-59b26356b679 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:57.060153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f719b-ea8d-43fa-beda-59b26356b679 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:57.060574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f719b-ea8d-43fa-beda-59b26356b679 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:57.062176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 20/41] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:37:57.068522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e2096-db40-4d72-9bf7-99e9de31bfe0 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:57.068911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e2096-db40-4d72-9bf7-99e9de31bfe0 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:57.069156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e2096-db40-4d72-9bf7-99e9de31bfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:57.094580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ff0e2096-db40-4d72-9bf7-99e9de31bfe0 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:57.095485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ff0e2096-db40-4d72-9bf7-99e9de31bfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:57.107400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:57.164922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88141c6c-2fd7-4ff7-962b-102d7266cb82 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:57.174504 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 21/42] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:37:57.175502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e2096-db40-4d72-9bf7-99e9de31bfe0 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:57.203346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6fb44-d90b-41d9-9981-5db2a5ed5497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:57.204039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6fb44-d90b-41d9-9981-5db2a5ed5497 None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:57.204321 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6fb44-d90b-41d9-9981-5db2a5ed5497 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:57.204880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6fb44-d90b-41d9-9981-5db2a5ed5497 None admin] PATH_INFO: `/v3/domains/default/users/92fdc7d8d37b46dea64f38c142a071b0/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:57.206749 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6fb44-d90b-41d9-9981-5db2a5ed5497 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=92fdc7d8d37b46dea64f38c142a071b0, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:57.208306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6fb44-d90b-41d9-9981-5db2a5ed5497 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:57.284784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e2096-db40-4d72-9bf7-99e9de31bfe0 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:57.316452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:57.322866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2942-0b7f-438a-91f6-449d5ebd2cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:57.323617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2942-0b7f-438a-91f6-449d5ebd2cd2 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:57.323905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2942-0b7f-438a-91f6-449d5ebd2cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:57.324186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2942-0b7f-438a-91f6-449d5ebd2cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:57.324923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f2942-0b7f-438a-91f6-449d5ebd2cd2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:57.326326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f2942-0b7f-438a-91f6-449d5ebd2cd2 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:57.329846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 22/43] 10.222.0.124 () {58 vars in 1366 bytes} [Mon Aug 1 16:37:57 2022] PUT /identity/v3/domains/default/users/92fdc7d8d37b46dea64f38c142a071b0/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:37:57.330911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6fb44-d90b-41d9-9981-5db2a5ed5497 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:57.345058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 22/44] 10.222.0.124 () {60 vars in 1136 bytes} [Mon Aug 1 16:37:57 2022] POST /identity/v3/roles => generated 224 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:37:57.473146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6fb44-d90b-41d9-9981-5db2a5ed5497 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:57.491031 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:57.527343 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c542cb-7e69-4735-a682-e11f630d6ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:57.528063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c542cb-7e69-4735-a682-e11f630d6ab3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:57.528338 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c542cb-7e69-4735-a682-e11f630d6ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:57.528607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c542cb-7e69-4735-a682-e11f630d6ab3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:57.530435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c542cb-7e69-4735-a682-e11f630d6ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:57.532256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c542cb-7e69-4735-a682-e11f630d6ab3 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:57.536849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 23/45] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:37:57 2022] GET /identity/v3/domains/default => generated 200 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:37:57.543787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2942-0b7f-438a-91f6-449d5ebd2cd2 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:57.654648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2942-0b7f-438a-91f6-449d5ebd2cd2 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:57.689379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c4585-cbbd-4912-ad7b-9d6004b241a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:57.690011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4585-cbbd-4912-ad7b-9d6004b241a4 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:57.690293 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4585-cbbd-4912-ad7b-9d6004b241a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:57.690568 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4585-cbbd-4912-ad7b-9d6004b241a4 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:57.691293 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c4585-cbbd-4912-ad7b-9d6004b241a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:57.692753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c4585-cbbd-4912-ad7b-9d6004b241a4 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:57.721105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 23/46] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:37:57 2022] POST /identity/v3/projects => generated 313 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:37:59.387156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e4c7-1ce6-4aea-be50-97ddf408a703 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:59.387755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e4c7-1ce6-4aea-be50-97ddf408a703 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:59.387755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e4c7-1ce6-4aea-be50-97ddf408a703 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:59.389125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 24/47] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:37:59.395120 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458847-60ca-4d3b-a20b-e5ec7f30837b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:59.395685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458847-60ca-4d3b-a20b-e5ec7f30837b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:59.395685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458847-60ca-4d3b-a20b-e5ec7f30837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:59.415886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-5d458847-60ca-4d3b-a20b-e5ec7f30837b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:59.417144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5d458847-60ca-4d3b-a20b-e5ec7f30837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:59.459707 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:59.494239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 24/48] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:37:59.518325 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847e4c7-1ce6-4aea-be50-97ddf408a703 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:59.631863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847e4c7-1ce6-4aea-be50-97ddf408a703 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:59.671905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68426c-59b2-4b4a-84a9-5900884457b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:59.672454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68426c-59b2-4b4a-84a9-5900884457b6 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:59.672747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68426c-59b2-4b4a-84a9-5900884457b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:59.673023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68426c-59b2-4b4a-84a9-5900884457b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:59.685303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68426c-59b2-4b4a-84a9-5900884457b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-8c68426c-59b2-4b4a-84a9-5900884457b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:37:59.690304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:37:59.691203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:37:59.692264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 25/49] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:37:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:37:59.697817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458847-60ca-4d3b-a20b-e5ec7f30837b None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:59.762349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218e2a2-417f-4284-b896-368162596545 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:59.762646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218e2a2-417f-4284-b896-368162596545 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:59.762929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218e2a2-417f-4284-b896-368162596545 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:59.764360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 26/50] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:37:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:37:59.770059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127c888-f529-49a3-b4dd-3bdd2173311b None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:59.770456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127c888-f529-49a3-b4dd-3bdd2173311b None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:59.770863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127c888-f529-49a3-b4dd-3bdd2173311b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:59.791203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f127c888-f529-49a3-b4dd-3bdd2173311b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:37:59.793257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f127c888-f529-49a3-b4dd-3bdd2173311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:37:59.808029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458847-60ca-4d3b-a20b-e5ec7f30837b None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:37:59.833189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:59.844778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3406-7c75-4a3d-b344-8b03649a0e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:37:59.845491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3406-7c75-4a3d-b344-8b03649a0e6d None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:37:59.845892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3406-7c75-4a3d-b344-8b03649a0e6d None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:37:59.846117 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3406-7c75-4a3d-b344-8b03649a0e6d None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:37:59.846866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd3406-7c75-4a3d-b344-8b03649a0e6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:37:59.847198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd3406-7c75-4a3d-b344-8b03649a0e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:37:59.848650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd3406-7c75-4a3d-b344-8b03649a0e6d None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:37:59.860933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 25/51] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:37:59 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:37:59.866522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3406-7c75-4a3d-b344-8b03649a0e6d None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:59.869995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 27/52] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:37:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:37:59.894249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127c888-f529-49a3-b4dd-3bdd2173311b None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:37:59.902517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:59.974538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3406-7c75-4a3d-b344-8b03649a0e6d None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:00.000731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127c888-f529-49a3-b4dd-3bdd2173311b None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:00.016357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6607955-6431-4392-8f93-8e0d72cb2383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:00.017027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6607955-6431-4392-8f93-8e0d72cb2383 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:00.017331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6607955-6431-4392-8f93-8e0d72cb2383 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:00.017610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6607955-6431-4392-8f93-8e0d72cb2383 None admin] PATH_INFO: `/v3/users/92fdc7d8d37b46dea64f38c142a071b0` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:00.019508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6607955-6431-4392-8f93-8e0d72cb2383 None admin] RBAC: Authorizing `identity:get_user(user_id=92fdc7d8d37b46dea64f38c142a071b0)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:00.021170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6607955-6431-4392-8f93-8e0d72cb2383 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:00.023107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 26/53] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:37:59 2022] GET /identity/v3/users/92fdc7d8d37b46dea64f38c142a071b0 => generated 248 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:00.029523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6607955-6431-4392-8f93-8e0d72cb2383 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:00.041293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce6f22-9e96-441b-8e2d-e19c459c3849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:00.042041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6f22-9e96-441b-8e2d-e19c459c3849 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:00.042651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6f22-9e96-441b-8e2d-e19c459c3849 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:00.042651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6f22-9e96-441b-8e2d-e19c459c3849 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:00.043949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce6f22-9e96-441b-8e2d-e19c459c3849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:00.045487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce6f22-9e96-441b-8e2d-e19c459c3849 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:00.047273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 28/54] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:37:59 2022] GET /identity/v3/domains/default => generated 200 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:00.053464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce6f22-9e96-441b-8e2d-e19c459c3849 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:00.099092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:00.147947 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6607955-6431-4392-8f93-8e0d72cb2383 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:00.149827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:00.174021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce6f22-9e96-441b-8e2d-e19c459c3849 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:00.190387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfb350-a8c6-4a9d-a267-26d1c2d20166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:00.191108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb350-a8c6-4a9d-a267-26d1c2d20166 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:00.191394 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb350-a8c6-4a9d-a267-26d1c2d20166 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:00.191673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb350-a8c6-4a9d-a267-26d1c2d20166 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:00.192935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfb350-a8c6-4a9d-a267-26d1c2d20166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:00.194443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfb350-a8c6-4a9d-a267-26d1c2d20166 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:00.196187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 27/55] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:38:00 2022] GET /identity/v3/domains/default => generated 200 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:00.202166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfb350-a8c6-4a9d-a267-26d1c2d20166 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:00.212970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ab947-00f1-434a-bdfc-28ac45a5a7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:00.213979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab947-00f1-434a-bdfc-28ac45a5a7bb None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:00.214279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab947-00f1-434a-bdfc-28ac45a5a7bb None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:00.214555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab947-00f1-434a-bdfc-28ac45a5a7bb None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:00.215305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ab947-00f1-434a-bdfc-28ac45a5a7bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:00.216818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ab947-00f1-434a-bdfc-28ac45a5a7bb None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:00.251157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 29/56] 10.222.0.124 () {60 vars in 1145 bytes} [Mon Aug 1 16:38:00 2022] POST /identity/v3/projects => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:38:00.322848 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfb350-a8c6-4a9d-a267-26d1c2d20166 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:00.373259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4adae-f9b7-47b6-b47a-81b6b693bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:00.373927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4adae-f9b7-47b6-b47a-81b6b693bfda None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:00.374213 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4adae-f9b7-47b6-b47a-81b6b693bfda None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:00.374494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4adae-f9b7-47b6-b47a-81b6b693bfda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:00.375369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4adae-f9b7-47b6-b47a-81b6b693bfda None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.domain.id=default, user.id=92fdc7d8d37b46dea64f38c142a071b0) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:00.375685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4adae-f9b7-47b6-b47a-81b6b693bfda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:00.377337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4adae-f9b7-47b6-b47a-81b6b693bfda None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:00.388713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 28/57] 10.222.0.124 () {56 vars in 1327 bytes} [Mon Aug 1 16:38:00 2022] GET /identity/v3/role_assignments?user.id=92fdc7d8d37b46dea64f38c142a071b0&scope.domain.id=default&role.id=390e487a45f74246ba84773e8760bc7c => generated 532 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:02.337938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de3a8-f2e9-4510-8a17-587a1b4579e4 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:02.338578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de3a8-f2e9-4510-8a17-587a1b4579e4 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:02.338578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de3a8-f2e9-4510-8a17-587a1b4579e4 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:02.340072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 30/58] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:02.346840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d74a06-5386-4664-ad1c-ef4d154797ff None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:02.347445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d74a06-5386-4664-ad1c-ef4d154797ff None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:02.347445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d74a06-5386-4664-ad1c-ef4d154797ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:02.368621 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-26d74a06-5386-4664-ad1c-ef4d154797ff None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:02.370352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-26d74a06-5386-4664-ad1c-ef4d154797ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:02.405404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:02.459632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 29/59] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:02.484942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6de3a8-f2e9-4510-8a17-587a1b4579e4 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:02.590765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:02.603996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6de3a8-f2e9-4510-8a17-587a1b4579e4 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:02.648069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668df65-f4d4-44b1-9571-fd2b921b6b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:02.648965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668df65-f4d4-44b1-9571-fd2b921b6b35 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:02.649313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668df65-f4d4-44b1-9571-fd2b921b6b35 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:02.649629 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668df65-f4d4-44b1-9571-fd2b921b6b35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:02.651357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668df65-f4d4-44b1-9571-fd2b921b6b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:02.652854 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668df65-f4d4-44b1-9571-fd2b921b6b35 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:02.654468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 31/60] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:38:02 2022] GET /identity/v3/domains/default => generated 200 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:02.660461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d74a06-5386-4664-ad1c-ef4d154797ff None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:02.766500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d74a06-5386-4664-ad1c-ef4d154797ff None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:02.803599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dfd0f-1193-4184-a6a2-8aec4f27deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:02.804220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dfd0f-1193-4184-a6a2-8aec4f27deff None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:02.804497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dfd0f-1193-4184-a6a2-8aec4f27deff None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:02.804763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dfd0f-1193-4184-a6a2-8aec4f27deff None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:02.805448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dfd0f-1193-4184-a6a2-8aec4f27deff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:02.807149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dfd0f-1193-4184-a6a2-8aec4f27deff None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:02.837495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 30/61] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:38:02 2022] POST /identity/v3/users => generated 276 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:38:06.048904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4281-95b7-4bfb-84d4-048011fe8fda None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:06.049871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4281-95b7-4bfb-84d4-048011fe8fda None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:06.050368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4281-95b7-4bfb-84d4-048011fe8fda None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:06.052308 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 32/62] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:06.059084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b11a-7efc-447e-af8a-1434b62f67e3 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:06.059599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b11a-7efc-447e-af8a-1434b62f67e3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:06.060058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b11a-7efc-447e-af8a-1434b62f67e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:06.103659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-af20b11a-7efc-447e-af8a-1434b62f67e3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:06.106006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-af20b11a-7efc-447e-af8a-1434b62f67e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:06.144367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:06.246190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 31/63] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:06.292773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c4281-95b7-4bfb-84d4-048011fe8fda None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:06.413176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b380a-b9bf-4d89-9365-50861088b230 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:06.413359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b380a-b9bf-4d89-9365-50861088b230 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:06.413644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b380a-b9bf-4d89-9365-50861088b230 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:06.415548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 32/64] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:06.428856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5f79-aba9-4430-bca8-096b0d18b4ac None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:06.429500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5f79-aba9-4430-bca8-096b0d18b4ac None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:06.429975 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5f79-aba9-4430-bca8-096b0d18b4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:06.460295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-5a1d5f79-aba9-4430-bca8-096b0d18b4ac None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:06.464661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5a1d5f79-aba9-4430-bca8-096b0d18b4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:06.491098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c4281-95b7-4bfb-84d4-048011fe8fda None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:06.560878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05927ba8-2055-4542-a887-f28deca76c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:06.561547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05927ba8-2055-4542-a887-f28deca76c9c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:06.561833 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05927ba8-2055-4542-a887-f28deca76c9c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:06.562364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05927ba8-2055-4542-a887-f28deca76c9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:06.582922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05927ba8-2055-4542-a887-f28deca76c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-05927ba8-2055-4542-a887-f28deca76c9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:06.589268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:06.590323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:06.591371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:06.596580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 33/65] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:06.606440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05927ba8-2055-4542-a887-f28deca76c9c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:06.627781 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 33/66] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:06.629942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85251b8-c2d4-44d0-b992-8d2fd4488919 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:06.630450 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85251b8-c2d4-44d0-b992-8d2fd4488919 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:06.630916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85251b8-c2d4-44d0-b992-8d2fd4488919 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:06.632622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 34/67] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:06.641634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87757-48d5-4ad2-b946-0ecff6798e80 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:06.642398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87757-48d5-4ad2-b946-0ecff6798e80 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:06.642897 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87757-48d5-4ad2-b946-0ecff6798e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:06.644266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:06.668175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4eb87757-48d5-4ad2-b946-0ecff6798e80 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:06.669914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4eb87757-48d5-4ad2-b946-0ecff6798e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:06.743184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 35/68] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:06.744106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb87757-48d5-4ad2-b946-0ecff6798e80 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:06.755602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05927ba8-2055-4542-a887-f28deca76c9c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:06.769507 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:06.799353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6e4b1-7956-453d-b001-c4c35692a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:06.800355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6e4b1-7956-453d-b001-c4c35692a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:06.801333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6e4b1-7956-453d-b001-c4c35692a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:06.801823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6e4b1-7956-453d-b001-c4c35692a3f9 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:06.802874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6e4b1-7956-453d-b001-c4c35692a3f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:06.803492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6e4b1-7956-453d-b001-c4c35692a3f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:06.805168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6e4b1-7956-453d-b001-c4c35692a3f9 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:06.815986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 34/69] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:06 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:06.817361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6e4b1-7956-453d-b001-c4c35692a3f9 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:06.881010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb87757-48d5-4ad2-b946-0ecff6798e80 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:06.916147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:06.924853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48e55-1e72-4ab0-9d0e-2791b34bb169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:06.926385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48e55-1e72-4ab0-9d0e-2791b34bb169 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:06.927254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48e55-1e72-4ab0-9d0e-2791b34bb169 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:06.928046 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48e55-1e72-4ab0-9d0e-2791b34bb169 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:06.941393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6e4b1-7956-453d-b001-c4c35692a3f9 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:06.950296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca48e55-1e72-4ab0-9d0e-2791b34bb169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-cca48e55-1e72-4ab0-9d0e-2791b34bb169 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:06.963722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:06.965420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:06.966911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:06.971743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 36/70] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:38:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:06.973507 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48e55-1e72-4ab0-9d0e-2791b34bb169 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:06.980296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39ebc-3529-4a2c-b0c8-38a938318c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:06.981039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39ebc-3529-4a2c-b0c8-38a938318c11 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:06.981325 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39ebc-3529-4a2c-b0c8-38a938318c11 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:06.981599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39ebc-3529-4a2c-b0c8-38a938318c11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:07.001098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d39ebc-3529-4a2c-b0c8-38a938318c11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-a3d39ebc-3529-4a2c-b0c8-38a938318c11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:07.008999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:07.010152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:07.010904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:07.012487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 35/71] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:07.018022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39ebc-3529-4a2c-b0c8-38a938318c11 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:07.081477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:07.132413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48e55-1e72-4ab0-9d0e-2791b34bb169 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:07.165284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39ebc-3529-4a2c-b0c8-38a938318c11 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:07.175862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8c6fa-d578-4075-9727-22787191bab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:07.176528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8c6fa-d578-4075-9727-22787191bab5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:07.176818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8c6fa-d578-4075-9727-22787191bab5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:07.177090 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8c6fa-d578-4075-9727-22787191bab5 None admin] PATH_INFO: `/v3/users/640696f6e9954a98a5d477fef0c386bb` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:07.195728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8c6fa-d578-4075-9727-22787191bab5 None admin] RBAC: Authorizing `identity:get_user(user_id=640696f6e9954a98a5d477fef0c386bb)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:07.197502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8c6fa-d578-4075-9727-22787191bab5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:07.199490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 37/72] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:06 2022] GET /identity/v3/users/640696f6e9954a98a5d477fef0c386bb => generated 276 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:07.200346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8c6fa-d578-4075-9727-22787191bab5 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:07.212271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f51069-2838-4dda-98f0-1ef63f52f4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:07.213054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f51069-2838-4dda-98f0-1ef63f52f4dd None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:07.213440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f51069-2838-4dda-98f0-1ef63f52f4dd None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:07.213727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f51069-2838-4dda-98f0-1ef63f52f4dd None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:07.214515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f51069-2838-4dda-98f0-1ef63f52f4dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:07.214827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f51069-2838-4dda-98f0-1ef63f52f4dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:07.216351 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f51069-2838-4dda-98f0-1ef63f52f4dd None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:07.232214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 36/73] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:07 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:07.232214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b65d9-e3f4-4d82-8d4e-4dcf03463164 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:07.232214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b65d9-e3f4-4d82-8d4e-4dcf03463164 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:07.232214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b65d9-e3f4-4d82-8d4e-4dcf03463164 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:07.232214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 37/74] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:07.233388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b65d9-e3f4-4d82-8d4e-4dcf03463164 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:07.237073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:07.344334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8c6fa-d578-4075-9727-22787191bab5 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:07.368655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b65d9-e3f4-4d82-8d4e-4dcf03463164 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:07.375158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:07.390031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c615c-508e-4c1c-a0d4-abd14340cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:07.391467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c615c-508e-4c1c-a0d4-abd14340cde0 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:07.392267 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c615c-508e-4c1c-a0d4-abd14340cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:07.392685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c615c-508e-4c1c-a0d4-abd14340cde0 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:07.393808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c615c-508e-4c1c-a0d4-abd14340cde0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:07.394309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c615c-508e-4c1c-a0d4-abd14340cde0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:07.395934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c615c-508e-4c1c-a0d4-abd14340cde0 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:07.408236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 38/75] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:07 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:07.409314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c615c-508e-4c1c-a0d4-abd14340cde0 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:07.418109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ffd06-3289-43dc-9de1-323995471778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:07.419173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ffd06-3289-43dc-9de1-323995471778 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:07.419663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ffd06-3289-43dc-9de1-323995471778 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:07.420393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ffd06-3289-43dc-9de1-323995471778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:07.528706 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ffd06-3289-43dc-9de1-323995471778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:07.530404 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ffd06-3289-43dc-9de1-323995471778 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:07.533020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:07.545918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c615c-508e-4c1c-a0d4-abd14340cde0 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:07.587461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28410269-7092-4454-b319-b14a5063cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:07.588157 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28410269-7092-4454-b319-b14a5063cdbe None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:07.588441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28410269-7092-4454-b319-b14a5063cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:07.588722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28410269-7092-4454-b319-b14a5063cdbe None admin] PATH_INFO: `/v3/users/92fdc7d8d37b46dea64f38c142a071b0` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:07.589977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28410269-7092-4454-b319-b14a5063cdbe None admin] RBAC: Authorizing `identity:get_user(user_id=92fdc7d8d37b46dea64f38c142a071b0)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:07.591492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28410269-7092-4454-b319-b14a5063cdbe None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:07.593855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 39/76] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:07 2022] GET /identity/v3/users/92fdc7d8d37b46dea64f38c142a071b0 => generated 248 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:07.594667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef029a-9ef3-4e7a-812a-d2c20f9151bf None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:07.594973 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef029a-9ef3-4e7a-812a-d2c20f9151bf None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:07.595248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef029a-9ef3-4e7a-812a-d2c20f9151bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:07.615809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-edef029a-9ef3-4e7a-812a-d2c20f9151bf None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:07.617928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-edef029a-9ef3-4e7a-812a-d2c20f9151bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:07.663476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 38/77] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:07.665277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306e229-1f18-4612-8ea4-c1d9061a503a None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:07.665731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306e229-1f18-4612-8ea4-c1d9061a503a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:07.666271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306e229-1f18-4612-8ea4-c1d9061a503a None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:07.667963 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 39/78] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:07.671238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306e229-1f18-4612-8ea4-c1d9061a503a None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:07.699836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:07.720085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 40/79] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:07.721508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef029a-9ef3-4e7a-812a-d2c20f9151bf None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:07.810677 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306e229-1f18-4612-8ea4-c1d9061a503a None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:07.813110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:07.862167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e5c36-1088-4e78-ae3a-6142d9cf6ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:07.862676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef029a-9ef3-4e7a-812a-d2c20f9151bf None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:07.863039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e5c36-1088-4e78-ae3a-6142d9cf6ca0 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:07.863039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e5c36-1088-4e78-ae3a-6142d9cf6ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:07.863039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e5c36-1088-4e78-ae3a-6142d9cf6ca0 None admin] PATH_INFO: `/v3/users/640696f6e9954a98a5d477fef0c386bb` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:07.865174 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e5c36-1088-4e78-ae3a-6142d9cf6ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=640696f6e9954a98a5d477fef0c386bb)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:07.866652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e5c36-1088-4e78-ae3a-6142d9cf6ca0 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:07.868331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 40/80] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:07 2022] GET /identity/v3/users/640696f6e9954a98a5d477fef0c386bb => generated 276 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:07.869312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e5c36-1088-4e78-ae3a-6142d9cf6ca0 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:07.902327 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1785c1-c939-41f6-af6d-ed4ad4ea1ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:07.903015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1785c1-c939-41f6-af6d-ed4ad4ea1ea5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:07.903298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1785c1-c939-41f6-af6d-ed4ad4ea1ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:07.903580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1785c1-c939-41f6-af6d-ed4ad4ea1ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:07.969066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:07.982919 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1785c1-c939-41f6-af6d-ed4ad4ea1ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:07.984452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1785c1-c939-41f6-af6d-ed4ad4ea1ea5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:07.986451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e5c36-1088-4e78-ae3a-6142d9cf6ca0 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:08.027370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9f756-1d42-4226-b6e5-385871f9cefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:08.028038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9f756-1d42-4226-b6e5-385871f9cefb None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:08.028330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9f756-1d42-4226-b6e5-385871f9cefb None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:08.028606 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9f756-1d42-4226-b6e5-385871f9cefb None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:08.029847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9f756-1d42-4226-b6e5-385871f9cefb None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:08.031359 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9f756-1d42-4226-b6e5-385871f9cefb None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:08.033108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 41/81] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:07 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:08.035196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39c915-d7d5-4b0b-bd90-121819fa4907 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:08.035196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39c915-d7d5-4b0b-bd90-121819fa4907 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:08.035196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39c915-d7d5-4b0b-bd90-121819fa4907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:08.054465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6b39c915-d7d5-4b0b-bd90-121819fa4907 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:08.055737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6b39c915-d7d5-4b0b-bd90-121819fa4907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:08.093215 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:08.135855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 42/82] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:08.144451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 41/83] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:08.144958 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39c915-d7d5-4b0b-bd90-121819fa4907 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:08.145086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1785c1-c939-41f6-af6d-ed4ad4ea1ea5 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:08.269028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:08.274565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39c915-d7d5-4b0b-bd90-121819fa4907 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:08.284527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1785c1-c939-41f6-af6d-ed4ad4ea1ea5 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:08.315269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a539bb-ee1c-42ea-a081-7620025099a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:08.315928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a539bb-ee1c-42ea-a081-7620025099a5 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:08.316231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a539bb-ee1c-42ea-a081-7620025099a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:08.316663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a539bb-ee1c-42ea-a081-7620025099a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:08.322820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d953e-f9c2-49b0-a9af-208b921ab7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:08.323551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d953e-f9c2-49b0-a9af-208b921ab7c1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:08.323834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d953e-f9c2-49b0-a9af-208b921ab7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:08.324108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d953e-f9c2-49b0-a9af-208b921ab7c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:08.328838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a539bb-ee1c-42ea-a081-7620025099a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-d3a539bb-ee1c-42ea-a081-7620025099a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:08.334032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:08.334995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:08.335780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 43/84] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:08.336419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a539bb-ee1c-42ea-a081-7620025099a5 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:08.366474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:08.398691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d953e-f9c2-49b0-a9af-208b921ab7c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:08.400342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d953e-f9c2-49b0-a9af-208b921ab7c1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:08.446461 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a539bb-ee1c-42ea-a081-7620025099a5 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:08.483938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875819f-8daf-47d9-9cef-65e018f44a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:08.484587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875819f-8daf-47d9-9cef-65e018f44a88 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:08.484920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875819f-8daf-47d9-9cef-65e018f44a88 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:08.485128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875819f-8daf-47d9-9cef-65e018f44a88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:08.485964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875819f-8daf-47d9-9cef-65e018f44a88 None admin] RBAC: Adding query filter params (role.id=a1ce48deeb3148e28049f10600de5fbe, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15, user.id=640696f6e9954a98a5d477fef0c386bb) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:08.486275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875819f-8daf-47d9-9cef-65e018f44a88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:08.487846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875819f-8daf-47d9-9cef-65e018f44a88 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:08.496432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 44/85] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:08 2022] GET /identity/v3/role_assignments?user.id=640696f6e9954a98a5d477fef0c386bb&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:08.496432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875819f-8daf-47d9-9cef-65e018f44a88 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:08.516671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:08.534288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 42/86] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:08.535167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d953e-f9c2-49b0-a9af-208b921ab7c1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:08.622201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:08.633136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875819f-8daf-47d9-9cef-65e018f44a88 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:08.661221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d953e-f9c2-49b0-a9af-208b921ab7c1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:08.684927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077da97-d178-49e1-8eaf-38388265a309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:08.685716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077da97-d178-49e1-8eaf-38388265a309 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:08.686002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077da97-d178-49e1-8eaf-38388265a309 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:08.687109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077da97-d178-49e1-8eaf-38388265a309 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:08.689597 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077da97-d178-49e1-8eaf-38388265a309 None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:08.692331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077da97-d178-49e1-8eaf-38388265a309 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:08.695019 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 45/87] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:08 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:08.696742 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077da97-d178-49e1-8eaf-38388265a309 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:08.703257 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c0801-121f-488c-abf7-a3ce8c0117c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:08.703936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c0801-121f-488c-abf7-a3ce8c0117c9 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:08.704214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c0801-121f-488c-abf7-a3ce8c0117c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:08.704485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c0801-121f-488c-abf7-a3ce8c0117c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:08.705863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c0801-121f-488c-abf7-a3ce8c0117c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:08.707563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c0801-121f-488c-abf7-a3ce8c0117c9 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:08.709540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 43/88] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:38:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:08.710191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c0801-121f-488c-abf7-a3ce8c0117c9 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:08.791309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:08.842276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077da97-d178-49e1-8eaf-38388265a309 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:08.845795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c0801-121f-488c-abf7-a3ce8c0117c9 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:08.892827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de7a20-3b66-4623-af71-02f477328a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:08.893383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7a20-3b66-4623-af71-02f477328a33 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:08.893704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7a20-3b66-4623-af71-02f477328a33 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:08.894059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7a20-3b66-4623-af71-02f477328a33 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:08.894807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de7a20-3b66-4623-af71-02f477328a33 None admin] RBAC: Adding query filter params (name=member) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:08.895151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de7a20-3b66-4623-af71-02f477328a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:08.896567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de7a20-3b66-4623-af71-02f477328a33 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:08.897561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a6d42-2d28-4f89-ae2a-b2746a65bc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:08.898439 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a6d42-2d28-4f89-ae2a-b2746a65bc4c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:08.898922 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a6d42-2d28-4f89-ae2a-b2746a65bc4c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:08.899224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a6d42-2d28-4f89-ae2a-b2746a65bc4c None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:08.900464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a6d42-2d28-4f89-ae2a-b2746a65bc4c None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:08.902005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a6d42-2d28-4f89-ae2a-b2746a65bc4c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:08.908784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 44/89] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:08 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:08.908784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a6d42-2d28-4f89-ae2a-b2746a65bc4c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:08.912277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 46/90] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:08 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:08.913272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de7a20-3b66-4623-af71-02f477328a33 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:08.961574 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:09.062207 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a6d42-2d28-4f89-ae2a-b2746a65bc4c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:09.070780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de7a20-3b66-4623-af71-02f477328a33 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:09.093527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:09.110001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a88896-a93f-423a-9ddb-ee8753eadd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:09.110825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a88896-a93f-423a-9ddb-ee8753eadd7b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:09.111135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a88896-a93f-423a-9ddb-ee8753eadd7b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:09.111417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a88896-a93f-423a-9ddb-ee8753eadd7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:09.112250 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a88896-a93f-423a-9ddb-ee8753eadd7b None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15, user.id=92fdc7d8d37b46dea64f38c142a071b0) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:09.112649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a88896-a93f-423a-9ddb-ee8753eadd7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:09.114082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a88896-a93f-423a-9ddb-ee8753eadd7b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:09.120460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 45/91] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:08 2022] GET /identity/v3/role_assignments?user.id=92fdc7d8d37b46dea64f38c142a071b0&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=390e487a45f74246ba84773e8760bc7c => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:09.121573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a88896-a93f-423a-9ddb-ee8753eadd7b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:09.132460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1345b-e366-4d75-9c89-3f1e0e48d15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:09.133530 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1345b-e366-4d75-9c89-3f1e0e48d15c None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:09.134004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1345b-e366-4d75-9c89-3f1e0e48d15c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:09.134701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1345b-e366-4d75-9c89-3f1e0e48d15c None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:09.136270 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1345b-e366-4d75-9c89-3f1e0e48d15c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:09.139723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1345b-e366-4d75-9c89-3f1e0e48d15c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:09.178829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 47/92] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:38:08 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:38:09.181494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1345b-e366-4d75-9c89-3f1e0e48d15c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:09.331391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a88896-a93f-423a-9ddb-ee8753eadd7b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:09.395485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1d3e2-b06a-42ac-8c6a-e918264b24a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:09.396888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1d3e2-b06a-42ac-8c6a-e918264b24a6 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:09.397571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1d3e2-b06a-42ac-8c6a-e918264b24a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:09.398224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1d3e2-b06a-42ac-8c6a-e918264b24a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:09.400071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1d3e2-b06a-42ac-8c6a-e918264b24a6 None admin] RBAC: Adding query filter params (role.id=1f3d7dea677f4b82a9728c6f9083d706, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15, user.id=640696f6e9954a98a5d477fef0c386bb) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:09.400903 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1d3e2-b06a-42ac-8c6a-e918264b24a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:09.404000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1d3e2-b06a-42ac-8c6a-e918264b24a6 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:09.415084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 46/93] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:09 2022] GET /identity/v3/role_assignments?user.id=640696f6e9954a98a5d477fef0c386bb&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=1f3d7dea677f4b82a9728c6f9083d706 => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:09.436312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:09.478983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1345b-e366-4d75-9c89-3f1e0e48d15c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:09.544543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d973a8-9cce-4853-816d-7d20de98fb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:09.545239 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d973a8-9cce-4853-816d-7d20de98fb74 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:09.545524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d973a8-9cce-4853-816d-7d20de98fb74 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:09.545807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d973a8-9cce-4853-816d-7d20de98fb74 None admin] PATH_INFO: `/v3/users/640696f6e9954a98a5d477fef0c386bb` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:09.547255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d973a8-9cce-4853-816d-7d20de98fb74 None admin] RBAC: Authorizing `identity:get_user(user_id=640696f6e9954a98a5d477fef0c386bb)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:09.548838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d973a8-9cce-4853-816d-7d20de98fb74 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:09.550938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 48/94] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:09 2022] GET /identity/v3/users/640696f6e9954a98a5d477fef0c386bb => generated 276 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:09.557662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1d3e2-b06a-42ac-8c6a-e918264b24a6 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:09.645484 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:09.731668 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1d3e2-b06a-42ac-8c6a-e918264b24a6 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:09.785837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948bc82-30df-4b09-8983-cd001cf25ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:09.786743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948bc82-30df-4b09-8983-cd001cf25ea4 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:09.787198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948bc82-30df-4b09-8983-cd001cf25ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:09.787644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948bc82-30df-4b09-8983-cd001cf25ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:09.882023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948bc82-30df-4b09-8983-cd001cf25ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:09.883587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948bc82-30df-4b09-8983-cd001cf25ea4 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:09.952990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:10.024481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 47/95] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:10.031837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d973a8-9cce-4853-816d-7d20de98fb74 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:10.167691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d973a8-9cce-4853-816d-7d20de98fb74 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:10.208332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68cb6d-2f3e-4163-a543-928c90f06083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:10.209006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68cb6d-2f3e-4163-a543-928c90f06083 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:10.209289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68cb6d-2f3e-4163-a543-928c90f06083 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:10.209564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68cb6d-2f3e-4163-a543-928c90f06083 None admin] PATH_INFO: `/v3/projects/2d02d2873bdc4a8683bba452d3f3290e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:10.210915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68cb6d-2f3e-4163-a543-928c90f06083 None admin] RBAC: Authorizing `identity:get_project(project_id=2d02d2873bdc4a8683bba452d3f3290e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:10.212558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68cb6d-2f3e-4163-a543-928c90f06083 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:10.214406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 49/96] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:10 2022] GET /identity/v3/projects/2d02d2873bdc4a8683bba452d3f3290e => generated 313 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:10.220985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948bc82-30df-4b09-8983-cd001cf25ea4 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:10.359090 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948bc82-30df-4b09-8983-cd001cf25ea4 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:10.402775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cc4f7-09d7-411d-b324-1379d17dc261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:10.403459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc4f7-09d7-411d-b324-1379d17dc261 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:10.403795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc4f7-09d7-411d-b324-1379d17dc261 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:10.404075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc4f7-09d7-411d-b324-1379d17dc261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:10.404893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cc4f7-09d7-411d-b324-1379d17dc261 None admin] RBAC: Adding query filter params (role.id=a1ce48deeb3148e28049f10600de5fbe, scope.project.id=2d02d2873bdc4a8683bba452d3f3290e, user.id=640696f6e9954a98a5d477fef0c386bb) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:10.405204 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cc4f7-09d7-411d-b324-1379d17dc261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:10.406916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cc4f7-09d7-411d-b324-1379d17dc261 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:10.414341 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 48/97] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:10 2022] GET /identity/v3/role_assignments?user.id=640696f6e9954a98a5d477fef0c386bb&scope.project.id=2d02d2873bdc4a8683bba452d3f3290e&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:11.428016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860a96c-a392-4830-8c70-bb16255d5d71 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:11.428558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860a96c-a392-4830-8c70-bb16255d5d71 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:11.428558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860a96c-a392-4830-8c70-bb16255d5d71 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:11.429951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 50/98] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:11.439850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a333b2-d3dc-41a6-8ce3-8e97e6e66494 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:11.440404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a333b2-d3dc-41a6-8ce3-8e97e6e66494 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:11.440404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a333b2-d3dc-41a6-8ce3-8e97e6e66494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:11.464314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-33a333b2-d3dc-41a6-8ce3-8e97e6e66494 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:11.465541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-33a333b2-d3dc-41a6-8ce3-8e97e6e66494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:11.482520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:11.564927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 49/99] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:11.600501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860a96c-a392-4830-8c70-bb16255d5d71 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:11.617182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:11.751713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860a96c-a392-4830-8c70-bb16255d5d71 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:11.798675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8cc8f-0fa9-4225-b2e3-c6b1c4d3e3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:11.799386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8cc8f-0fa9-4225-b2e3-c6b1c4d3e3fe None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:11.799671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8cc8f-0fa9-4225-b2e3-c6b1c4d3e3fe None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:11.799951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8cc8f-0fa9-4225-b2e3-c6b1c4d3e3fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:11.818095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8cc8f-0fa9-4225-b2e3-c6b1c4d3e3fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-dde8cc8f-0fa9-4225-b2e3-c6b1c4d3e3fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:11.823456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:11.824320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:11.825074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 51/100] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:11.830764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a333b2-d3dc-41a6-8ce3-8e97e6e66494 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:12.008778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a333b2-d3dc-41a6-8ce3-8e97e6e66494 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:12.043071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783056-38f4-4dbc-9a02-8d628a197f07 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:12.045490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783056-38f4-4dbc-9a02-8d628a197f07 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:12.045490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783056-38f4-4dbc-9a02-8d628a197f07 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:12.045490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 52/101] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:12.051074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f287-45ef-465e-a669-0c02176628ee None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:12.051369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f287-45ef-465e-a669-0c02176628ee None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:12.051754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f287-45ef-465e-a669-0c02176628ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:12.054306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a00c31-e5a1-4e9c-8981-1cd6258e6e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:12.055014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00c31-e5a1-4e9c-8981-1cd6258e6e4b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:12.055254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00c31-e5a1-4e9c-8981-1cd6258e6e4b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:12.055525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00c31-e5a1-4e9c-8981-1cd6258e6e4b None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:12.056302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a00c31-e5a1-4e9c-8981-1cd6258e6e4b None admin] RBAC: Adding query filter params (name=member) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:12.056605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a00c31-e5a1-4e9c-8981-1cd6258e6e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:12.057999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a00c31-e5a1-4e9c-8981-1cd6258e6e4b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:12.072370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 50/102] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:11 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:12.079452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a00c31-e5a1-4e9c-8981-1cd6258e6e4b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:12.096113 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b3a6f287-45ef-465e-a669-0c02176628ee None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:12.097377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b3a6f287-45ef-465e-a669-0c02176628ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:12.101798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:12.250301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a00c31-e5a1-4e9c-8981-1cd6258e6e4b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:12.280433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 53/103] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:12.325183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a18785-64f6-4160-b1a0-b215c273e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:12.326730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a18785-64f6-4160-b1a0-b215c273e69f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:12.327293 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a18785-64f6-4160-b1a0-b215c273e69f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:12.327768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a18785-64f6-4160-b1a0-b215c273e69f None admin] PATH_INFO: `/v3/users/640696f6e9954a98a5d477fef0c386bb` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:12.331760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a18785-64f6-4160-b1a0-b215c273e69f None admin] RBAC: Authorizing `identity:get_user(user_id=640696f6e9954a98a5d477fef0c386bb)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:12.332276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6f287-45ef-465e-a669-0c02176628ee None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:12.333875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a18785-64f6-4160-b1a0-b215c273e69f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:12.336274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 51/104] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:12 2022] GET /identity/v3/users/640696f6e9954a98a5d477fef0c386bb => generated 276 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:12.343184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a18785-64f6-4160-b1a0-b215c273e69f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:12.344820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:12.494761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:12.544103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a18785-64f6-4160-b1a0-b215c273e69f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:12.583875 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6f287-45ef-465e-a669-0c02176628ee None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:12.613173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580e2ee-cd9f-42a8-af18-de7523106fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:12.613841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580e2ee-cd9f-42a8-af18-de7523106fcd None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:12.614131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580e2ee-cd9f-42a8-af18-de7523106fcd None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:12.614421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580e2ee-cd9f-42a8-af18-de7523106fcd None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:12.615660 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580e2ee-cd9f-42a8-af18-de7523106fcd None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:12.617137 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580e2ee-cd9f-42a8-af18-de7523106fcd None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:12.619200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 52/105] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:12 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:12.628853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b934e-b477-40e9-8991-e5b9b37039ef None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:12.629223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b934e-b477-40e9-8991-e5b9b37039ef None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:12.629522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b934e-b477-40e9-8991-e5b9b37039ef None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:12.630936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 53/106] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:12 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:12.631684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b934e-b477-40e9-8991-e5b9b37039ef None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:12.659934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ebaf4-1957-4cc4-b1b5-a0a5b1ac4d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:12.660614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ebaf4-1957-4cc4-b1b5-a0a5b1ac4d00 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:12.660889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ebaf4-1957-4cc4-b1b5-a0a5b1ac4d00 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:12.661165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ebaf4-1957-4cc4-b1b5-a0a5b1ac4d00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:12.684604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ebaf4-1957-4cc4-b1b5-a0a5b1ac4d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-340ebaf4-1957-4cc4-b1b5-a0a5b1ac4d00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:12.689707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:12.690590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:12.691379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 54/107] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:12.692796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf5a7f-4955-480f-8c9a-f6f82eb36766 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:12.692796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf5a7f-4955-480f-8c9a-f6f82eb36766 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:12.692796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf5a7f-4955-480f-8c9a-f6f82eb36766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:12.738207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-38bf5a7f-4955-480f-8c9a-f6f82eb36766 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:12.739468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-38bf5a7f-4955-480f-8c9a-f6f82eb36766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:12.843588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b934e-b477-40e9-8991-e5b9b37039ef None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:12.857933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:12.868569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 55/108] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:12.869875 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf5a7f-4955-480f-8c9a-f6f82eb36766 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:12.897253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ad6e0-a0bf-4422-b106-698d398dcc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:12.897965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ad6e0-a0bf-4422-b106-698d398dcc9d None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:12.898252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ad6e0-a0bf-4422-b106-698d398dcc9d None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:12.898534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ad6e0-a0bf-4422-b106-698d398dcc9d None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/users/640696f6e9954a98a5d477fef0c386bb/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:12.904481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ad6e0-a0bf-4422-b106-698d398dcc9d None admin] RBAC: Authorizing `identity:create_grant(project_id=32937f53ee28435c9dcbea8b3d17dd15, user_id=640696f6e9954a98a5d477fef0c386bb, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:12.905971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ad6e0-a0bf-4422-b106-698d398dcc9d None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:12.930180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 54/109] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:38:12 2022] PUT /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/users/640696f6e9954a98a5d477fef0c386bb/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:12.931999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b884-cbdd-4164-bbf2-0f529f91a379 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:12.932345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b884-cbdd-4164-bbf2-0f529f91a379 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:12.932748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b884-cbdd-4164-bbf2-0f529f91a379 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:12.934387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 55/110] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:12.935199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45b884-cbdd-4164-bbf2-0f529f91a379 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:12.939759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:13.032329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf5a7f-4955-480f-8c9a-f6f82eb36766 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:13.076379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc298a-ad3e-4258-b204-0ee9ef9b749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:13.077077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc298a-ad3e-4258-b204-0ee9ef9b749c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.077458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc298a-ad3e-4258-b204-0ee9ef9b749c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.077738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc298a-ad3e-4258-b204-0ee9ef9b749c None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.078600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc298a-ad3e-4258-b204-0ee9ef9b749c None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:13.078914 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc298a-ad3e-4258-b204-0ee9ef9b749c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:13.080493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc298a-ad3e-4258-b204-0ee9ef9b749c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:13.082233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45b884-cbdd-4164-bbf2-0f529f91a379 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:13.092495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 56/111] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:12 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:13.094040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000446df-424b-4ec6-95ed-2a6a3638a0b4 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.094268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000446df-424b-4ec6-95ed-2a6a3638a0b4 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.094552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000446df-424b-4ec6-95ed-2a6a3638a0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.115987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-000446df-424b-4ec6-95ed-2a6a3638a0b4 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:13.117358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-000446df-424b-4ec6-95ed-2a6a3638a0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:13.125748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d06638-4f26-4670-a934-b308dc55b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:13.126575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d06638-4f26-4670-a934-b308dc55b6a9 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.127004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d06638-4f26-4670-a934-b308dc55b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.127420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d06638-4f26-4670-a934-b308dc55b6a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.140799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d06638-4f26-4670-a934-b308dc55b6a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-e2d06638-4f26-4670-a934-b308dc55b6a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:13.146410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:13.148748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 56/112] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:13.150230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2647-1a44-4ff7-add2-99f3e97da65c None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.151046 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2647-1a44-4ff7-add2-99f3e97da65c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.151046 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2647-1a44-4ff7-add2-99f3e97da65c None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.155057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 57/113] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:13.155057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2647-1a44-4ff7-add2-99f3e97da65c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:13.180319 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:13.206364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 57/114] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:13.207286 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000446df-424b-4ec6-95ed-2a6a3638a0b4 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:13.242735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:13.285820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2647-1a44-4ff7-add2-99f3e97da65c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:13.323828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26605ac6-2ebd-477b-86f4-9469ab806bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:13.324676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26605ac6-2ebd-477b-86f4-9469ab806bba None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.325102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26605ac6-2ebd-477b-86f4-9469ab806bba None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.325481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26605ac6-2ebd-477b-86f4-9469ab806bba None admin] PATH_INFO: `/v3/users/92fdc7d8d37b46dea64f38c142a071b0` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.326912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26605ac6-2ebd-477b-86f4-9469ab806bba None admin] RBAC: Authorizing `identity:get_user(user_id=92fdc7d8d37b46dea64f38c142a071b0)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:13.328731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26605ac6-2ebd-477b-86f4-9469ab806bba None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:13.331049 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 58/115] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:13 2022] GET /identity/v3/users/92fdc7d8d37b46dea64f38c142a071b0 => generated 248 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:13.332558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b551c-4c80-40f1-8ca3-cb6893b4dcdb None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.332945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b551c-4c80-40f1-8ca3-cb6893b4dcdb None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.333321 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b551c-4c80-40f1-8ca3-cb6893b4dcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.348123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000446df-424b-4ec6-95ed-2a6a3638a0b4 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:13.354969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-563b551c-4c80-40f1-8ca3-cb6893b4dcdb None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:13.356420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-563b551c-4c80-40f1-8ca3-cb6893b4dcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:13.396165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9d337-d809-46de-88f0-fc5c2bd36fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:13.396970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9d337-d809-46de-88f0-fc5c2bd36fc0 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.397374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9d337-d809-46de-88f0-fc5c2bd36fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.397659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9d337-d809-46de-88f0-fc5c2bd36fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.398416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9d337-d809-46de-88f0-fc5c2bd36fc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:13.398721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9d337-d809-46de-88f0-fc5c2bd36fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:13.401040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9d337-d809-46de-88f0-fc5c2bd36fc0 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:13.412652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 58/116] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:13 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:13.414119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9d337-d809-46de-88f0-fc5c2bd36fc0 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:13.452260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 59/117] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:13.453259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b551c-4c80-40f1-8ca3-cb6893b4dcdb None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:13.489713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:13.530766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:13.560433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9d337-d809-46de-88f0-fc5c2bd36fc0 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:13.578850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b551c-4c80-40f1-8ca3-cb6893b4dcdb None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:13.601964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f7f79-6d79-4065-9d6c-cb1045afefbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:13.602672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f7f79-6d79-4065-9d6c-cb1045afefbd None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.602805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f7f79-6d79-4065-9d6c-cb1045afefbd None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.603222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f7f79-6d79-4065-9d6c-cb1045afefbd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.614136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f7f79-6d79-4065-9d6c-cb1045afefbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:13.616403 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75248161-7fee-4c9b-aff6-a10d76d94f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:13.617082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248161-7fee-4c9b-aff6-a10d76d94f04 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.617365 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248161-7fee-4c9b-aff6-a10d76d94f04 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.617643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248161-7fee-4c9b-aff6-a10d76d94f04 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.619373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75248161-7fee-4c9b-aff6-a10d76d94f04 None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-d97f7f79-6d79-4065-9d6c-cb1045afefbd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:13.619940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:13.620798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:13.621542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:13.622110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75248161-7fee-4c9b-aff6-a10d76d94f04 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:13.622173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 59/118] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:13.622173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f7f79-6d79-4065-9d6c-cb1045afefbd None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:13.625959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 60/119] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:13 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:13.625959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75248161-7fee-4c9b-aff6-a10d76d94f04 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:13.745213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f7f79-6d79-4065-9d6c-cb1045afefbd None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:13.745660 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75248161-7fee-4c9b-aff6-a10d76d94f04 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:13.755955 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:13.779044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:13.786142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4a4c8-baae-4fd4-89fa-a62e521c53c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:13.786569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de10f63-8983-44e2-99ae-9f0ba1f62cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:13.786799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a4c8-baae-4fd4-89fa-a62e521c53c9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.787129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a4c8-baae-4fd4-89fa-a62e521c53c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.787287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de10f63-8983-44e2-99ae-9f0ba1f62cc2 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.787408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a4c8-baae-4fd4-89fa-a62e521c53c9 None admin] PATH_INFO: `/v3/users/640696f6e9954a98a5d477fef0c386bb` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.787561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de10f63-8983-44e2-99ae-9f0ba1f62cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.787955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de10f63-8983-44e2-99ae-9f0ba1f62cc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.788634 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4a4c8-baae-4fd4-89fa-a62e521c53c9 None admin] RBAC: Authorizing `identity:get_user(user_id=640696f6e9954a98a5d477fef0c386bb)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:13.789111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de10f63-8983-44e2-99ae-9f0ba1f62cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:13.790408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4a4c8-baae-4fd4-89fa-a62e521c53c9 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:13.791070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de10f63-8983-44e2-99ae-9f0ba1f62cc2 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:13.799008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 61/120] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:38:13 2022] GET /identity/v3/domains/default => generated 200 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:13.799008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feb011-1ec8-4389-a17d-dd288a94e5e6 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.799008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feb011-1ec8-4389-a17d-dd288a94e5e6 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.799008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feb011-1ec8-4389-a17d-dd288a94e5e6 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.801635 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 60/121] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:13 2022] GET /identity/v3/users/640696f6e9954a98a5d477fef0c386bb => generated 276 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:13.801716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 62/122] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:13.801782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4a4c8-baae-4fd4-89fa-a62e521c53c9 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:13.801853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feb011-1ec8-4389-a17d-dd288a94e5e6 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:13.911729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feb011-1ec8-4389-a17d-dd288a94e5e6 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:13.926830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4a4c8-baae-4fd4-89fa-a62e521c53c9 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:13.948753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654769-a752-4283-9249-9064f2428591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:13.949446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654769-a752-4283-9249-9064f2428591 None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.949726 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654769-a752-4283-9249-9064f2428591 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.950020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654769-a752-4283-9249-9064f2428591 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/users/92fdc7d8d37b46dea64f38c142a071b0/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.952029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4654769-a752-4283-9249-9064f2428591 None admin] RBAC: Authorizing `identity:create_grant(project_id=32937f53ee28435c9dcbea8b3d17dd15, user_id=92fdc7d8d37b46dea64f38c142a071b0, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:13.953701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4654769-a752-4283-9249-9064f2428591 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:13.964099 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ff273-659c-476f-9f80-a695811efe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:13.964834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff273-659c-476f-9f80-a695811efe91 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:13.965090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff273-659c-476f-9f80-a695811efe91 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:13.965437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff273-659c-476f-9f80-a695811efe91 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:13.966252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ff273-659c-476f-9f80-a695811efe91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:13.967018 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ff273-659c-476f-9f80-a695811efe91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:13.968693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ff273-659c-476f-9f80-a695811efe91 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:13.979097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 63/123] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:38:13 2022] PUT /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/users/92fdc7d8d37b46dea64f38c142a071b0/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:13.979097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654769-a752-4283-9249-9064f2428591 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:13.979369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 61/124] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:13 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:13.979369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ff273-659c-476f-9f80-a695811efe91 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:14.045966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:14.078910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:14.135991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654769-a752-4283-9249-9064f2428591 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:14.143369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ff273-659c-476f-9f80-a695811efe91 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:14.186417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d1bf8-c00b-4c0d-95bc-283596cd05d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:14.187049 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d1bf8-c00b-4c0d-95bc-283596cd05d8 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:14.187428 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d1bf8-c00b-4c0d-95bc-283596cd05d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:14.187705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d1bf8-c00b-4c0d-95bc-283596cd05d8 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:14.187803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620829f6-07f3-402c-b9aa-e16745f95882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:14.188458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620829f6-07f3-402c-b9aa-e16745f95882 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:14.188578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d1bf8-c00b-4c0d-95bc-283596cd05d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:14.188730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620829f6-07f3-402c-b9aa-e16745f95882 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:14.188963 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620829f6-07f3-402c-b9aa-e16745f95882 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:14.190342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620829f6-07f3-402c-b9aa-e16745f95882 None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:14.190445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d1bf8-c00b-4c0d-95bc-283596cd05d8 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:14.191926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620829f6-07f3-402c-b9aa-e16745f95882 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:14.193735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 62/125] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:13 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:14.194909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe7175-047d-46ed-adbe-23270aec3634 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:14.195240 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe7175-047d-46ed-adbe-23270aec3634 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:14.195504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe7175-047d-46ed-adbe-23270aec3634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:14.220782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-75fe7175-047d-46ed-adbe-23270aec3634 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:14.222419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-75fe7175-047d-46ed-adbe-23270aec3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:14.233002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 64/126] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:38:13 2022] POST /identity/v3/projects => generated 303 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:38:14.234406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d1bf8-c00b-4c0d-95bc-283596cd05d8 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:14.357812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 63/127] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:14.358763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe7175-047d-46ed-adbe-23270aec3634 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:14.371138 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d1bf8-c00b-4c0d-95bc-283596cd05d8 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:14.386548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:14.426682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36079b9c-cef4-4832-ad86-9cca4155b707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:14.427563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079b9c-cef4-4832-ad86-9cca4155b707 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:14.427954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079b9c-cef4-4832-ad86-9cca4155b707 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:14.428353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079b9c-cef4-4832-ad86-9cca4155b707 None admin] PATH_INFO: `/v3/users/39560b0e06eb42bb833267e094500984` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:14.431753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:14.455453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36079b9c-cef4-4832-ad86-9cca4155b707 None admin] RBAC: Authorizing `identity:get_user(user_id=39560b0e06eb42bb833267e094500984)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:14.457128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36079b9c-cef4-4832-ad86-9cca4155b707 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:14.459250 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 65/128] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:14 2022] GET /identity/v3/users/39560b0e06eb42bb833267e094500984 => generated 290 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:14.460065 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36079b9c-cef4-4832-ad86-9cca4155b707 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:14.579240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36079b9c-cef4-4832-ad86-9cca4155b707 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:14.601098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe7175-047d-46ed-adbe-23270aec3634 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:14.627797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b09f2-eb8d-47e9-899c-dd1b6cbb206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:14.629310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b09f2-eb8d-47e9-899c-dd1b6cbb206a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:14.629740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b09f2-eb8d-47e9-899c-dd1b6cbb206a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:14.630439 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b09f2-eb8d-47e9-899c-dd1b6cbb206a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:14.645208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b09f2-eb8d-47e9-899c-dd1b6cbb206a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:14.646547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290715e6-5d8b-4a25-8b2a-986310836e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:14.647360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290715e6-5d8b-4a25-8b2a-986310836e7e None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:14.647710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290715e6-5d8b-4a25-8b2a-986310836e7e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:14.648056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290715e6-5d8b-4a25-8b2a-986310836e7e None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/users/640696f6e9954a98a5d477fef0c386bb/roles/1f3d7dea677f4b82a9728c6f9083d706` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:14.651566 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290715e6-5d8b-4a25-8b2a-986310836e7e None admin] RBAC: Authorizing `identity:create_grant(project_id=32937f53ee28435c9dcbea8b3d17dd15, user_id=640696f6e9954a98a5d477fef0c386bb, role_id=1f3d7dea677f4b82a9728c6f9083d706)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d66b09f2-eb8d-47e9-899c-dd1b6cbb206a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:14.652135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:14.653170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:14.654220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:14.656063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290715e6-5d8b-4a25-8b2a-986310836e7e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:14.656792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 66/129] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:14.657854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b09f2-eb8d-47e9-899c-dd1b6cbb206a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:14.676398 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 64/130] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:38:14 2022] PUT /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/users/640696f6e9954a98a5d477fef0c386bb/roles/1f3d7dea677f4b82a9728c6f9083d706 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:14.677593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290715e6-5d8b-4a25-8b2a-986310836e7e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:14.708183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:14.801795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:14.812977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290715e6-5d8b-4a25-8b2a-986310836e7e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:14.863607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a94ff-b3b1-4d60-9a55-d2bae9cac56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:14.864945 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a94ff-b3b1-4d60-9a55-d2bae9cac56a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:14.865492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a94ff-b3b1-4d60-9a55-d2bae9cac56a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:14.866191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a94ff-b3b1-4d60-9a55-d2bae9cac56a None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:14.867175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a94ff-b3b1-4d60-9a55-d2bae9cac56a None admin] RBAC: Adding query filter params (name=member) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:14.867702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a94ff-b3b1-4d60-9a55-d2bae9cac56a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:14.869442 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a94ff-b3b1-4d60-9a55-d2bae9cac56a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:14.881126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 65/131] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:14 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:14.882336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b09f2-eb8d-47e9-899c-dd1b6cbb206a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:14.893827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a94ff-b3b1-4d60-9a55-d2bae9cac56a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:14.955790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff57b3-1e61-480a-badb-512e336799e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:14.957691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff57b3-1e61-480a-badb-512e336799e9 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:14.958462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff57b3-1e61-480a-badb-512e336799e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:14.960129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff57b3-1e61-480a-badb-512e336799e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:15.067605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff57b3-1e61-480a-badb-512e336799e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:15.069572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff57b3-1e61-480a-badb-512e336799e9 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:15.079195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a94ff-b3b1-4d60-9a55-d2bae9cac56a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:15.101159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:15.140829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b38ae-3092-41d3-8316-2f00e640afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:15.141514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b38ae-3092-41d3-8316-2f00e640afa5 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:15.141798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b38ae-3092-41d3-8316-2f00e640afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:15.142084 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b38ae-3092-41d3-8316-2f00e640afa5 None admin] PATH_INFO: `/v3/users/640696f6e9954a98a5d477fef0c386bb` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:15.143370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b38ae-3092-41d3-8316-2f00e640afa5 None admin] RBAC: Authorizing `identity:get_user(user_id=640696f6e9954a98a5d477fef0c386bb)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:15.144774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b38ae-3092-41d3-8316-2f00e640afa5 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:15.150156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 66/132] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:14 2022] GET /identity/v3/users/640696f6e9954a98a5d477fef0c386bb => generated 276 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:15.166207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b38ae-3092-41d3-8316-2f00e640afa5 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:15.193505 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 67/133] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:15.209054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff57b3-1e61-480a-badb-512e336799e9 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:15.231486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:15.324124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff57b3-1e61-480a-badb-512e336799e9 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:15.348131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b38ae-3092-41d3-8316-2f00e640afa5 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:15.356083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:15.375784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037e75-12c0-4a35-88d3-24bf93beeb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:15.376894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037e75-12c0-4a35-88d3-24bf93beeb66 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:15.377400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037e75-12c0-4a35-88d3-24bf93beeb66 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:15.377880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037e75-12c0-4a35-88d3-24bf93beeb66 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:15.379523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e037e75-12c0-4a35-88d3-24bf93beeb66 None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:15.381283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e037e75-12c0-4a35-88d3-24bf93beeb66 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:15.386891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 68/134] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:15 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:15.396304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037e75-12c0-4a35-88d3-24bf93beeb66 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:15.404425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab76b1-8997-4c1c-aa3e-d686faf34b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:15.405340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab76b1-8997-4c1c-aa3e-d686faf34b1d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:15.405639 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab76b1-8997-4c1c-aa3e-d686faf34b1d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:15.405896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab76b1-8997-4c1c-aa3e-d686faf34b1d None admin] PATH_INFO: `/v3/projects/2d02d2873bdc4a8683bba452d3f3290e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:15.410121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab76b1-8997-4c1c-aa3e-d686faf34b1d None admin] RBAC: Authorizing `identity:get_project(project_id=2d02d2873bdc4a8683bba452d3f3290e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:15.411686 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab76b1-8997-4c1c-aa3e-d686faf34b1d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:15.417077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 67/135] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:15 2022] GET /identity/v3/projects/2d02d2873bdc4a8683bba452d3f3290e => generated 313 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:15.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab76b1-8997-4c1c-aa3e-d686faf34b1d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:15.522441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037e75-12c0-4a35-88d3-24bf93beeb66 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:15.566387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2a547-cb17-4ea2-9b4b-9c0f0e50fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:15.567574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2a547-cb17-4ea2-9b4b-9c0f0e50fe92 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:15.568057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2a547-cb17-4ea2-9b4b-9c0f0e50fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:15.568972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2a547-cb17-4ea2-9b4b-9c0f0e50fe92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:15.570519 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2a547-cb17-4ea2-9b4b-9c0f0e50fe92 None admin] RBAC: Adding query filter params (role.id=1aeb3352b3fb4ab79fd7171fec026530, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15, user.id=39560b0e06eb42bb833267e094500984) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:15.571249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2a547-cb17-4ea2-9b4b-9c0f0e50fe92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:15.574009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2a547-cb17-4ea2-9b4b-9c0f0e50fe92 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:15.588635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 69/136] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:15 2022] GET /identity/v3/role_assignments?user.id=39560b0e06eb42bb833267e094500984&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=1aeb3352b3fb4ab79fd7171fec026530 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:15.592435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486550d0-ee31-45df-b918-6bdae6da88ba None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:15.594160 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486550d0-ee31-45df-b918-6bdae6da88ba None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:15.594688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486550d0-ee31-45df-b918-6bdae6da88ba None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:15.596613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 70/137] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:15 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:15.603177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05222177-529d-4d06-b99b-e742acc02551 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:15.603794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05222177-529d-4d06-b99b-e742acc02551 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:15.604269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05222177-529d-4d06-b99b-e742acc02551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:15.649144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-05222177-529d-4d06-b99b-e742acc02551 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:15.650817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-05222177-529d-4d06-b99b-e742acc02551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:15.651351 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:15.664252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab76b1-8997-4c1c-aa3e-d686faf34b1d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:15.735055 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:15.741548 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c034c-08ba-47b1-8f9d-d13cfd3e24a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:15.742335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c034c-08ba-47b1-8f9d-d13cfd3e24a0 None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:15.742577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c034c-08ba-47b1-8f9d-d13cfd3e24a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:15.742857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c034c-08ba-47b1-8f9d-d13cfd3e24a0 None admin] PATH_INFO: `/v3/projects/2d02d2873bdc4a8683bba452d3f3290e/users/640696f6e9954a98a5d477fef0c386bb/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:15.752445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c034c-08ba-47b1-8f9d-d13cfd3e24a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d02d2873bdc4a8683bba452d3f3290e, user_id=640696f6e9954a98a5d477fef0c386bb, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:15.759190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 71/138] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:15.761678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c034c-08ba-47b1-8f9d-d13cfd3e24a0 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:15.786366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 68/139] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:38:15 2022] PUT /identity/v3/projects/2d02d2873bdc4a8683bba452d3f3290e/users/640696f6e9954a98a5d477fef0c386bb/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:15.818594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05222177-529d-4d06-b99b-e742acc02551 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:15.960315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05222177-529d-4d06-b99b-e742acc02551 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:16.005722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8390d68-e7aa-41fc-95f4-e5796e38f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:16.006887 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8390d68-e7aa-41fc-95f4-e5796e38f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:16.007350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8390d68-e7aa-41fc-95f4-e5796e38f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:16.007775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8390d68-e7aa-41fc-95f4-e5796e38f9d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:16.025760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8390d68-e7aa-41fc-95f4-e5796e38f9d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-e8390d68-e7aa-41fc-95f4-e5796e38f9d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:16.031765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:16.032888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:16.033890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:16.040348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 72/140] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:16.046792 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c034c-08ba-47b1-8f9d-d13cfd3e24a0 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:16.173811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c034c-08ba-47b1-8f9d-d13cfd3e24a0 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:16.222660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9db81f-57ed-44b8-9121-3661db78f006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:16.223655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9db81f-57ed-44b8-9121-3661db78f006 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:16.224101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9db81f-57ed-44b8-9121-3661db78f006 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:16.224520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9db81f-57ed-44b8-9121-3661db78f006 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:16.225400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9db81f-57ed-44b8-9121-3661db78f006 None admin] RBAC: Adding query filter params (name=member) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:16.225890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9db81f-57ed-44b8-9121-3661db78f006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:16.227509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9db81f-57ed-44b8-9121-3661db78f006 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:16.240212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 69/141] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:16 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:16.243613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8390d68-e7aa-41fc-95f4-e5796e38f9d7 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:16.299871 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:16.391309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8390d68-e7aa-41fc-95f4-e5796e38f9d7 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:16.435879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bd7bc-22cf-4709-babd-6a14a4dfa965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:16.436975 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd7bc-22cf-4709-babd-6a14a4dfa965 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:16.437445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd7bc-22cf-4709-babd-6a14a4dfa965 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:16.437866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd7bc-22cf-4709-babd-6a14a4dfa965 None admin] PATH_INFO: `/v3/users/640696f6e9954a98a5d477fef0c386bb` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:16.439525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bd7bc-22cf-4709-babd-6a14a4dfa965 None admin] RBAC: Authorizing `identity:get_user(user_id=640696f6e9954a98a5d477fef0c386bb)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:16.441249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bd7bc-22cf-4709-babd-6a14a4dfa965 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:16.443254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 73/142] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:16 2022] GET /identity/v3/users/640696f6e9954a98a5d477fef0c386bb => generated 276 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:16.449711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9db81f-57ed-44b8-9121-3661db78f006 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:16.475390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:16.566709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9db81f-57ed-44b8-9121-3661db78f006 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:16.602216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd227bf-edb1-4e7b-93e0-0435741d1f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:16.602933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd227bf-edb1-4e7b-93e0-0435741d1f79 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:16.603257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd227bf-edb1-4e7b-93e0-0435741d1f79 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:16.603532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd227bf-edb1-4e7b-93e0-0435741d1f79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:16.676631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd227bf-edb1-4e7b-93e0-0435741d1f79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:16.678122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd227bf-edb1-4e7b-93e0-0435741d1f79 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:16.696862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:16.789065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 70/143] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:16 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:16.795056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bd7bc-22cf-4709-babd-6a14a4dfa965 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:16.808609 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff5d8-9f3d-4de4-bdc3-2bbba7220919 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:16.808964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff5d8-9f3d-4de4-bdc3-2bbba7220919 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:16.809160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff5d8-9f3d-4de4-bdc3-2bbba7220919 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:16.810549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 71/144] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:16.816190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543383c7-0252-4fe8-8cb2-fd8ad227c758 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:16.816471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543383c7-0252-4fe8-8cb2-fd8ad227c758 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:16.816803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543383c7-0252-4fe8-8cb2-fd8ad227c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:16.858380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-543383c7-0252-4fe8-8cb2-fd8ad227c758 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:16.859823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-543383c7-0252-4fe8-8cb2-fd8ad227c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:16.941562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 72/145] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:16.968080 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543383c7-0252-4fe8-8cb2-fd8ad227c758 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:17.001569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bd7bc-22cf-4709-babd-6a14a4dfa965 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:17.026026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:17.039347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:17.077835 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97407e1-8157-466b-85da-e11a00c6c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:17.078851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97407e1-8157-466b-85da-e11a00c6c472 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:17.079365 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97407e1-8157-466b-85da-e11a00c6c472 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:17.079921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97407e1-8157-466b-85da-e11a00c6c472 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:17.083606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97407e1-8157-466b-85da-e11a00c6c472 None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:17.085472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97407e1-8157-466b-85da-e11a00c6c472 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:17.087808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 74/146] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:16 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:17.093532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543383c7-0252-4fe8-8cb2-fd8ad227c758 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:17.106574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97407e1-8157-466b-85da-e11a00c6c472 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:17.134692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0978c8e-12f1-4719-adef-d94223c40f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:17.135578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978c8e-12f1-4719-adef-d94223c40f67 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:17.135794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978c8e-12f1-4719-adef-d94223c40f67 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:17.136068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978c8e-12f1-4719-adef-d94223c40f67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:17.147259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0978c8e-12f1-4719-adef-d94223c40f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-e0978c8e-12f1-4719-adef-d94223c40f67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:17.153169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:17.154252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:17.155225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:17.162982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 73/147] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:17.163327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0978c8e-12f1-4719-adef-d94223c40f67 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:17.269061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0978c8e-12f1-4719-adef-d94223c40f67 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:17.277094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:17.284529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97407e1-8157-466b-85da-e11a00c6c472 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:17.325030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3b68-8804-41e7-a451-a5e6367960a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:17.325982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dd59d-dd2c-4a48-ae01-1f9cf2218844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:17.326817 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3b68-8804-41e7-a451-a5e6367960a6 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:17.327683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dd59d-dd2c-4a48-ae01-1f9cf2218844 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:17.328222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3b68-8804-41e7-a451-a5e6367960a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:17.328921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3b68-8804-41e7-a451-a5e6367960a6 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:17.329170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dd59d-dd2c-4a48-ae01-1f9cf2218844 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:17.329600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dd59d-dd2c-4a48-ae01-1f9cf2218844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:17.330521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c3b68-8804-41e7-a451-a5e6367960a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:17.331558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dd59d-dd2c-4a48-ae01-1f9cf2218844 None admin] RBAC: Adding query filter params (role.id=a1ce48deeb3148e28049f10600de5fbe, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15, user.id=640696f6e9954a98a5d477fef0c386bb) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:17.332038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c3b68-8804-41e7-a451-a5e6367960a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:17.332510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dd59d-dd2c-4a48-ae01-1f9cf2218844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:17.334090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c3b68-8804-41e7-a451-a5e6367960a6 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:17.335728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dd59d-dd2c-4a48-ae01-1f9cf2218844 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:17.348262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 75/148] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:17 2022] GET /identity/v3/role_assignments?user.id=640696f6e9954a98a5d477fef0c386bb&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 610 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:17.352550 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 74/149] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:17 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:17.358886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dd59d-dd2c-4a48-ae01-1f9cf2218844 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:17.419923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:17.473357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dd59d-dd2c-4a48-ae01-1f9cf2218844 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:17.512227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fe116-da33-42d1-acb4-6861f0038dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:17.512974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fe116-da33-42d1-acb4-6861f0038dec None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:17.513265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fe116-da33-42d1-acb4-6861f0038dec None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:17.513544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fe116-da33-42d1-acb4-6861f0038dec None admin] PATH_INFO: `/v3/users/92fdc7d8d37b46dea64f38c142a071b0` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:17.514979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fe116-da33-42d1-acb4-6861f0038dec None admin] RBAC: Authorizing `identity:get_user(user_id=92fdc7d8d37b46dea64f38c142a071b0)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:17.516514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fe116-da33-42d1-acb4-6861f0038dec None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:17.518251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 76/150] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:17 2022] GET /identity/v3/users/92fdc7d8d37b46dea64f38c142a071b0 => generated 248 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:17.524220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3b68-8804-41e7-a451-a5e6367960a6 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:17.584231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4aced-3ff9-45ef-8827-796eafffe2a4 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:17.584519 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4aced-3ff9-45ef-8827-796eafffe2a4 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:17.584698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4aced-3ff9-45ef-8827-796eafffe2a4 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:17.586273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 77/151] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:38:17.592712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c5d87-0759-487a-9fa8-e4c35e344496 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:17.593000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c5d87-0759-487a-9fa8-e4c35e344496 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:17.593327 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c5d87-0759-487a-9fa8-e4c35e344496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:17.624635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-183c5d87-0759-487a-9fa8-e4c35e344496 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:17.625917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-183c5d87-0759-487a-9fa8-e4c35e344496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:17.733672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3b68-8804-41e7-a451-a5e6367960a6 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:17.777502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 78/152] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:17.805499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c5d87-0759-487a-9fa8-e4c35e344496 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:17.809251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a136-1051-475c-b75f-978cb4470c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:17.809905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a136-1051-475c-b75f-978cb4470c3c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:17.810300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a136-1051-475c-b75f-978cb4470c3c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:17.810773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a136-1051-475c-b75f-978cb4470c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:17.860550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:17.905961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:17.918119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c5d87-0759-487a-9fa8-e4c35e344496 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:17.955027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8fbb7-982d-4473-b3b1-e7d5a64eec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:17.956142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fbb7-982d-4473-b3b1-e7d5a64eec84 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:17.956562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fbb7-982d-4473-b3b1-e7d5a64eec84 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:17.956998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fbb7-982d-4473-b3b1-e7d5a64eec84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:17.958335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8fbb7-982d-4473-b3b1-e7d5a64eec84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:17.960079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8fbb7-982d-4473-b3b1-e7d5a64eec84 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:17.962393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 79/153] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:38:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:17.963787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e1844-ec52-4af4-9da0-5b344272384d None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:17.964210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e1844-ec52-4af4-9da0-5b344272384d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:17.964652 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e1844-ec52-4af4-9da0-5b344272384d None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:17.966837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 80/154] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:17.972761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46e7b0-2cba-4639-9acd-5179a02d21bc None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:17.973223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46e7b0-2cba-4639-9acd-5179a02d21bc None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:17.973636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46e7b0-2cba-4639-9acd-5179a02d21bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:17.980744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0a136-1051-475c-b75f-978cb4470c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:17.982873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0a136-1051-475c-b75f-978cb4470c3c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:17.994798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-5f46e7b0-2cba-4639-9acd-5179a02d21bc None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:17.996367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5f46e7b0-2cba-4639-9acd-5179a02d21bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:18.109980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 81/155] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:18.111866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46e7b0-2cba-4639-9acd-5179a02d21bc None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:18.151769 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 75/156] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:17 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:18.171084 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a136-1051-475c-b75f-978cb4470c3c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:18.203331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:18.287881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:18.296629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46e7b0-2cba-4639-9acd-5179a02d21bc None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:18.338641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a136-1051-475c-b75f-978cb4470c3c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:18.342980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bb66b-6b23-4753-a247-7f461c86eab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:18.343693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb66b-6b23-4753-a247-7f461c86eab3 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:18.344021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb66b-6b23-4753-a247-7f461c86eab3 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:18.344301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb66b-6b23-4753-a247-7f461c86eab3 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:18.345000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bb66b-6b23-4753-a247-7f461c86eab3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:18.346467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bb66b-6b23-4753-a247-7f461c86eab3 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:18.371522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 82/157] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:38:18 2022] POST /identity/v3/users => generated 284 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:38:18.375997 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bb66b-6b23-4753-a247-7f461c86eab3 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:18.387924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ec998-fc73-4042-b5a0-305ec56d56b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:18.388625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ec998-fc73-4042-b5a0-305ec56d56b4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:18.388910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ec998-fc73-4042-b5a0-305ec56d56b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:18.389191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ec998-fc73-4042-b5a0-305ec56d56b4 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:18.392596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ec998-fc73-4042-b5a0-305ec56d56b4 None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:18.398488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ec998-fc73-4042-b5a0-305ec56d56b4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:18.402587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 76/158] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:18 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:18.416893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ec998-fc73-4042-b5a0-305ec56d56b4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:18.592217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bb66b-6b23-4753-a247-7f461c86eab3 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:18.595256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:18.628091 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ec998-fc73-4042-b5a0-305ec56d56b4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:18.650385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b11aae-f930-468a-9fcf-a3c73bd79bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:18.651584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11aae-f930-468a-9fcf-a3c73bd79bc8 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:18.652067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11aae-f930-468a-9fcf-a3c73bd79bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:18.652594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11aae-f930-468a-9fcf-a3c73bd79bc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:18.668988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b11aae-f930-468a-9fcf-a3c73bd79bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:18.672646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aeacae-0f05-439f-9996-879e4483bb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:18.673503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeacae-0f05-439f-9996-879e4483bb37 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:18.673956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeacae-0f05-439f-9996-879e4483bb37 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:18.674414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeacae-0f05-439f-9996-879e4483bb37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-94b11aae-f930-468a-9fcf-a3c73bd79bc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:18.675580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:18.676633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:18.677616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:18.678878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aeacae-0f05-439f-9996-879e4483bb37 None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15, user.id=92fdc7d8d37b46dea64f38c142a071b0) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:18.679372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aeacae-0f05-439f-9996-879e4483bb37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:18.679533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 83/159] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:18.681329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aeacae-0f05-439f-9996-879e4483bb37 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:18.688545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 77/160] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:18 2022] GET /identity/v3/role_assignments?user.id=92fdc7d8d37b46dea64f38c142a071b0&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=390e487a45f74246ba84773e8760bc7c => generated 610 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:18.688913 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:18.690889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b11aae-f930-468a-9fcf-a3c73bd79bc8 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:18.745211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a4670-f158-46ad-b488-759690a82279 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:18.745768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a4670-f158-46ad-b488-759690a82279 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:18.745768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a4670-f158-46ad-b488-759690a82279 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:18.747329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 78/161] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:18.755085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9b283-e521-4f0f-8388-ad0a4ad65aa9 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:18.755399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9b283-e521-4f0f-8388-ad0a4ad65aa9 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:18.755648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9b283-e521-4f0f-8388-ad0a4ad65aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:18.784541 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-63d9b283-e521-4f0f-8388-ad0a4ad65aa9 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:18.785815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-63d9b283-e521-4f0f-8388-ad0a4ad65aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:18.818393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b11aae-f930-468a-9fcf-a3c73bd79bc8 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:18.863818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413c0be-86f3-49f6-84b9-b4936d77e5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:18.864956 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413c0be-86f3-49f6-84b9-b4936d77e5a5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:18.865495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413c0be-86f3-49f6-84b9-b4936d77e5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:18.865853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413c0be-86f3-49f6-84b9-b4936d77e5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:18.866669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413c0be-86f3-49f6-84b9-b4936d77e5a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:18.867133 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413c0be-86f3-49f6-84b9-b4936d77e5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:18.868938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413c0be-86f3-49f6-84b9-b4936d77e5a5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:18.885154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 84/162] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:18 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:18.890891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413c0be-86f3-49f6-84b9-b4936d77e5a5 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:18.897109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 79/163] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:18.921645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:18.936734 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9b283-e521-4f0f-8388-ad0a4ad65aa9 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:19.015233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413c0be-86f3-49f6-84b9-b4936d77e5a5 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:19.061642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ef323-5304-4000-91a6-4130922fbc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:19.062317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ef323-5304-4000-91a6-4130922fbc3f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:19.062603 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ef323-5304-4000-91a6-4130922fbc3f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:19.062987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ef323-5304-4000-91a6-4130922fbc3f None admin] PATH_INFO: `/v3/users/640696f6e9954a98a5d477fef0c386bb` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:19.064521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ef323-5304-4000-91a6-4130922fbc3f None admin] RBAC: Authorizing `identity:get_user(user_id=640696f6e9954a98a5d477fef0c386bb)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:19.066064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ef323-5304-4000-91a6-4130922fbc3f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:19.070342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 85/164] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:18 2022] GET /identity/v3/users/640696f6e9954a98a5d477fef0c386bb => generated 276 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:19.077517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ef323-5304-4000-91a6-4130922fbc3f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:19.081349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9b283-e521-4f0f-8388-ad0a4ad65aa9 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:19.122507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:19.128263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307ba29-0974-46be-8bca-4660e09a78ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:19.128930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307ba29-0974-46be-8bca-4660e09a78ba None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:19.129323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307ba29-0974-46be-8bca-4660e09a78ba None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:19.129675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307ba29-0974-46be-8bca-4660e09a78ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:19.148692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307ba29-0974-46be-8bca-4660e09a78ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-b307ba29-0974-46be-8bca-4660e09a78ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:19.154973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:19.156071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:19.157399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 80/165] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:19.162448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307ba29-0974-46be-8bca-4660e09a78ba None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:19.228184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:19.237171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ef323-5304-4000-91a6-4130922fbc3f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:19.278627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150e133-140f-4a08-a032-8a34b168b573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:19.280711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150e133-140f-4a08-a032-8a34b168b573 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:19.281404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150e133-140f-4a08-a032-8a34b168b573 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:19.283028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150e133-140f-4a08-a032-8a34b168b573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:19.297352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307ba29-0974-46be-8bca-4660e09a78ba None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:19.344743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f689f2-05ff-496f-a6fe-5d767eb1d6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:19.344982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f689f2-05ff-496f-a6fe-5d767eb1d6b2 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:19.345218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f689f2-05ff-496f-a6fe-5d767eb1d6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:19.345464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f689f2-05ff-496f-a6fe-5d767eb1d6b2 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:19.346205 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f689f2-05ff-496f-a6fe-5d767eb1d6b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:19.346502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f689f2-05ff-496f-a6fe-5d767eb1d6b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:19.348181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f689f2-05ff-496f-a6fe-5d767eb1d6b2 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:19.359040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 81/166] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:19 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:19.360623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eacbee-e0f3-410b-937e-7f4a93893b14 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:19.360906 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eacbee-e0f3-410b-937e-7f4a93893b14 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:19.361173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eacbee-e0f3-410b-937e-7f4a93893b14 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:19.362901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 82/167] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:19.368810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eacbee-e0f3-410b-937e-7f4a93893b14 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:19.377924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150e133-140f-4a08-a032-8a34b168b573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:19.380521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150e133-140f-4a08-a032-8a34b168b573 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:19.441004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:19.501264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eacbee-e0f3-410b-937e-7f4a93893b14 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:19.516119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:19.528701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 86/168] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:19 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:19.529684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1722c-9ca1-439a-b996-5962a6481319 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:19.529972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1722c-9ca1-439a-b996-5962a6481319 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:19.530252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1722c-9ca1-439a-b996-5962a6481319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:19.546171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe2e9e-b22a-4cd5-aad8-6abd531ed5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:19.547297 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe2e9e-b22a-4cd5-aad8-6abd531ed5e4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:19.547778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe2e9e-b22a-4cd5-aad8-6abd531ed5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:19.548244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe2e9e-b22a-4cd5-aad8-6abd531ed5e4 None admin] PATH_INFO: `/v3/users/39560b0e06eb42bb833267e094500984` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:19.549743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe2e9e-b22a-4cd5-aad8-6abd531ed5e4 None admin] RBAC: Authorizing `identity:get_user(user_id=39560b0e06eb42bb833267e094500984)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:19.551017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-66f1722c-9ca1-439a-b996-5962a6481319 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:19.551943 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe2e9e-b22a-4cd5-aad8-6abd531ed5e4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:19.552270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-66f1722c-9ca1-439a-b996-5962a6481319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:19.554097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 83/169] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:19 2022] GET /identity/v3/users/39560b0e06eb42bb833267e094500984 => generated 290 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:19.555173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe2e9e-b22a-4cd5-aad8-6abd531ed5e4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:19.648076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 87/170] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:19.648985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1722c-9ca1-439a-b996-5962a6481319 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:19.722494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe2e9e-b22a-4cd5-aad8-6abd531ed5e4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:19.744561 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:19.762784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3d9d8-7d66-4aca-9f35-c4bebdc8088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:19.763681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3d9d8-7d66-4aca-9f35-c4bebdc8088c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:19.764031 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3d9d8-7d66-4aca-9f35-c4bebdc8088c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:19.764628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3d9d8-7d66-4aca-9f35-c4bebdc8088c None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:19.765992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3d9d8-7d66-4aca-9f35-c4bebdc8088c None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:19.771761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3d9d8-7d66-4aca-9f35-c4bebdc8088c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:19.774024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 84/171] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:19 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:19.779985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3d9d8-7d66-4aca-9f35-c4bebdc8088c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:19.780838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1722c-9ca1-439a-b996-5962a6481319 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:19.809418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:19.833776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165a25b-4038-4e5a-9aac-92bf01815c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:19.835329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a25b-4038-4e5a-9aac-92bf01815c67 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:19.835780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a25b-4038-4e5a-9aac-92bf01815c67 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:19.836195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165a25b-4038-4e5a-9aac-92bf01815c67 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:19.839754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165a25b-4038-4e5a-9aac-92bf01815c67 None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:19.841841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165a25b-4038-4e5a-9aac-92bf01815c67 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:19.844196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 88/172] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:19 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:19.851761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165a25b-4038-4e5a-9aac-92bf01815c67 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:19.911002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3d9d8-7d66-4aca-9f35-c4bebdc8088c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:19.971693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edf637-684c-4df8-8f1b-89847e93d9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:19.972371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edf637-684c-4df8-8f1b-89847e93d9fa None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:19.972720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edf637-684c-4df8-8f1b-89847e93d9fa None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:19.972935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edf637-684c-4df8-8f1b-89847e93d9fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:19.992392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edf637-684c-4df8-8f1b-89847e93d9fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:20.001031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165a25b-4038-4e5a-9aac-92bf01815c67 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-53edf637-684c-4df8-8f1b-89847e93d9fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:20.006933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:20.007949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 85/173] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:20.009203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edf637-684c-4df8-8f1b-89847e93d9fa None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:20.058497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3fc16-6409-48ff-96ff-7c8a7641e147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:20.059170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3fc16-6409-48ff-96ff-7c8a7641e147 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:20.059451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3fc16-6409-48ff-96ff-7c8a7641e147 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:20.059744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3fc16-6409-48ff-96ff-7c8a7641e147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:20.060538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3fc16-6409-48ff-96ff-7c8a7641e147 None admin] RBAC: Adding query filter params (role.id=1f3d7dea677f4b82a9728c6f9083d706, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15, user.id=640696f6e9954a98a5d477fef0c386bb) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:20.060847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3fc16-6409-48ff-96ff-7c8a7641e147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:20.062368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3fc16-6409-48ff-96ff-7c8a7641e147 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:20.081479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 89/174] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:19 2022] GET /identity/v3/role_assignments?user.id=640696f6e9954a98a5d477fef0c386bb&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=1f3d7dea677f4b82a9728c6f9083d706 => generated 610 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:20.082142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3fc16-6409-48ff-96ff-7c8a7641e147 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:20.105374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:20.204534 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edf637-684c-4df8-8f1b-89847e93d9fa None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:20.215401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:20.297798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3fc16-6409-48ff-96ff-7c8a7641e147 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:20.305613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f5ef2-cca2-446e-b06e-3559b0cca56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:20.306628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f5ef2-cca2-446e-b06e-3559b0cca56c None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:20.306628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f5ef2-cca2-446e-b06e-3559b0cca56c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:20.306902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f5ef2-cca2-446e-b06e-3559b0cca56c None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/users/39560b0e06eb42bb833267e094500984/roles/1aeb3352b3fb4ab79fd7171fec026530` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:20.313097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f5ef2-cca2-446e-b06e-3559b0cca56c None admin] RBAC: Authorizing `identity:create_grant(project_id=32937f53ee28435c9dcbea8b3d17dd15, user_id=39560b0e06eb42bb833267e094500984, role_id=1aeb3352b3fb4ab79fd7171fec026530)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:20.314840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f5ef2-cca2-446e-b06e-3559b0cca56c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:20.343573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9305912-f35a-4323-a5ba-d569c7ee4394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:20.344217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305912-f35a-4323-a5ba-d569c7ee4394 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:20.344498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305912-f35a-4323-a5ba-d569c7ee4394 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:20.344766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305912-f35a-4323-a5ba-d569c7ee4394 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:20.345289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 86/175] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:38:20 2022] PUT /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/users/39560b0e06eb42bb833267e094500984/roles/1aeb3352b3fb4ab79fd7171fec026530 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:20.345662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9305912-f35a-4323-a5ba-d569c7ee4394 None admin] RBAC: Adding query filter params (name=member) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:20.345967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9305912-f35a-4323-a5ba-d569c7ee4394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:20.351066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9305912-f35a-4323-a5ba-d569c7ee4394 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:20.358301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 90/176] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:20 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:20.364374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f5ef2-cca2-446e-b06e-3559b0cca56c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:20.530559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f5ef2-cca2-446e-b06e-3559b0cca56c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:20.541589 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:20.572126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabbed0-3dd2-4d82-979e-eaf4996d7e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:20.572632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabbed0-3dd2-4d82-979e-eaf4996d7e15 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:20.572916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabbed0-3dd2-4d82-979e-eaf4996d7e15 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:20.573190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabbed0-3dd2-4d82-979e-eaf4996d7e15 None admin] PATH_INFO: `/v3/users/640696f6e9954a98a5d477fef0c386bb` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:20.574423 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabbed0-3dd2-4d82-979e-eaf4996d7e15 None admin] RBAC: Authorizing `identity:get_user(user_id=640696f6e9954a98a5d477fef0c386bb)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:20.575940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabbed0-3dd2-4d82-979e-eaf4996d7e15 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:20.577696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 87/177] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:20 2022] GET /identity/v3/users/640696f6e9954a98a5d477fef0c386bb => generated 276 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:20.583523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9305912-f35a-4323-a5ba-d569c7ee4394 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:20.779680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9305912-f35a-4323-a5ba-d569c7ee4394 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:20.819262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:20.856960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fa1c-7e98-4bb9-9d83-d60205e5fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:20.858084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fa1c-7e98-4bb9-9d83-d60205e5fc0c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:20.858590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fa1c-7e98-4bb9-9d83-d60205e5fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:20.859191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fa1c-7e98-4bb9-9d83-d60205e5fc0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:20.988227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112fa1c-7e98-4bb9-9d83-d60205e5fc0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:20.991167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112fa1c-7e98-4bb9-9d83-d60205e5fc0c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:21.156301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 91/178] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:20 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:21.161843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabbed0-3dd2-4d82-979e-eaf4996d7e15 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:21.272906 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabbed0-3dd2-4d82-979e-eaf4996d7e15 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:21.310797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c041f65-c1e3-42f7-ad38-da71b227518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:21.311533 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c041f65-c1e3-42f7-ad38-da71b227518c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:21.311901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c041f65-c1e3-42f7-ad38-da71b227518c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:21.312177 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c041f65-c1e3-42f7-ad38-da71b227518c None admin] PATH_INFO: `/v3/projects/2d02d2873bdc4a8683bba452d3f3290e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:21.313371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c041f65-c1e3-42f7-ad38-da71b227518c None admin] RBAC: Authorizing `identity:get_project(project_id=2d02d2873bdc4a8683bba452d3f3290e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:21.314830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c041f65-c1e3-42f7-ad38-da71b227518c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:21.316640 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 88/179] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:21 2022] GET /identity/v3/projects/2d02d2873bdc4a8683bba452d3f3290e => generated 313 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:21.323009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fa1c-7e98-4bb9-9d83-d60205e5fc0c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:21.346283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:21.459317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fa1c-7e98-4bb9-9d83-d60205e5fc0c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:21.510263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013fc6-f123-427a-ba6f-18acce1c88ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:21.510919 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013fc6-f123-427a-ba6f-18acce1c88ea None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:21.511223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013fc6-f123-427a-ba6f-18acce1c88ea None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:21.511499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013fc6-f123-427a-ba6f-18acce1c88ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:21.512313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28013fc6-f123-427a-ba6f-18acce1c88ea None admin] RBAC: Adding query filter params (role.id=a1ce48deeb3148e28049f10600de5fbe, scope.project.id=2d02d2873bdc4a8683bba452d3f3290e, user.id=640696f6e9954a98a5d477fef0c386bb) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:21.512624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28013fc6-f123-427a-ba6f-18acce1c88ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:21.514450 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28013fc6-f123-427a-ba6f-18acce1c88ea None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:21.523789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 92/180] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:21 2022] GET /identity/v3/role_assignments?user.id=640696f6e9954a98a5d477fef0c386bb&scope.project.id=2d02d2873bdc4a8683bba452d3f3290e&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 610 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:21.720537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fac0-b04c-46ef-b018-e1343dc8b804 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:21.720889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fac0-b04c-46ef-b018-e1343dc8b804 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:21.721006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fac0-b04c-46ef-b018-e1343dc8b804 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:21.722701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 89/181] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:21.728927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca628c04-f542-4af6-9447-38e309e4fb38 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:21.729241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca628c04-f542-4af6-9447-38e309e4fb38 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:21.729515 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca628c04-f542-4af6-9447-38e309e4fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:21.749429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ca628c04-f542-4af6-9447-38e309e4fb38 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:21.750711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ca628c04-f542-4af6-9447-38e309e4fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:21.816438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d952b7-ae21-485e-9901-39980c49a289 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:21.816772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d952b7-ae21-485e-9901-39980c49a289 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:21.817082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d952b7-ae21-485e-9901-39980c49a289 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:21.819744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 90/182] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:38:21.825495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a2340-4760-4527-b929-537b79efd6a6 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:21.825815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a2340-4760-4527-b929-537b79efd6a6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:21.826046 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a2340-4760-4527-b929-537b79efd6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:21.841660 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 93/183] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:21.858044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-597a2340-4760-4527-b929-537b79efd6a6 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:21.859342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-597a2340-4760-4527-b929-537b79efd6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:21.867351 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca628c04-f542-4af6-9447-38e309e4fb38 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:21.881857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:21.924051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:21.957127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 91/184] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:21.984511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a2340-4760-4527-b929-537b79efd6a6 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:22.001033 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca628c04-f542-4af6-9447-38e309e4fb38 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:22.049484 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84897d07-39ca-4cdf-b505-7fc7801e7e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:22.050161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84897d07-39ca-4cdf-b505-7fc7801e7e41 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:22.050441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84897d07-39ca-4cdf-b505-7fc7801e7e41 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:22.050714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84897d07-39ca-4cdf-b505-7fc7801e7e41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:22.064749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84897d07-39ca-4cdf-b505-7fc7801e7e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-84897d07-39ca-4cdf-b505-7fc7801e7e41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:22.069875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:22.071141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:22.072471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 94/185] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:22.073560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687706de-1961-4aaf-87c9-25a53de404e7 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:22.073908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687706de-1961-4aaf-87c9-25a53de404e7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:22.074184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687706de-1961-4aaf-87c9-25a53de404e7 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:22.075690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 95/186] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:22.080382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687706de-1961-4aaf-87c9-25a53de404e7 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:22.119710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a2340-4760-4527-b929-537b79efd6a6 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:22.161439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cffa20-ab47-4a90-9502-692b9fe3e1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:22.162099 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cffa20-ab47-4a90-9502-692b9fe3e1ed None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:22.162671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cffa20-ab47-4a90-9502-692b9fe3e1ed None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:22.162671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cffa20-ab47-4a90-9502-692b9fe3e1ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:22.163176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:22.174094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cffa20-ab47-4a90-9502-692b9fe3e1ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-e7cffa20-ab47-4a90-9502-692b9fe3e1ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:22.179184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:22.180192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:22.181360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 92/187] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:38:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:22.182852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f20353-5a51-4e73-9f96-a23bd42347ee None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:22.182852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f20353-5a51-4e73-9f96-a23bd42347ee None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:22.183029 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f20353-5a51-4e73-9f96-a23bd42347ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:22.201238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-43f20353-5a51-4e73-9f96-a23bd42347ee None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:22.202467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-43f20353-5a51-4e73-9f96-a23bd42347ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:22.208107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687706de-1961-4aaf-87c9-25a53de404e7 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:22.234777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:22.247920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d640211-aea7-446b-a2dd-2eea2dd5eb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:22.248678 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640211-aea7-446b-a2dd-2eea2dd5eb64 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:22.248961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640211-aea7-446b-a2dd-2eea2dd5eb64 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:22.249237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640211-aea7-446b-a2dd-2eea2dd5eb64 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:22.250358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d640211-aea7-446b-a2dd-2eea2dd5eb64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:22.250358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d640211-aea7-446b-a2dd-2eea2dd5eb64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:22.251736 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d640211-aea7-446b-a2dd-2eea2dd5eb64 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:22.265611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 96/188] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:22 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:22.265611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d640211-aea7-446b-a2dd-2eea2dd5eb64 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:22.284319 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 93/189] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:22.284994 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f20353-5a51-4e73-9f96-a23bd42347ee None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:22.385640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d640211-aea7-446b-a2dd-2eea2dd5eb64 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:22.411272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f20353-5a51-4e73-9f96-a23bd42347ee None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:22.419379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:22.425457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08e9eb-cc11-44c8-9204-d98072b46f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:22.426139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08e9eb-cc11-44c8-9204-d98072b46f45 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:22.426421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08e9eb-cc11-44c8-9204-d98072b46f45 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:22.426693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08e9eb-cc11-44c8-9204-d98072b46f45 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:22.427478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08e9eb-cc11-44c8-9204-d98072b46f45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:22.427769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08e9eb-cc11-44c8-9204-d98072b46f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:22.429269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08e9eb-cc11-44c8-9204-d98072b46f45 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:22.438782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 97/190] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:22.439808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08e9eb-cc11-44c8-9204-d98072b46f45 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:22.470218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db87d-57fc-432c-8f6c-fc3ba04afeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:22.480022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db87d-57fc-432c-8f6c-fc3ba04afeb9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:22.480022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db87d-57fc-432c-8f6c-fc3ba04afeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:22.480022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db87d-57fc-432c-8f6c-fc3ba04afeb9 None admin] PATH_INFO: `/v3/users/c2b813d2728345168d1351ac9dc40cb8` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:22.488507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63db87d-57fc-432c-8f6c-fc3ba04afeb9 None admin] RBAC: Authorizing `identity:get_user(user_id=c2b813d2728345168d1351ac9dc40cb8)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:22.489908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63db87d-57fc-432c-8f6c-fc3ba04afeb9 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:22.491667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 94/191] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:22 2022] GET /identity/v3/users/c2b813d2728345168d1351ac9dc40cb8 => generated 284 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:22.496638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db87d-57fc-432c-8f6c-fc3ba04afeb9 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:22.529261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:22.592441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08e9eb-cc11-44c8-9204-d98072b46f45 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:22.619537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db87d-57fc-432c-8f6c-fc3ba04afeb9 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:22.627730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f35fc-71cc-49f5-a218-812a2192ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:22.628392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f35fc-71cc-49f5-a218-812a2192ae5d None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:22.628669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f35fc-71cc-49f5-a218-812a2192ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:22.628939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f35fc-71cc-49f5-a218-812a2192ae5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:22.630110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f35fc-71cc-49f5-a218-812a2192ae5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:22.631614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f35fc-71cc-49f5-a218-812a2192ae5d None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:22.633488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 98/192] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:38:22 2022] GET /identity/v3/domains/default => generated 200 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:22.634156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f35fc-71cc-49f5-a218-812a2192ae5d None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:22.668294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5f76-4319-488f-a91c-958574026ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:22.668961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5f76-4319-488f-a91c-958574026ca7 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:22.669254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5f76-4319-488f-a91c-958574026ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:22.669645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5f76-4319-488f-a91c-958574026ca7 None admin] PATH_INFO: `/v3/users/c2b813d2728345168d1351ac9dc40cb8` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:22.670873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c5f76-4319-488f-a91c-958574026ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=c2b813d2728345168d1351ac9dc40cb8)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:22.672547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c5f76-4319-488f-a91c-958574026ca7 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:22.674216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 95/193] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:22 2022] GET /identity/v3/users/c2b813d2728345168d1351ac9dc40cb8 => generated 284 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:22.675152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5f76-4319-488f-a91c-958574026ca7 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:22.704757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:22.750974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f35fc-71cc-49f5-a218-812a2192ae5d None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:22.777598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:22.790762 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab2e1f-5320-4bdf-9443-4decdfaac962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:22.790762 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab2e1f-5320-4bdf-9443-4decdfaac962 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:22.791212 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab2e1f-5320-4bdf-9443-4decdfaac962 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:22.791556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab2e1f-5320-4bdf-9443-4decdfaac962 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:22.795099 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5f76-4319-488f-a91c-958574026ca7 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:22.835774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c547621-220b-4214-90a1-ab0602c995b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:22.836576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c547621-220b-4214-90a1-ab0602c995b7 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:22.836865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c547621-220b-4214-90a1-ab0602c995b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:22.837136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c547621-220b-4214-90a1-ab0602c995b7 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:22.837846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c547621-220b-4214-90a1-ab0602c995b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:22.839464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c547621-220b-4214-90a1-ab0602c995b7 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:22.863396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 96/194] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:38:22 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:38:22.864397 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c547621-220b-4214-90a1-ab0602c995b7 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:22.886155 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab2e1f-5320-4bdf-9443-4decdfaac962 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:22.888840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab2e1f-5320-4bdf-9443-4decdfaac962 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:22.968960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:23.037613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c547621-220b-4214-90a1-ab0602c995b7 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:23.052631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 99/195] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:23.054247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8d36-65e6-4138-b6b4-1eb30ac784d7 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:23.054247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8d36-65e6-4138-b6b4-1eb30ac784d7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:23.054475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8d36-65e6-4138-b6b4-1eb30ac784d7 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:23.056434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 100/196] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:23.062191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb49b-81b9-4d54-8a73-b4e3a75bbb31 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:23.062473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb49b-81b9-4d54-8a73-b4e3a75bbb31 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:23.062768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb49b-81b9-4d54-8a73-b4e3a75bbb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:23.083533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-026eb49b-81b9-4d54-8a73-b4e3a75bbb31 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:23.084755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-026eb49b-81b9-4d54-8a73-b4e3a75bbb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:23.095942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea5992-c618-4786-bdb2-1cc4cafa5deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:23.096529 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5992-c618-4786-bdb2-1cc4cafa5deb None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:23.096816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5992-c618-4786-bdb2-1cc4cafa5deb None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:23.097100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5992-c618-4786-bdb2-1cc4cafa5deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:23.115261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:23.179173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 101/197] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:23.181170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb49b-81b9-4d54-8a73-b4e3a75bbb31 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:23.197543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea5992-c618-4786-bdb2-1cc4cafa5deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:23.199763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea5992-c618-4786-bdb2-1cc4cafa5deb None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:23.327417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:23.334844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb49b-81b9-4d54-8a73-b4e3a75bbb31 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:23.347505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 97/198] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:23.348368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea5992-c618-4786-bdb2-1cc4cafa5deb None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:23.384820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca52ea-5650-4897-8029-4b2d283683cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:23.385870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca52ea-5650-4897-8029-4b2d283683cd None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:23.386553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca52ea-5650-4897-8029-4b2d283683cd None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:23.388000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca52ea-5650-4897-8029-4b2d283683cd None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:23.389470 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca52ea-5650-4897-8029-4b2d283683cd None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:23.391169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca52ea-5650-4897-8029-4b2d283683cd None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:23.393265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 102/199] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:23 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:23.398877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca52ea-5650-4897-8029-4b2d283683cd None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:23.407819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:23.469674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea5992-c618-4786-bdb2-1cc4cafa5deb None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:23.517771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f75ae-adb2-4a11-9a10-93d2fc8f9225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:23.518758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f75ae-adb2-4a11-9a10-93d2fc8f9225 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:23.519265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f75ae-adb2-4a11-9a10-93d2fc8f9225 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:23.519762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f75ae-adb2-4a11-9a10-93d2fc8f9225 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:23.528880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca52ea-5650-4897-8029-4b2d283683cd None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:23.533908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f75ae-adb2-4a11-9a10-93d2fc8f9225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-3c5f75ae-adb2-4a11-9a10-93d2fc8f9225 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:23.539552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:23.541068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:23.541882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:23.544363 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 98/200] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:23.545546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f75ae-adb2-4a11-9a10-93d2fc8f9225 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:23.570748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f9ff8-a371-432b-a9b5-a0939319f832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:23.571494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f9ff8-a371-432b-a9b5-a0939319f832 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:23.571779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f9ff8-a371-432b-a9b5-a0939319f832 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:23.572063 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f9ff8-a371-432b-a9b5-a0939319f832 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:23.573292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f9ff8-a371-432b-a9b5-a0939319f832 None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:23.574790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f9ff8-a371-432b-a9b5-a0939319f832 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:23.577130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 103/201] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:23 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:23.577632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f9ff8-a371-432b-a9b5-a0939319f832 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:23.612027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:23.683037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f75ae-adb2-4a11-9a10-93d2fc8f9225 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:23.691389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:23.720775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f9ff8-a371-432b-a9b5-a0939319f832 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:23.731135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c6ce0-16f0-4118-967c-903892749e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:23.732291 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c6ce0-16f0-4118-967c-903892749e51 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:23.733247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c6ce0-16f0-4118-967c-903892749e51 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:23.733758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c6ce0-16f0-4118-967c-903892749e51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:23.735195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c6ce0-16f0-4118-967c-903892749e51 None admin] RBAC: Adding query filter params (role.id=1f3d7dea677f4b82a9728c6f9083d706, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user.id=c2b813d2728345168d1351ac9dc40cb8) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:23.736001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c6ce0-16f0-4118-967c-903892749e51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:23.737959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c6ce0-16f0-4118-967c-903892749e51 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:23.746515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 99/202] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:23 2022] GET /identity/v3/role_assignments?user.id=c2b813d2728345168d1351ac9dc40cb8&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=1f3d7dea677f4b82a9728c6f9083d706 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:23.747844 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c6ce0-16f0-4118-967c-903892749e51 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:23.797655 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741191ed-c7df-4f72-a7f7-62a48741fc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:23.798308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741191ed-c7df-4f72-a7f7-62a48741fc50 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:23.798594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741191ed-c7df-4f72-a7f7-62a48741fc50 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:23.798870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741191ed-c7df-4f72-a7f7-62a48741fc50 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:23.799662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741191ed-c7df-4f72-a7f7-62a48741fc50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:23.799968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741191ed-c7df-4f72-a7f7-62a48741fc50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:23.801402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741191ed-c7df-4f72-a7f7-62a48741fc50 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:23.826780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 104/203] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:23 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:23.832512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741191ed-c7df-4f72-a7f7-62a48741fc50 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:23.881429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c6ce0-16f0-4118-967c-903892749e51 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:23.933636 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e93d34-9351-43f9-9559-3171fb3f5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:23.934288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93d34-9351-43f9-9559-3171fb3f5971 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:23.934573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93d34-9351-43f9-9559-3171fb3f5971 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:23.934850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93d34-9351-43f9-9559-3171fb3f5971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:23.936865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e93d34-9351-43f9-9559-3171fb3f5971 None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user.id=c2b813d2728345168d1351ac9dc40cb8) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:23.937183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e93d34-9351-43f9-9559-3171fb3f5971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:23.938668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e93d34-9351-43f9-9559-3171fb3f5971 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:23.954652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 100/204] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:23 2022] GET /identity/v3/role_assignments?user.id=c2b813d2728345168d1351ac9dc40cb8&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=390e487a45f74246ba84773e8760bc7c => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:24.020374 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:24.033028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741191ed-c7df-4f72-a7f7-62a48741fc50 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:24.076941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33659d-5eb9-43a5-8c11-21d46d364a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:24.077625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33659d-5eb9-43a5-8c11-21d46d364a45 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:24.077907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33659d-5eb9-43a5-8c11-21d46d364a45 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:24.078184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33659d-5eb9-43a5-8c11-21d46d364a45 None admin] PATH_INFO: `/v3/users/39560b0e06eb42bb833267e094500984` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:24.079552 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33659d-5eb9-43a5-8c11-21d46d364a45 None admin] RBAC: Authorizing `identity:get_user(user_id=39560b0e06eb42bb833267e094500984)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:24.081137 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33659d-5eb9-43a5-8c11-21d46d364a45 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:24.083412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 105/205] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:23 2022] GET /identity/v3/users/39560b0e06eb42bb833267e094500984 => generated 290 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:24.089051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e93d34-9351-43f9-9559-3171fb3f5971 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:24.130153 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:24.206388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e93d34-9351-43f9-9559-3171fb3f5971 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:24.254326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eedff3-1603-470b-884f-3c0f33dab583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:24.255063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eedff3-1603-470b-884f-3c0f33dab583 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:24.255346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eedff3-1603-470b-884f-3c0f33dab583 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:24.255622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eedff3-1603-470b-884f-3c0f33dab583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:24.342083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eedff3-1603-470b-884f-3c0f33dab583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:24.343558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eedff3-1603-470b-884f-3c0f33dab583 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:24.379679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:24.486012 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 101/206] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:24.491869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33659d-5eb9-43a5-8c11-21d46d364a45 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:24.636072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33659d-5eb9-43a5-8c11-21d46d364a45 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:24.689010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7de868-9fa6-4c31-9d50-75c8dae47b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:24.689679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de868-9fa6-4c31-9d50-75c8dae47b61 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:24.689960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de868-9fa6-4c31-9d50-75c8dae47b61 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:24.690236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de868-9fa6-4c31-9d50-75c8dae47b61 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:24.691475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7de868-9fa6-4c31-9d50-75c8dae47b61 None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:24.692952 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7de868-9fa6-4c31-9d50-75c8dae47b61 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:24.695059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 106/207] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:24 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:24.700901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eedff3-1603-470b-884f-3c0f33dab583 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:24.842121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eedff3-1603-470b-884f-3c0f33dab583 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:24.887047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea088d-73c7-45c5-8128-6c3b303022eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:24.887607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea088d-73c7-45c5-8128-6c3b303022eb None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:24.887890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea088d-73c7-45c5-8128-6c3b303022eb None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:24.888163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea088d-73c7-45c5-8128-6c3b303022eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:24.888983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea088d-73c7-45c5-8128-6c3b303022eb None admin] RBAC: Adding query filter params (role.id=1aeb3352b3fb4ab79fd7171fec026530, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15, user.id=39560b0e06eb42bb833267e094500984) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:24.889297 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea088d-73c7-45c5-8128-6c3b303022eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:24.890882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea088d-73c7-45c5-8128-6c3b303022eb None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:24.892983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:24.901684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 102/208] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:24 2022] GET /identity/v3/role_assignments?user.id=39560b0e06eb42bb833267e094500984&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=1aeb3352b3fb4ab79fd7171fec026530 => generated 610 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:25.346596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481522dc-b9e9-4a9c-9a5f-eea9b85465b1 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:25.347168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481522dc-b9e9-4a9c-9a5f-eea9b85465b1 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:25.347168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481522dc-b9e9-4a9c-9a5f-eea9b85465b1 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:25.348681 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 107/209] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:25.354685 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9758-7f7a-48ec-989b-b91a6faacc7c None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:25.355204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9758-7f7a-48ec-989b-b91a6faacc7c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:25.355306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9758-7f7a-48ec-989b-b91a6faacc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:25.377023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-976d9758-7f7a-48ec-989b-b91a6faacc7c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:25.378237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-976d9758-7f7a-48ec-989b-b91a6faacc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:25.469287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 103/210] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:25.495030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481522dc-b9e9-4a9c-9a5f-eea9b85465b1 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:25.528693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:25.536217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e6d64-5291-44c0-8580-f802a1752019 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:25.536516 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e6d64-5291-44c0-8580-f802a1752019 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:25.536773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e6d64-5291-44c0-8580-f802a1752019 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:25.538552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 104/211] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:38:25.547781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731992-4ed8-4f74-8f2d-ddbfe1dabeeb None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:25.548122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731992-4ed8-4f74-8f2d-ddbfe1dabeeb None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:25.548337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731992-4ed8-4f74-8f2d-ddbfe1dabeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:25.569253 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-dd731992-4ed8-4f74-8f2d-ddbfe1dabeeb None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:25.570728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-dd731992-4ed8-4f74-8f2d-ddbfe1dabeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:25.634079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481522dc-b9e9-4a9c-9a5f-eea9b85465b1 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:25.662506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 105/212] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:25.681250 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161c3b0-e9a8-406b-8c3c-b958d3a8ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:25.681920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161c3b0-e9a8-406b-8c3c-b958d3a8ef93 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:25.682201 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161c3b0-e9a8-406b-8c3c-b958d3a8ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:25.682477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161c3b0-e9a8-406b-8c3c-b958d3a8ef93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:25.688351 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd731992-4ed8-4f74-8f2d-ddbfe1dabeeb None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:25.694236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161c3b0-e9a8-406b-8c3c-b958d3a8ef93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-6161c3b0-e9a8-406b-8c3c-b958d3a8ef93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:25.699888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:25.700803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:25.702101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 108/213] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:25.707398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161c3b0-e9a8-406b-8c3c-b958d3a8ef93 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:25.754083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:25.800652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd731992-4ed8-4f74-8f2d-ddbfe1dabeeb None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:25.802738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:25.821112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161c3b0-e9a8-406b-8c3c-b958d3a8ef93 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:25.838760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbfadc-8f84-461c-b1b3-656c32691ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:25.839693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbfadc-8f84-461c-b1b3-656c32691ced None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:25.840116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbfadc-8f84-461c-b1b3-656c32691ced None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:25.840557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbfadc-8f84-461c-b1b3-656c32691ced None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:25.842217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbfadc-8f84-461c-b1b3-656c32691ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:25.843956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbfadc-8f84-461c-b1b3-656c32691ced None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:25.850455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 106/214] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:38:25 2022] GET /identity/v3/domains/default => generated 200 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:25.851534 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbfadc-8f84-461c-b1b3-656c32691ced None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:25.860064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874467-e98c-411b-8e05-c1b72b0bb04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:25.860710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874467-e98c-411b-8e05-c1b72b0bb04f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:25.861041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874467-e98c-411b-8e05-c1b72b0bb04f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:25.861352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874467-e98c-411b-8e05-c1b72b0bb04f None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:25.862208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874467-e98c-411b-8e05-c1b72b0bb04f None admin] RBAC: Adding query filter params (name=member) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:25.862390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874467-e98c-411b-8e05-c1b72b0bb04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:25.863821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874467-e98c-411b-8e05-c1b72b0bb04f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:25.873336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 109/215] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:25 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:25.880456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874467-e98c-411b-8e05-c1b72b0bb04f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:25.971578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbfadc-8f84-461c-b1b3-656c32691ced None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:25.999785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874467-e98c-411b-8e05-c1b72b0bb04f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:26.000173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:26.011315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b945cb1-e940-41bf-91aa-ee1a0d8cd123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:26.012216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b945cb1-e940-41bf-91aa-ee1a0d8cd123 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:26.012662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b945cb1-e940-41bf-91aa-ee1a0d8cd123 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:26.013134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b945cb1-e940-41bf-91aa-ee1a0d8cd123 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:26.014002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b945cb1-e940-41bf-91aa-ee1a0d8cd123 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:26.015883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b945cb1-e940-41bf-91aa-ee1a0d8cd123 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:26.039260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd339d59-f110-4b92-8e1c-ca00fd7dce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:26.040319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339d59-f110-4b92-8e1c-ca00fd7dce87 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:26.040608 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339d59-f110-4b92-8e1c-ca00fd7dce87 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:26.040884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339d59-f110-4b92-8e1c-ca00fd7dce87 None admin] PATH_INFO: `/v3/users/b468de6ff95c4934af5d4f48e9866735` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:26.051053 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 107/216] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:38:25 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:38:26.063821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd339d59-f110-4b92-8e1c-ca00fd7dce87 None admin] RBAC: Authorizing `identity:get_user(user_id=b468de6ff95c4934af5d4f48e9866735)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:26.065456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd339d59-f110-4b92-8e1c-ca00fd7dce87 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:26.067761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 110/217] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:25 2022] GET /identity/v3/users/b468de6ff95c4934af5d4f48e9866735 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:26.074135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b945cb1-e940-41bf-91aa-ee1a0d8cd123 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:26.195347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b945cb1-e940-41bf-91aa-ee1a0d8cd123 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:26.208613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1297-e39b-464d-8295-690ed90baec4 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:26.208953 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1297-e39b-464d-8295-690ed90baec4 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:26.209171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1297-e39b-464d-8295-690ed90baec4 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:26.210906 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 111/218] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:26.217415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d750232-72a5-4b1b-bfcb-c1515f286452 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:26.217753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d750232-72a5-4b1b-bfcb-c1515f286452 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:26.218010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d750232-72a5-4b1b-bfcb-c1515f286452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:26.232631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:26.236599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc038-fe39-498f-be44-f30146580b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:26.237232 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc038-fe39-498f-be44-f30146580b63 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:26.237514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc038-fe39-498f-be44-f30146580b63 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:26.237787 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc038-fe39-498f-be44-f30146580b63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:26.241664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-8d750232-72a5-4b1b-bfcb-c1515f286452 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:26.243427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8d750232-72a5-4b1b-bfcb-c1515f286452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:26.298914 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:26.323871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafc038-fe39-498f-be44-f30146580b63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:26.326773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafc038-fe39-498f-be44-f30146580b63 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:26.333918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 112/219] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:26.358397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d750232-72a5-4b1b-bfcb-c1515f286452 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:26.471443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 108/220] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:26.480653 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc038-fe39-498f-be44-f30146580b63 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:26.506115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d750232-72a5-4b1b-bfcb-c1515f286452 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:26.556414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099c02f-9f16-42c6-a82d-16c677803d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:26.557217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099c02f-9f16-42c6-a82d-16c677803d43 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:26.557217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099c02f-9f16-42c6-a82d-16c677803d43 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:26.557217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099c02f-9f16-42c6-a82d-16c677803d43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:26.561642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:26.572201 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099c02f-9f16-42c6-a82d-16c677803d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-f099c02f-9f16-42c6-a82d-16c677803d43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:26.577487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:26.578856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 113/221] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:26.580979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98cc6e-3dde-40cb-aa4b-8da419bb5d0c None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:26.582415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98cc6e-3dde-40cb-aa4b-8da419bb5d0c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:26.582415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98cc6e-3dde-40cb-aa4b-8da419bb5d0c None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:26.583598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 114/222] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:26.589888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae71b4-9d27-4d07-b39b-174cd935c128 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:26.590176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae71b4-9d27-4d07-b39b-174cd935c128 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:26.590451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae71b4-9d27-4d07-b39b-174cd935c128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:26.608679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:26.610190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-57ae71b4-9d27-4d07-b39b-174cd935c128 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:26.611459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-57ae71b4-9d27-4d07-b39b-174cd935c128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:26.629449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc038-fe39-498f-be44-f30146580b63 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:26.667220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c573eae-ab7c-4f1f-9f51-38fcc4b5ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:26.668207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c573eae-ab7c-4f1f-9f51-38fcc4b5ddd2 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:26.668666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c573eae-ab7c-4f1f-9f51-38fcc4b5ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:26.669152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c573eae-ab7c-4f1f-9f51-38fcc4b5ddd2 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:26.670695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c573eae-ab7c-4f1f-9f51-38fcc4b5ddd2 None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:26.672394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c573eae-ab7c-4f1f-9f51-38fcc4b5ddd2 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:26.674613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 109/223] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:26 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:26.680823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c573eae-ab7c-4f1f-9f51-38fcc4b5ddd2 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:26.698344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 115/224] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:26.700098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae71b4-9d27-4d07-b39b-174cd935c128 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:26.811691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c573eae-ab7c-4f1f-9f51-38fcc4b5ddd2 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:26.818769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae71b4-9d27-4d07-b39b-174cd935c128 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:26.852819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a50dc7-212c-4282-a00a-2a1b1189656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:26.853878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a50dc7-212c-4282-a00a-2a1b1189656e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:26.854387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a50dc7-212c-4282-a00a-2a1b1189656e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:26.854853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a50dc7-212c-4282-a00a-2a1b1189656e None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:26.855826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a50dc7-212c-4282-a00a-2a1b1189656e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:26.856327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a50dc7-212c-4282-a00a-2a1b1189656e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:26.857893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d5cc-1158-4ed9-9a15-deaa8cff932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:26.858221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a50dc7-212c-4282-a00a-2a1b1189656e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:26.858539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d5cc-1158-4ed9-9a15-deaa8cff932a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:26.858823 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d5cc-1158-4ed9-9a15-deaa8cff932a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:26.859131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d5cc-1158-4ed9-9a15-deaa8cff932a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:26.860131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492d5cc-1158-4ed9-9a15-deaa8cff932a None admin] RBAC: Adding query filter params (role.id=a1ce48deeb3148e28049f10600de5fbe, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user.id=b468de6ff95c4934af5d4f48e9866735) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:26.860454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492d5cc-1158-4ed9-9a15-deaa8cff932a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:26.862012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492d5cc-1158-4ed9-9a15-deaa8cff932a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:26.868787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 116/225] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:26 2022] GET /identity/v3/role_assignments?user.id=b468de6ff95c4934af5d4f48e9866735&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:26.875086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d5cc-1158-4ed9-9a15-deaa8cff932a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:26.875086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:26.876693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 110/226] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:26 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:26.882965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a50dc7-212c-4282-a00a-2a1b1189656e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:26.914982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:27.001491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d5cc-1158-4ed9-9a15-deaa8cff932a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:27.043066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56bac-c792-4c79-a454-c0d41911e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:27.043748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56bac-c792-4c79-a454-c0d41911e120 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:27.044108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56bac-c792-4c79-a454-c0d41911e120 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:27.044505 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56bac-c792-4c79-a454-c0d41911e120 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:27.058499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb56bac-c792-4c79-a454-c0d41911e120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-4eb56bac-c792-4c79-a454-c0d41911e120 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:27.066579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:27.067516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:27.068298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 117/227] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:27.074385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56bac-c792-4c79-a454-c0d41911e120 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:27.141994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:27.195488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56bac-c792-4c79-a454-c0d41911e120 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:27.221275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a50dc7-212c-4282-a00a-2a1b1189656e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:27.235106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe57b58-ebd2-427b-acc8-21d17b842d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:27.235799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe57b58-ebd2-427b-acc8-21d17b842d41 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:27.236094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe57b58-ebd2-427b-acc8-21d17b842d41 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:27.236366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe57b58-ebd2-427b-acc8-21d17b842d41 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:27.237098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe57b58-ebd2-427b-acc8-21d17b842d41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:27.237404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe57b58-ebd2-427b-acc8-21d17b842d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:27.238845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe57b58-ebd2-427b-acc8-21d17b842d41 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:27.248744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 118/228] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:27.254713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe57b58-ebd2-427b-acc8-21d17b842d41 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:27.288818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e4985-44c7-49bf-8db2-c620ccd694e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:27.290001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e4985-44c7-49bf-8db2-c620ccd694e4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:27.290546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e4985-44c7-49bf-8db2-c620ccd694e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:27.291045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e4985-44c7-49bf-8db2-c620ccd694e4 None admin] PATH_INFO: `/v3/users/c2b813d2728345168d1351ac9dc40cb8` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:27.295778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e4985-44c7-49bf-8db2-c620ccd694e4 None admin] RBAC: Authorizing `identity:get_user(user_id=c2b813d2728345168d1351ac9dc40cb8)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:27.297610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e4985-44c7-49bf-8db2-c620ccd694e4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:27.299923 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 111/229] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:26 2022] GET /identity/v3/users/c2b813d2728345168d1351ac9dc40cb8 => generated 284 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:27.305832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e4985-44c7-49bf-8db2-c620ccd694e4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:27.368243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe57b58-ebd2-427b-acc8-21d17b842d41 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:27.397534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:27.410958 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7954-04bc-45fa-b09a-9b5e55d2da86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:27.411657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7954-04bc-45fa-b09a-9b5e55d2da86 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:27.411980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7954-04bc-45fa-b09a-9b5e55d2da86 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:27.412263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7954-04bc-45fa-b09a-9b5e55d2da86 None admin] PATH_INFO: `/v3/users/c2b813d2728345168d1351ac9dc40cb8` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:27.413529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7954-04bc-45fa-b09a-9b5e55d2da86 None admin] RBAC: Authorizing `identity:get_user(user_id=c2b813d2728345168d1351ac9dc40cb8)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:27.418166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7954-04bc-45fa-b09a-9b5e55d2da86 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:27.419937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 119/230] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:27 2022] GET /identity/v3/users/c2b813d2728345168d1351ac9dc40cb8 => generated 284 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:27.425510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7954-04bc-45fa-b09a-9b5e55d2da86 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:27.512691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:27.544654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e4985-44c7-49bf-8db2-c620ccd694e4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:27.622366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea1603-5460-46ff-8e9d-518f35d5c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:27.623530 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1603-5460-46ff-8e9d-518f35d5c5eb None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:27.624684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1603-5460-46ff-8e9d-518f35d5c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:27.625336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1603-5460-46ff-8e9d-518f35d5c5eb None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:27.628731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea1603-5460-46ff-8e9d-518f35d5c5eb None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:27.630641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea1603-5460-46ff-8e9d-518f35d5c5eb None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:27.633679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 112/231] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:27 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:27.641568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea1603-5460-46ff-8e9d-518f35d5c5eb None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:27.648026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7954-04bc-45fa-b09a-9b5e55d2da86 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:27.727757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2be962-3787-40ae-a4cc-bbbf72d27e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:27.728437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2be962-3787-40ae-a4cc-bbbf72d27e2a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:27.728719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2be962-3787-40ae-a4cc-bbbf72d27e2a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:27.728997 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2be962-3787-40ae-a4cc-bbbf72d27e2a None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:27.730273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2be962-3787-40ae-a4cc-bbbf72d27e2a None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:27.731777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2be962-3787-40ae-a4cc-bbbf72d27e2a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:27.733628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 120/232] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:27 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:27.739278 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2be962-3787-40ae-a4cc-bbbf72d27e2a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:27.794478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea1603-5460-46ff-8e9d-518f35d5c5eb None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:27.833948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97300fef-fd40-4fd5-8dae-e8f4bc4d82ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:27.835246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97300fef-fd40-4fd5-8dae-e8f4bc4d82ca None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:27.837206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97300fef-fd40-4fd5-8dae-e8f4bc4d82ca None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:27.837689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97300fef-fd40-4fd5-8dae-e8f4bc4d82ca None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/users/c2b813d2728345168d1351ac9dc40cb8/roles/1f3d7dea677f4b82a9728c6f9083d706` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:27.843714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97300fef-fd40-4fd5-8dae-e8f4bc4d82ca None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user_id=c2b813d2728345168d1351ac9dc40cb8, role_id=1f3d7dea677f4b82a9728c6f9083d706)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:27.845449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97300fef-fd40-4fd5-8dae-e8f4bc4d82ca None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:27.860058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:27.871097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 113/233] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:38:27 2022] PUT /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/users/c2b813d2728345168d1351ac9dc40cb8/roles/1f3d7dea677f4b82a9728c6f9083d706 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:27.941407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2be962-3787-40ae-a4cc-bbbf72d27e2a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:27.985051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f1c96-f5f5-4eea-8339-78200d4d6a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:27.986139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1c96-f5f5-4eea-8339-78200d4d6a18 None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:27.986638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1c96-f5f5-4eea-8339-78200d4d6a18 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:27.987162 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1c96-f5f5-4eea-8339-78200d4d6a18 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/users/c2b813d2728345168d1351ac9dc40cb8/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:27.989996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f1c96-f5f5-4eea-8339-78200d4d6a18 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user_id=c2b813d2728345168d1351ac9dc40cb8, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:27.991798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f1c96-f5f5-4eea-8339-78200d4d6a18 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:28.014123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 121/234] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:38:27 2022] PUT /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/users/c2b813d2728345168d1351ac9dc40cb8/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:38:28.620069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327a8d-40e9-40b6-a062-167dd84710d7 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:28.621111 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327a8d-40e9-40b6-a062-167dd84710d7 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:28.621595 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327a8d-40e9-40b6-a062-167dd84710d7 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:28.623383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 114/235] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:28 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:28.629728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29118-8d0e-4caf-bd6f-199a3bf5da81 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:28.630661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29118-8d0e-4caf-bd6f-199a3bf5da81 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:28.631240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29118-8d0e-4caf-bd6f-199a3bf5da81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:28.655460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-71b29118-8d0e-4caf-bd6f-199a3bf5da81 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:28.657020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-71b29118-8d0e-4caf-bd6f-199a3bf5da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:28.756005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 122/236] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:28.804603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6327a8d-40e9-40b6-a062-167dd84710d7 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:28.811744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b5f0d-0af3-4c34-82f5-9466a8719469 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:28.812054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b5f0d-0af3-4c34-82f5-9466a8719469 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:28.812312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b5f0d-0af3-4c34-82f5-9466a8719469 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:28.813731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 123/237] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:28.819966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7ab5c-43d0-41e4-b9bd-bcbd348e9238 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:28.820245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7ab5c-43d0-41e4-b9bd-bcbd348e9238 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:28.821078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7ab5c-43d0-41e4-b9bd-bcbd348e9238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:28.822682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:28.848004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a3c7ab5c-43d0-41e4-b9bd-bcbd348e9238 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:28.849356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a3c7ab5c-43d0-41e4-b9bd-bcbd348e9238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:28.899369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:28.981884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 124/238] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:29.008236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7ab5c-43d0-41e4-b9bd-bcbd348e9238 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:29.023319 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6327a8d-40e9-40b6-a062-167dd84710d7 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:29.072180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac06188-b1a6-49da-a008-64b64aa64828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:29.072888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06188-b1a6-49da-a008-64b64aa64828 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:29.073171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06188-b1a6-49da-a008-64b64aa64828 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:29.073444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06188-b1a6-49da-a008-64b64aa64828 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:29.075879 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac06188-b1a6-49da-a008-64b64aa64828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:29.079834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac06188-b1a6-49da-a008-64b64aa64828 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:29.085392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 115/239] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:38:28 2022] GET /identity/v3/domains/default => generated 200 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:29.091833 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac06188-b1a6-49da-a008-64b64aa64828 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:29.168903 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7ab5c-43d0-41e4-b9bd-bcbd348e9238 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:29.244572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c54bb-6fac-418d-947f-66ef57a86010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:29.246352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c54bb-6fac-418d-947f-66ef57a86010 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:29.248073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c54bb-6fac-418d-947f-66ef57a86010 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:29.249296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c54bb-6fac-418d-947f-66ef57a86010 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:29.271703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c54bb-6fac-418d-947f-66ef57a86010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-752c54bb-6fac-418d-947f-66ef57a86010 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:29.281911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:29.283126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:29.284119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:29.285290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:29.290366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 125/240] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:29.298438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdbb9c-fda8-4034-be3f-3ac4657f745f None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:29.298729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdbb9c-fda8-4034-be3f-3ac4657f745f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:29.299026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdbb9c-fda8-4034-be3f-3ac4657f745f None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:29.301389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 126/241] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:29.302393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bdbb9c-fda8-4034-be3f-3ac4657f745f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:29.325371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac06188-b1a6-49da-a008-64b64aa64828 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:29.341815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:29.370452 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413897fc-bcb8-400b-ac91-3afcb39af83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:29.371411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413897fc-bcb8-400b-ac91-3afcb39af83b None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:29.371993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413897fc-bcb8-400b-ac91-3afcb39af83b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:29.372410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413897fc-bcb8-400b-ac91-3afcb39af83b None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:29.373399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413897fc-bcb8-400b-ac91-3afcb39af83b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:29.375040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413897fc-bcb8-400b-ac91-3afcb39af83b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:29.407704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 116/242] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:38:29 2022] POST /identity/v3/users => generated 294 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:38:29.409943 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746343c-e567-4cce-911f-43811eba0bc7 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:29.410649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746343c-e567-4cce-911f-43811eba0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:29.411015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746343c-e567-4cce-911f-43811eba0bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:29.437021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-5746343c-e567-4cce-911f-43811eba0bc7 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:29.438822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-5746343c-e567-4cce-911f-43811eba0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:29.444886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bdbb9c-fda8-4034-be3f-3ac4657f745f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:29.503470 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f7e6f-6805-4ffd-877e-82b329dfe79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:29.506425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f7e6f-6805-4ffd-877e-82b329dfe79a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:29.507086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f7e6f-6805-4ffd-877e-82b329dfe79a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:29.507628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f7e6f-6805-4ffd-877e-82b329dfe79a None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:29.509933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f7e6f-6805-4ffd-877e-82b329dfe79a None admin] RBAC: Adding query filter params (name=reader) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:29.511592 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f7e6f-6805-4ffd-877e-82b329dfe79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:29.514526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f7e6f-6805-4ffd-877e-82b329dfe79a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:29.534589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 127/243] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:29 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:29.544356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f7e6f-6805-4ffd-877e-82b329dfe79a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:29.566565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 117/244] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:29.631822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746343c-e567-4cce-911f-43811eba0bc7 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:29.695225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:29.706686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f7e6f-6805-4ffd-877e-82b329dfe79a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:29.715324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:29.758433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9799ec5-20d5-43ae-8ce9-3946da821c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:29.759516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9799ec5-20d5-43ae-8ce9-3946da821c07 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:29.760012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9799ec5-20d5-43ae-8ce9-3946da821c07 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:29.760472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9799ec5-20d5-43ae-8ce9-3946da821c07 None admin] PATH_INFO: `/v3/users/5ec828ce967d404ab2b3e02338a8266f` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:29.771740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746343c-e567-4cce-911f-43811eba0bc7 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:29.780134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9799ec5-20d5-43ae-8ce9-3946da821c07 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec828ce967d404ab2b3e02338a8266f)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:29.782165 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9799ec5-20d5-43ae-8ce9-3946da821c07 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:29.784949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 128/245] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:29 2022] GET /identity/v3/users/5ec828ce967d404ab2b3e02338a8266f => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:29.790807 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9799ec5-20d5-43ae-8ce9-3946da821c07 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:29.815770 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace750c-221d-4574-a176-9b7e719d9bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:29.816539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace750c-221d-4574-a176-9b7e719d9bc4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:29.817216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace750c-221d-4574-a176-9b7e719d9bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:29.817216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace750c-221d-4574-a176-9b7e719d9bc4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:29.831769 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace750c-221d-4574-a176-9b7e719d9bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-8ace750c-221d-4574-a176-9b7e719d9bc4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:29.837000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:29.837903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:29.838684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 118/246] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:29.844920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace750c-221d-4574-a176-9b7e719d9bc4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:29.936175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9799ec5-20d5-43ae-8ce9-3946da821c07 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:29.987987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb91e9-0f96-4e4f-b884-569c0b5ab8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:29.989010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb91e9-0f96-4e4f-b884-569c0b5ab8a1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:29.989499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb91e9-0f96-4e4f-b884-569c0b5ab8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:29.989960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb91e9-0f96-4e4f-b884-569c0b5ab8a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:29.993121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace750c-221d-4574-a176-9b7e719d9bc4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:30.012819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:30.023686 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:30.039778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52bc5-1b53-4b56-9a82-97d1672f4259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:30.040369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52bc5-1b53-4b56-9a82-97d1672f4259 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:30.040726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52bc5-1b53-4b56-9a82-97d1672f4259 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:30.041003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52bc5-1b53-4b56-9a82-97d1672f4259 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:30.041750 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac52bc5-1b53-4b56-9a82-97d1672f4259 None admin] RBAC: Adding query filter params (name=member) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:30.042665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac52bc5-1b53-4b56-9a82-97d1672f4259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:30.043566 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac52bc5-1b53-4b56-9a82-97d1672f4259 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:30.053871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 119/247] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:29 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:30.060216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52bc5-1b53-4b56-9a82-97d1672f4259 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:30.079708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb91e9-0f96-4e4f-b884-569c0b5ab8a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:30.081557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb91e9-0f96-4e4f-b884-569c0b5ab8a1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:30.178161 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52bc5-1b53-4b56-9a82-97d1672f4259 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:30.197894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 129/248] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:30.204398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb91e9-0f96-4e4f-b884-569c0b5ab8a1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:30.226327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ade81-e5d6-453f-a65a-c3ad9ecf8321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:30.227254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ade81-e5d6-453f-a65a-c3ad9ecf8321 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:30.227540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ade81-e5d6-453f-a65a-c3ad9ecf8321 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:30.227820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ade81-e5d6-453f-a65a-c3ad9ecf8321 None admin] PATH_INFO: `/v3/users/b468de6ff95c4934af5d4f48e9866735` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:30.229148 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ade81-e5d6-453f-a65a-c3ad9ecf8321 None admin] RBAC: Authorizing `identity:get_user(user_id=b468de6ff95c4934af5d4f48e9866735)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:30.230708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ade81-e5d6-453f-a65a-c3ad9ecf8321 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:30.232945 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 120/249] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:30 2022] GET /identity/v3/users/b468de6ff95c4934af5d4f48e9866735 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:30.239920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ade81-e5d6-453f-a65a-c3ad9ecf8321 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:30.267958 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:30.326254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb91e9-0f96-4e4f-b884-569c0b5ab8a1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:30.347373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:30.369159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24803a9a-ea24-4d29-8640-85cf4fe31abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:30.370219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24803a9a-ea24-4d29-8640-85cf4fe31abe None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:30.370689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24803a9a-ea24-4d29-8640-85cf4fe31abe None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:30.371202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24803a9a-ea24-4d29-8640-85cf4fe31abe None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:30.372620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24803a9a-ea24-4d29-8640-85cf4fe31abe None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:30.374756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24803a9a-ea24-4d29-8640-85cf4fe31abe None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:30.383241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 130/250] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:30 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:30.384528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24803a9a-ea24-4d29-8640-85cf4fe31abe None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:30.439840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ade81-e5d6-453f-a65a-c3ad9ecf8321 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:30.512076 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a19e99-b3fb-44b4-8fb6-68217f326cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:30.513124 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19e99-b3fb-44b4-8fb6-68217f326cd6 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:30.513593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19e99-b3fb-44b4-8fb6-68217f326cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:30.514060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19e99-b3fb-44b4-8fb6-68217f326cd6 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:30.517085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a19e99-b3fb-44b4-8fb6-68217f326cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:30.518813 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a19e99-b3fb-44b4-8fb6-68217f326cd6 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:30.526681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 121/251] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:30 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:30.532667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24803a9a-ea24-4d29-8640-85cf4fe31abe None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:30.533908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a19e99-b3fb-44b4-8fb6-68217f326cd6 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:30.579271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:30.632311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc542f-23e6-4b78-85a6-9d493d1a556a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:30.633070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc542f-23e6-4b78-85a6-9d493d1a556a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:30.633526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc542f-23e6-4b78-85a6-9d493d1a556a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:30.634020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc542f-23e6-4b78-85a6-9d493d1a556a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:30.634978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc542f-23e6-4b78-85a6-9d493d1a556a None admin] RBAC: Adding query filter params (role.id=1aeb3352b3fb4ab79fd7171fec026530, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user.id=5ec828ce967d404ab2b3e02338a8266f) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:30.635259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc542f-23e6-4b78-85a6-9d493d1a556a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:30.636764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc542f-23e6-4b78-85a6-9d493d1a556a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:30.655559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 131/252] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:30 2022] GET /identity/v3/role_assignments?user.id=5ec828ce967d404ab2b3e02338a8266f&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=1aeb3352b3fb4ab79fd7171fec026530 => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:30.742990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fca3c-cd79-4283-b136-e5de51d973e9 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:30.742990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fca3c-cd79-4283-b136-e5de51d973e9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:30.742990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fca3c-cd79-4283-b136-e5de51d973e9 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:30.742990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 132/253] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:30.743832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf8616-c8cb-4f09-9c47-1f4249eee27b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:30.744190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf8616-c8cb-4f09-9c47-1f4249eee27b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:30.744507 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf8616-c8cb-4f09-9c47-1f4249eee27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:30.745787 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a19e99-b3fb-44b4-8fb6-68217f326cd6 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:30.765298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-bdaf8616-c8cb-4f09-9c47-1f4249eee27b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:30.766590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-bdaf8616-c8cb-4f09-9c47-1f4249eee27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:30.795469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:30.821809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375fd45-8ab1-43c6-aca7-d24ca9fe643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:30.822822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375fd45-8ab1-43c6-aca7-d24ca9fe643d None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:30.824090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375fd45-8ab1-43c6-aca7-d24ca9fe643d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:30.824386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375fd45-8ab1-43c6-aca7-d24ca9fe643d None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/users/b468de6ff95c4934af5d4f48e9866735/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:30.829242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375fd45-8ab1-43c6-aca7-d24ca9fe643d None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user_id=b468de6ff95c4934af5d4f48e9866735, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:30.831179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375fd45-8ab1-43c6-aca7-d24ca9fe643d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:30.876152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 122/254] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:38:30 2022] PUT /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/users/b468de6ff95c4934af5d4f48e9866735/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:30.889907 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00c7b4-0b62-456d-8452-3d0fecb338a7 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:30.890235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00c7b4-0b62-456d-8452-3d0fecb338a7 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:30.890497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00c7b4-0b62-456d-8452-3d0fecb338a7 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:30.898995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 123/255] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:30 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:30.899533 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008217ff-8a97-436a-a0b2-d19114d934da None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:30.899826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008217ff-8a97-436a-a0b2-d19114d934da None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:30.900106 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008217ff-8a97-436a-a0b2-d19114d934da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:30.921398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 133/256] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:30.941877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-008217ff-8a97-436a-a0b2-d19114d934da None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:30.943606 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-008217ff-8a97-436a-a0b2-d19114d934da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:30.949636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf8616-c8cb-4f09-9c47-1f4249eee27b None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:31.107399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 124/257] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:31.140944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf8616-c8cb-4f09-9c47-1f4249eee27b None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:31.147903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008217ff-8a97-436a-a0b2-d19114d934da None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:31.171583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:31.216524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247770c-f196-44f2-8de6-60031ab89cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:31.217211 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247770c-f196-44f2-8de6-60031ab89cb1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:31.217496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247770c-f196-44f2-8de6-60031ab89cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:31.217766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247770c-f196-44f2-8de6-60031ab89cb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:31.241909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247770c-f196-44f2-8de6-60031ab89cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-1247770c-f196-44f2-8de6-60031ab89cb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:31.252130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:31.253056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:31.253847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:31.258627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 134/258] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:38:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:31.266625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247770c-f196-44f2-8de6-60031ab89cb1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:31.312988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008217ff-8a97-436a-a0b2-d19114d934da None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:31.330982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:31.371735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b64a8-ca9d-4cd5-adeb-58e60605a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:31.372677 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b64a8-ca9d-4cd5-adeb-58e60605a253 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:31.372899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b64a8-ca9d-4cd5-adeb-58e60605a253 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:31.373127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b64a8-ca9d-4cd5-adeb-58e60605a253 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:31.394809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b64a8-ca9d-4cd5-adeb-58e60605a253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-942b64a8-ca9d-4cd5-adeb-58e60605a253 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:31.409015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:31.409937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:31.410709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:31.411835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 125/259] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:31.420317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b64a8-ca9d-4cd5-adeb-58e60605a253 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:31.467175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247770c-f196-44f2-8de6-60031ab89cb1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:31.528346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86118844-9b05-46ba-b1e2-559d56d38a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:31.529441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86118844-9b05-46ba-b1e2-559d56d38a54 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:31.529740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86118844-9b05-46ba-b1e2-559d56d38a54 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:31.530196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86118844-9b05-46ba-b1e2-559d56d38a54 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:31.531011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86118844-9b05-46ba-b1e2-559d56d38a54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:31.531325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86118844-9b05-46ba-b1e2-559d56d38a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:31.532798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86118844-9b05-46ba-b1e2-559d56d38a54 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:31.548202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 135/260] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:31.560366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86118844-9b05-46ba-b1e2-559d56d38a54 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:31.646724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:31.733285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b64a8-ca9d-4cd5-adeb-58e60605a253 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:31.818430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96582a-3178-40cb-b5e2-30e2d2f7e790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:31.819104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96582a-3178-40cb-b5e2-30e2d2f7e790 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:31.819373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96582a-3178-40cb-b5e2-30e2d2f7e790 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:31.819651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96582a-3178-40cb-b5e2-30e2d2f7e790 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:31.820663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96582a-3178-40cb-b5e2-30e2d2f7e790 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:31.820982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96582a-3178-40cb-b5e2-30e2d2f7e790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:31.822626 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96582a-3178-40cb-b5e2-30e2d2f7e790 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:31.838044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 126/261] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:31 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:31.847073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96582a-3178-40cb-b5e2-30e2d2f7e790 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:31.853758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86118844-9b05-46ba-b1e2-559d56d38a54 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:31.895317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:31.983878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a35437-4fc5-4c24-b4eb-d16d71954752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:31.984473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a35437-4fc5-4c24-b4eb-d16d71954752 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:31.984765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a35437-4fc5-4c24-b4eb-d16d71954752 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:31.985041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a35437-4fc5-4c24-b4eb-d16d71954752 None admin] PATH_INFO: `/v3/users/c2b813d2728345168d1351ac9dc40cb8` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:31.986331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a35437-4fc5-4c24-b4eb-d16d71954752 None admin] RBAC: Authorizing `identity:get_user(user_id=c2b813d2728345168d1351ac9dc40cb8)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:31.987834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a35437-4fc5-4c24-b4eb-d16d71954752 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:31.989667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 136/262] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:31 2022] GET /identity/v3/users/c2b813d2728345168d1351ac9dc40cb8 => generated 284 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:31.992896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96582a-3178-40cb-b5e2-30e2d2f7e790 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:31.995727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a35437-4fc5-4c24-b4eb-d16d71954752 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:32.033826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26270705-0fb9-41d6-bf9e-9812685dea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:32.034864 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26270705-0fb9-41d6-bf9e-9812685dea4f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:32.035369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26270705-0fb9-41d6-bf9e-9812685dea4f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:32.036393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26270705-0fb9-41d6-bf9e-9812685dea4f None admin] PATH_INFO: `/v3/users/c2b813d2728345168d1351ac9dc40cb8` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:32.037988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26270705-0fb9-41d6-bf9e-9812685dea4f None admin] RBAC: Authorizing `identity:get_user(user_id=c2b813d2728345168d1351ac9dc40cb8)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:32.039794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26270705-0fb9-41d6-bf9e-9812685dea4f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:32.042494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 127/263] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:31 2022] GET /identity/v3/users/c2b813d2728345168d1351ac9dc40cb8 => generated 284 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:32.049676 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26270705-0fb9-41d6-bf9e-9812685dea4f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:32.219321 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:32.223778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26270705-0fb9-41d6-bf9e-9812685dea4f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:32.240895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:32.250192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a35437-4fc5-4c24-b4eb-d16d71954752 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:32.295747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098af23-31a7-4169-a61c-06a639bc7fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:32.296746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098af23-31a7-4169-a61c-06a639bc7fb5 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:32.297272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098af23-31a7-4169-a61c-06a639bc7fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:32.297740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098af23-31a7-4169-a61c-06a639bc7fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:32.315693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2415c-dcd6-42d5-93f4-6066ac1254c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:32.316347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2415c-dcd6-42d5-93f4-6066ac1254c0 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:32.316637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2415c-dcd6-42d5-93f4-6066ac1254c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:32.316912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2415c-dcd6-42d5-93f4-6066ac1254c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:32.447525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2415c-dcd6-42d5-93f4-6066ac1254c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:32.449189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2415c-dcd6-42d5-93f4-6066ac1254c0 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:32.459855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098af23-31a7-4169-a61c-06a639bc7fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:32.461429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098af23-31a7-4169-a61c-06a639bc7fb5 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:32.682564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:32.688566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 137/264] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 16:38:32.696805 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2415c-dcd6-42d5-93f4-6066ac1254c0 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:32.723366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:32.729416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 128/265] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:32 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 16:38:32.736153 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098af23-31a7-4169-a61c-06a639bc7fb5 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:32.934251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098af23-31a7-4169-a61c-06a639bc7fb5 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:32.946719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2415c-dcd6-42d5-93f4-6066ac1254c0 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:33.008684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266acd52-c142-42ec-b69f-0d5d2bf439a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:33.009822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266acd52-c142-42ec-b69f-0d5d2bf439a3 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:33.010112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266acd52-c142-42ec-b69f-0d5d2bf439a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:33.010534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266acd52-c142-42ec-b69f-0d5d2bf439a3 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:33.016670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266acd52-c142-42ec-b69f-0d5d2bf439a3 None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:33.016818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc4de5-d926-429d-9e33-b1476209bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:33.017713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc4de5-d926-429d-9e33-b1476209bf31 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:33.018170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266acd52-c142-42ec-b69f-0d5d2bf439a3 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:33.018442 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc4de5-d926-429d-9e33-b1476209bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:33.018905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc4de5-d926-429d-9e33-b1476209bf31 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:33.020265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 138/266] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:32 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:33.020594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc4de5-d926-429d-9e33-b1476209bf31 None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:33.022336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc4de5-d926-429d-9e33-b1476209bf31 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:33.024349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 129/267] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:32 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:33.033489 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266acd52-c142-42ec-b69f-0d5d2bf439a3 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:33.034771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc4de5-d926-429d-9e33-b1476209bf31 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:33.140081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:33.160690 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:33.184223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266acd52-c142-42ec-b69f-0d5d2bf439a3 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:33.224581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f45b4-dc9d-4908-8cf3-f7999ba5e162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:33.225574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f45b4-dc9d-4908-8cf3-f7999ba5e162 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:33.226104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f45b4-dc9d-4908-8cf3-f7999ba5e162 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:33.226789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f45b4-dc9d-4908-8cf3-f7999ba5e162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:33.228289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f45b4-dc9d-4908-8cf3-f7999ba5e162 None admin] RBAC: Adding query filter params (role.id=1f3d7dea677f4b82a9728c6f9083d706, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user.id=c2b813d2728345168d1351ac9dc40cb8) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:33.228908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f45b4-dc9d-4908-8cf3-f7999ba5e162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:33.230604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f45b4-dc9d-4908-8cf3-f7999ba5e162 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:33.238042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 139/268] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:33 2022] GET /identity/v3/role_assignments?user.id=c2b813d2728345168d1351ac9dc40cb8&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=1f3d7dea677f4b82a9728c6f9083d706 => generated 610 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:33.239845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe759b-2427-4533-97c5-c069bbf9ca4f None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:33.240509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe759b-2427-4533-97c5-c069bbf9ca4f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:33.241068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe759b-2427-4533-97c5-c069bbf9ca4f None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:33.243100 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 140/269] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:33.253024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900000-6aff-4b3a-a776-8c988a63e2ca None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:33.253656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900000-6aff-4b3a-a776-8c988a63e2ca None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:33.254164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900000-6aff-4b3a-a776-8c988a63e2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:33.267023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc4de5-d926-429d-9e33-b1476209bf31 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:33.304235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-2a900000-6aff-4b3a-a776-8c988a63e2ca None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:33.306471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2a900000-6aff-4b3a-a776-8c988a63e2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:33.380551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e74106-4fde-41b1-96ff-eb26e152d9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:33.381484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e74106-4fde-41b1-96ff-eb26e152d9bf None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:33.381765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e74106-4fde-41b1-96ff-eb26e152d9bf None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:33.382035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e74106-4fde-41b1-96ff-eb26e152d9bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:33.382890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e74106-4fde-41b1-96ff-eb26e152d9bf None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user.id=c2b813d2728345168d1351ac9dc40cb8) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:33.383233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e74106-4fde-41b1-96ff-eb26e152d9bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:33.384747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e74106-4fde-41b1-96ff-eb26e152d9bf None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:33.405482 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 130/270] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:33 2022] GET /identity/v3/role_assignments?user.id=c2b813d2728345168d1351ac9dc40cb8&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=390e487a45f74246ba84773e8760bc7c => generated 610 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:33.407152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac8af2-8cf8-493f-8783-11018c8b88af None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:33.407433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac8af2-8cf8-493f-8783-11018c8b88af None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:33.407705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac8af2-8cf8-493f-8783-11018c8b88af None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:33.409085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 131/271] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:33.415005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad05e7e-5740-4d45-baa9-3fc8910f1ec4 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:33.415324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad05e7e-5740-4d45-baa9-3fc8910f1ec4 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:33.415560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad05e7e-5740-4d45-baa9-3fc8910f1ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:33.436836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-bad05e7e-5740-4d45-baa9-3fc8910f1ec4 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:33.438046 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-bad05e7e-5740-4d45-baa9-3fc8910f1ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:33.438702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 141/272] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:33.475578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a900000-6aff-4b3a-a776-8c988a63e2ca None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:33.563547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 132/273] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:33.621682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:33.625946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad05e7e-5740-4d45-baa9-3fc8910f1ec4 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:33.662529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a900000-6aff-4b3a-a776-8c988a63e2ca None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:33.707477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539cd0-b001-42f2-9c01-f2a0a6ef5af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:33.708140 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539cd0-b001-42f2-9c01-f2a0a6ef5af0 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:33.708422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539cd0-b001-42f2-9c01-f2a0a6ef5af0 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:33.708687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539cd0-b001-42f2-9c01-f2a0a6ef5af0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:33.733084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43539cd0-b001-42f2-9c01-f2a0a6ef5af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-43539cd0-b001-42f2-9c01-f2a0a6ef5af0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:33.738102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:33.739853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:33.741453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 142/274] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:33.751612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539cd0-b001-42f2-9c01-f2a0a6ef5af0 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:33.756417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:33.830098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad05e7e-5740-4d45-baa9-3fc8910f1ec4 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:33.864753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539cd0-b001-42f2-9c01-f2a0a6ef5af0 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:33.890174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:33.897441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3f13d-2889-4441-993a-c40b2f57cf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:33.898570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f13d-2889-4441-993a-c40b2f57cf44 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:33.899271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f13d-2889-4441-993a-c40b2f57cf44 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:33.899514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f13d-2889-4441-993a-c40b2f57cf44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:33.901651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3f13d-2889-4441-993a-c40b2f57cf44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:33.904691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3f13d-2889-4441-993a-c40b2f57cf44 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:33.906603 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02073922-5a3b-4f69-9d89-8e20df48ebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:33.907282 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073922-5a3b-4f69-9d89-8e20df48ebb1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:33.907564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073922-5a3b-4f69-9d89-8e20df48ebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:33.907895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 133/275] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:38:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:33.908134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073922-5a3b-4f69-9d89-8e20df48ebb1 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:33.908883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02073922-5a3b-4f69-9d89-8e20df48ebb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:33.909197 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02073922-5a3b-4f69-9d89-8e20df48ebb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:33.910637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02073922-5a3b-4f69-9d89-8e20df48ebb1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:33.914584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3f13d-2889-4441-993a-c40b2f57cf44 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:33.920554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 143/276] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:33 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:33.926236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02073922-5a3b-4f69-9d89-8e20df48ebb1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:34.028172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3f13d-2889-4441-993a-c40b2f57cf44 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:34.040865 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02073922-5a3b-4f69-9d89-8e20df48ebb1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:34.060695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:34.067134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f9c8a-857c-4a15-9caa-66f3b80d4e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:34.067756 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9c8a-857c-4a15-9caa-66f3b80d4e89 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.068035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9c8a-857c-4a15-9caa-66f3b80d4e89 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.068299 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9c8a-857c-4a15-9caa-66f3b80d4e89 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.068978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f9c8a-857c-4a15-9caa-66f3b80d4e89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:34.070474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f9c8a-857c-4a15-9caa-66f3b80d4e89 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:34.077336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14c24f-4bf0-4fad-a7be-9b3ea4b341ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:34.078146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14c24f-4bf0-4fad-a7be-9b3ea4b341ed None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.078424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14c24f-4bf0-4fad-a7be-9b3ea4b341ed None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.078694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14c24f-4bf0-4fad-a7be-9b3ea4b341ed None admin] PATH_INFO: `/v3/users/60a23f656b34448caf8718c86de1a2cd` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.095320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 134/277] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:38:33 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:38:34.095872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14c24f-4bf0-4fad-a7be-9b3ea4b341ed None admin] RBAC: Authorizing `identity:get_user(user_id=60a23f656b34448caf8718c86de1a2cd)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:34.096844 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003cc1f-77c0-485e-a8b4-42d7bcbe7b19 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.097138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003cc1f-77c0-485e-a8b4-42d7bcbe7b19 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.097355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14c24f-4bf0-4fad-a7be-9b3ea4b341ed None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:34.097444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003cc1f-77c0-485e-a8b4-42d7bcbe7b19 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.098895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 135/278] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:34.099920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef92778-b343-4213-a8eb-7df405eef809 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.100130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef92778-b343-4213-a8eb-7df405eef809 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.100409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef92778-b343-4213-a8eb-7df405eef809 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.102999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 136/279] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:34.103403 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 144/280] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:33 2022] GET /identity/v3/users/60a23f656b34448caf8718c86de1a2cd => generated 294 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:34.108122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dfdb5-4279-44c4-bf7d-8fc44b9f8fd6 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.108600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a49d7f-2a40-4cf9-9c7d-445622fb663a None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.108776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dfdb5-4279-44c4-bf7d-8fc44b9f8fd6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.108879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a49d7f-2a40-4cf9-9c7d-445622fb663a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.109196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a49d7f-2a40-4cf9-9c7d-445622fb663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.109498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dfdb5-4279-44c4-bf7d-8fc44b9f8fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.130438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e58dfdb5-4279-44c4-bf7d-8fc44b9f8fd6 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:34.130664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-e8a49d7f-2a40-4cf9-9c7d-445622fb663a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:34.131756 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e58dfdb5-4279-44c4-bf7d-8fc44b9f8fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:34.131858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e8a49d7f-2a40-4cf9-9c7d-445622fb663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:34.181220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:34.227166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 145/281] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:34.227166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a49d7f-2a40-4cf9-9c7d-445622fb663a None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:34.227443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 137/282] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:34.246688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dfdb5-4279-44c4-bf7d-8fc44b9f8fd6 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:34.349980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a49d7f-2a40-4cf9-9c7d-445622fb663a None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:34.372025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dfdb5-4279-44c4-bf7d-8fc44b9f8fd6 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:34.391903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:34.408529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99b838-7634-4de5-ab64-f636b84b3fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:34.409310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99b838-7634-4de5-ab64-f636b84b3fce None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.409587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99b838-7634-4de5-ab64-f636b84b3fce None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.409854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99b838-7634-4de5-ab64-f636b84b3fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.410668 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99b838-7634-4de5-ab64-f636b84b3fce None admin] RBAC: Adding query filter params (role.id=a1ce48deeb3148e28049f10600de5fbe, user.id=60a23f656b34448caf8718c86de1a2cd, scope.system=all) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:34.410999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99b838-7634-4de5-ab64-f636b84b3fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:34.413242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99b838-7634-4de5-ab64-f636b84b3fce None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:34.420453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 146/283] 10.222.0.124 () {56 vars in 1313 bytes} [Mon Aug 1 16:38:34 2022] GET /identity/v3/role_assignments?user.id=60a23f656b34448caf8718c86de1a2cd&scope.system=all&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 227 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:34.420629 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0d504-9d5b-49b3-8d5b-5c793995c878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:34.421092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d504-9d5b-49b3-8d5b-5c793995c878 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.421189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99b838-7634-4de5-ab64-f636b84b3fce None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:34.421379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d504-9d5b-49b3-8d5b-5c793995c878 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.421657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d504-9d5b-49b3-8d5b-5c793995c878 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.435692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0d504-9d5b-49b3-8d5b-5c793995c878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-a1c0d504-9d5b-49b3-8d5b-5c793995c878 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:34.441176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:34.442185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:34.443054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 138/284] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:34.448987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0d504-9d5b-49b3-8d5b-5c793995c878 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:34.474209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:34.569894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99b838-7634-4de5-ab64-f636b84b3fce None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:34.581181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0d504-9d5b-49b3-8d5b-5c793995c878 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:34.610698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83975e14-d912-45cb-a39f-b94d51e35f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:34.611505 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83975e14-d912-45cb-a39f-b94d51e35f1a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.611860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83975e14-d912-45cb-a39f-b94d51e35f1a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.612224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83975e14-d912-45cb-a39f-b94d51e35f1a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.620897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8c27c-ac39-4e09-bc9c-970e38843609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:34.621873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8c27c-ac39-4e09-bc9c-970e38843609 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.622436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8c27c-ac39-4e09-bc9c-970e38843609 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.622874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8c27c-ac39-4e09-bc9c-970e38843609 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.623811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8c27c-ac39-4e09-bc9c-970e38843609 None admin] RBAC: Adding query filter params (name=member) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:34.624300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8c27c-ac39-4e09-bc9c-970e38843609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:34.625518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83975e14-d912-45cb-a39f-b94d51e35f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:34.626062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8c27c-ac39-4e09-bc9c-970e38843609 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-83975e14-d912-45cb-a39f-b94d51e35f1a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:34.631058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:34.631959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:34.632858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 147/285] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:34.638778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 139/286] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:34 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:34.640116 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83975e14-d912-45cb-a39f-b94d51e35f1a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:34.647663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8c27c-ac39-4e09-bc9c-970e38843609 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:34.728209 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:34.810565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8c27c-ac39-4e09-bc9c-970e38843609 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:34.829963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:34.840998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83975e14-d912-45cb-a39f-b94d51e35f1a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:34.885992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaff76-a130-4302-ad08-208a350c35fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:34.886600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaff76-a130-4302-ad08-208a350c35fc None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.886880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaff76-a130-4302-ad08-208a350c35fc None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.887189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaff76-a130-4302-ad08-208a350c35fc None admin] PATH_INFO: `/v3/users/b468de6ff95c4934af5d4f48e9866735` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.888397 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaff76-a130-4302-ad08-208a350c35fc None admin] RBAC: Authorizing `identity:get_user(user_id=b468de6ff95c4934af5d4f48e9866735)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:34.889883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaff76-a130-4302-ad08-208a350c35fc None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:34.891881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 140/287] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:34 2022] GET /identity/v3/users/b468de6ff95c4934af5d4f48e9866735 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:34.900580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaff76-a130-4302-ad08-208a350c35fc None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:34.901955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941e04b-eee0-4b2c-afc7-b6c0620b8bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:34.902601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941e04b-eee0-4b2c-afc7-b6c0620b8bd3 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:34.902880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941e04b-eee0-4b2c-afc7-b6c0620b8bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:34.903175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941e04b-eee0-4b2c-afc7-b6c0620b8bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:34.903914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941e04b-eee0-4b2c-afc7-b6c0620b8bd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:34.904220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941e04b-eee0-4b2c-afc7-b6c0620b8bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:34.905617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941e04b-eee0-4b2c-afc7-b6c0620b8bd3 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:34.929570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 148/288] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:34 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:34.935785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941e04b-eee0-4b2c-afc7-b6c0620b8bd3 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:35.051981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaff76-a130-4302-ad08-208a350c35fc None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:35.063604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:35.094783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd8892-6b2c-4e61-ba3a-97ba9f3fa329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:35.096422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd8892-6b2c-4e61-ba3a-97ba9f3fa329 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:35.096896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd8892-6b2c-4e61-ba3a-97ba9f3fa329 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:35.097502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd8892-6b2c-4e61-ba3a-97ba9f3fa329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:35.213498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941e04b-eee0-4b2c-afc7-b6c0620b8bd3 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:35.263731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf15fec-0015-4e3a-86a6-1d4e3d98dae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:35.264395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf15fec-0015-4e3a-86a6-1d4e3d98dae1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:35.264679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf15fec-0015-4e3a-86a6-1d4e3d98dae1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:35.264955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf15fec-0015-4e3a-86a6-1d4e3d98dae1 None admin] PATH_INFO: `/v3/users/5ec828ce967d404ab2b3e02338a8266f` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:35.266805 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf15fec-0015-4e3a-86a6-1d4e3d98dae1 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec828ce967d404ab2b3e02338a8266f)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:35.268304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf15fec-0015-4e3a-86a6-1d4e3d98dae1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:35.269944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 149/289] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:34 2022] GET /identity/v3/users/5ec828ce967d404ab2b3e02338a8266f => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:35.276499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf15fec-0015-4e3a-86a6-1d4e3d98dae1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:35.283971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd8892-6b2c-4e61-ba3a-97ba9f3fa329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:35.285485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd8892-6b2c-4e61-ba3a-97ba9f3fa329 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:35.318590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:35.452018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf15fec-0015-4e3a-86a6-1d4e3d98dae1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:35.515451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61b821-fce2-4fd4-9730-acd31491143f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:35.519748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 141/290] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:35.524758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b821-fce2-4fd4-9730-acd31491143f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:35.525054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b821-fce2-4fd4-9730-acd31491143f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:35.525340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b821-fce2-4fd4-9730-acd31491143f None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:35.527259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd8892-6b2c-4e61-ba3a-97ba9f3fa329 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:35.527565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61b821-fce2-4fd4-9730-acd31491143f None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:35.529120 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61b821-fce2-4fd4-9730-acd31491143f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:35.530910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 150/291] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:35 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:35.536214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:35.536582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61b821-fce2-4fd4-9730-acd31491143f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:35.643578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:35.651345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61b821-fce2-4fd4-9730-acd31491143f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:35.717832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd8892-6b2c-4e61-ba3a-97ba9f3fa329 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:35.728150 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7e97f-ebf5-4cfc-ae67-1f0931c9f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:35.728854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7e97f-ebf5-4cfc-ae67-1f0931c9f8b4 None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:35.729135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7e97f-ebf5-4cfc-ae67-1f0931c9f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:35.729410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7e97f-ebf5-4cfc-ae67-1f0931c9f8b4 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/users/5ec828ce967d404ab2b3e02338a8266f/roles/1aeb3352b3fb4ab79fd7171fec026530` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:35.733356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7e97f-ebf5-4cfc-ae67-1f0931c9f8b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user_id=5ec828ce967d404ab2b3e02338a8266f, role_id=1aeb3352b3fb4ab79fd7171fec026530)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:35.735176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7e97f-ebf5-4cfc-ae67-1f0931c9f8b4 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:35.755800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 151/292] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:38:35 2022] PUT /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/users/5ec828ce967d404ab2b3e02338a8266f/roles/1aeb3352b3fb4ab79fd7171fec026530 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:35.787736 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590110-db5e-4368-856b-97db7841aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:35.788421 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590110-db5e-4368-856b-97db7841aabc None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:35.788852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590110-db5e-4368-856b-97db7841aabc None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:35.789228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590110-db5e-4368-856b-97db7841aabc None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:35.792027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0590110-db5e-4368-856b-97db7841aabc None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:35.793592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0590110-db5e-4368-856b-97db7841aabc None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:35.795836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 142/293] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:35 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:35.801752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7e97f-ebf5-4cfc-ae67-1f0931c9f8b4 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:35.952805 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7e97f-ebf5-4cfc-ae67-1f0931c9f8b4 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:36.005415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b9106-53db-47b9-b795-1815b49ee236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:36.006122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b9106-53db-47b9-b795-1815b49ee236 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:36.006340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b9106-53db-47b9-b795-1815b49ee236 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:36.006616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b9106-53db-47b9-b795-1815b49ee236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:36.007604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b9106-53db-47b9-b795-1815b49ee236 None admin] RBAC: Adding query filter params (role.id=a1ce48deeb3148e28049f10600de5fbe, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user.id=b468de6ff95c4934af5d4f48e9866735) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:36.007927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b9106-53db-47b9-b795-1815b49ee236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:36.009425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b9106-53db-47b9-b795-1815b49ee236 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:36.020237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 152/294] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:35 2022] GET /identity/v3/role_assignments?user.id=b468de6ff95c4934af5d4f48e9866735&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 610 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:36.697474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b518ba-1b17-4e5f-8d38-7284a4a2cab5 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:36.698063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b518ba-1b17-4e5f-8d38-7284a4a2cab5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:36.698063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b518ba-1b17-4e5f-8d38-7284a4a2cab5 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:36.699463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 143/295] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:36.706799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa056b8-311a-4721-b559-db3e996ac3e3 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:36.707400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa056b8-311a-4721-b559-db3e996ac3e3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:36.707829 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa056b8-311a-4721-b559-db3e996ac3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:36.731179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-6fa056b8-311a-4721-b559-db3e996ac3e3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:36.732623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6fa056b8-311a-4721-b559-db3e996ac3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:36.758076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:36.773170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b7207-d345-4cf2-8ad8-68a09d313756 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:36.773459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b7207-d345-4cf2-8ad8-68a09d313756 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:36.773741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b7207-d345-4cf2-8ad8-68a09d313756 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:36.775484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 144/296] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:38:36.781072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d3ed3-c7eb-412d-bf0a-9e20bb89b2d6 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:36.781361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d3ed3-c7eb-412d-bf0a-9e20bb89b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:36.781641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d3ed3-c7eb-412d-bf0a-9e20bb89b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:36.801929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e34d3ed3-c7eb-412d-bf0a-9e20bb89b2d6 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:36.803712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e34d3ed3-c7eb-412d-bf0a-9e20bb89b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:36.826655 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 153/297] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:36.850305 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa056b8-311a-4721-b559-db3e996ac3e3 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:36.899126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 145/298] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:36.923811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d3ed3-c7eb-412d-bf0a-9e20bb89b2d6 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:36.927816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:36.979325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa056b8-311a-4721-b559-db3e996ac3e3 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:37.016936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8a604-f48a-4a79-975d-10c88dd6cf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:37.017499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8a604-f48a-4a79-975d-10c88dd6cf91 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.017788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8a604-f48a-4a79-975d-10c88dd6cf91 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.018062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8a604-f48a-4a79-975d-10c88dd6cf91 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:37.029051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8a604-f48a-4a79-975d-10c88dd6cf91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-25e8a604-f48a-4a79-975d-10c88dd6cf91 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:37.037050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:37.038217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:37.039169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:37.040846 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 154/299] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:37.041379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df6c8-3f4c-4d43-9cd7-c5343c9faf79 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.041836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df6c8-3f4c-4d43-9cd7-c5343c9faf79 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.042341 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df6c8-3f4c-4d43-9cd7-c5343c9faf79 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:37.044119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 155/300] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:37.044689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df6c8-3f4c-4d43-9cd7-c5343c9faf79 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:37.050545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d3ed3-c7eb-412d-bf0a-9e20bb89b2d6 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:37.057014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:37.091017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f3a8f-2b64-465e-bbec-37286ccb1085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:37.091681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f3a8f-2b64-465e-bbec-37286ccb1085 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.091963 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f3a8f-2b64-465e-bbec-37286ccb1085 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.092236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f3a8f-2b64-465e-bbec-37286ccb1085 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:37.093518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f3a8f-2b64-465e-bbec-37286ccb1085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:37.095035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f3a8f-2b64-465e-bbec-37286ccb1085 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:37.101453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 146/301] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:38:36 2022] GET /identity/v3/domains/default => generated 200 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:37.101453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262190e-251a-4a05-b90c-eed8eca354a6 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.101453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262190e-251a-4a05-b90c-eed8eca354a6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.101453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262190e-251a-4a05-b90c-eed8eca354a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:37.117597 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b262190e-251a-4a05-b90c-eed8eca354a6 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:37.118816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b262190e-251a-4a05-b90c-eed8eca354a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:37.174322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df6c8-3f4c-4d43-9cd7-c5343c9faf79 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:37.199001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 147/302] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:37.199001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262190e-251a-4a05-b90c-eed8eca354a6 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:37.203440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:37.215121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26af51-c9d3-4eee-a6c1-80e2f1576b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:37.215874 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26af51-c9d3-4eee-a6c1-80e2f1576b45 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.216223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26af51-c9d3-4eee-a6c1-80e2f1576b45 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.216569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26af51-c9d3-4eee-a6c1-80e2f1576b45 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:37.217368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26af51-c9d3-4eee-a6c1-80e2f1576b45 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:37.217740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26af51-c9d3-4eee-a6c1-80e2f1576b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:37.219365 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26af51-c9d3-4eee-a6c1-80e2f1576b45 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:37.228600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 156/303] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:37 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:37.229515 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26af51-c9d3-4eee-a6c1-80e2f1576b45 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:37.308339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:37.323130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262190e-251a-4a05-b90c-eed8eca354a6 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:37.346662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26af51-c9d3-4eee-a6c1-80e2f1576b45 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:37.360906 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a83d5f-8d8d-4a16-a698-643d2181deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:37.361552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a83d5f-8d8d-4a16-a698-643d2181deae None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.361843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a83d5f-8d8d-4a16-a698-643d2181deae None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.362122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a83d5f-8d8d-4a16-a698-643d2181deae None admin] PATH_INFO: `/v3/groups` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:37.362805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a83d5f-8d8d-4a16-a698-643d2181deae None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:37.364293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a83d5f-8d8d-4a16-a698-643d2181deae None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:37.385131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 148/304] 10.222.0.124 () {60 vars in 1139 bytes} [Mon Aug 1 16:38:37 2022] POST /identity/v3/groups => generated 230 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:38:37.385786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a83d5f-8d8d-4a16-a698-643d2181deae None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:37.393235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99167396-b170-416a-bb1a-8524f3c4e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:37.394319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99167396-b170-416a-bb1a-8524f3c4e983 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.394800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99167396-b170-416a-bb1a-8524f3c4e983 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.395313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99167396-b170-416a-bb1a-8524f3c4e983 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:37.414587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99167396-b170-416a-bb1a-8524f3c4e983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-99167396-b170-416a-bb1a-8524f3c4e983 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:37.423920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:37.424879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:37.425754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:37.428566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 157/305] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:37.434481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99167396-b170-416a-bb1a-8524f3c4e983 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:37.480000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:37.544089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a83d5f-8d8d-4a16-a698-643d2181deae None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:37.593976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99167396-b170-416a-bb1a-8524f3c4e983 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:37.597202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e03c9-fbae-4fd5-b6fc-1daf7993a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:37.597876 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e03c9-fbae-4fd5-b6fc-1daf7993a82f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.598163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e03c9-fbae-4fd5-b6fc-1daf7993a82f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.598446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e03c9-fbae-4fd5-b6fc-1daf7993a82f None admin] PATH_INFO: `/v3/users/885bfc38c00d4fb9965fc63261399b77` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:37.613363 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e03c9-fbae-4fd5-b6fc-1daf7993a82f None admin] RBAC: Authorizing `identity:get_user(user_id=885bfc38c00d4fb9965fc63261399b77)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:37.614986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e03c9-fbae-4fd5-b6fc-1daf7993a82f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:37.618447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 149/306] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:37 2022] GET /identity/v3/users/885bfc38c00d4fb9965fc63261399b77 => generated 294 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:37.624493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e03c9-fbae-4fd5-b6fc-1daf7993a82f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:37.626244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:37.631242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da7d4-f7e7-4023-846b-080648794d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:37.631886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da7d4-f7e7-4023-846b-080648794d86 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.632244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da7d4-f7e7-4023-846b-080648794d86 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.632497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da7d4-f7e7-4023-846b-080648794d86 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:37.633238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645da7d4-f7e7-4023-846b-080648794d86 None admin] RBAC: Adding query filter params (name=member) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:37.633646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645da7d4-f7e7-4023-846b-080648794d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:37.636122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645da7d4-f7e7-4023-846b-080648794d86 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:37.644776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 158/307] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:37.651205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da7d4-f7e7-4023-846b-080648794d86 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:37.750903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e03c9-fbae-4fd5-b6fc-1daf7993a82f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:37.778492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:37.779275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da7d4-f7e7-4023-846b-080648794d86 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:37.797189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee5259-af78-4b16-b7a8-b1c5233adb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:37.798276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee5259-af78-4b16-b7a8-b1c5233adb6c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.798658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee5259-af78-4b16-b7a8-b1c5233adb6c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.799067 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee5259-af78-4b16-b7a8-b1c5233adb6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:37.800121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee5259-af78-4b16-b7a8-b1c5233adb6c None admin] RBAC: Adding query filter params (role.id=1aeb3352b3fb4ab79fd7171fec026530, user.id=885bfc38c00d4fb9965fc63261399b77, scope.system=all) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:37.800823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee5259-af78-4b16-b7a8-b1c5233adb6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:37.802394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee5259-af78-4b16-b7a8-b1c5233adb6c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:37.810534 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 150/308] 10.222.0.124 () {56 vars in 1313 bytes} [Mon Aug 1 16:38:37 2022] GET /identity/v3/role_assignments?user.id=885bfc38c00d4fb9965fc63261399b77&scope.system=all&role.id=1aeb3352b3fb4ab79fd7171fec026530 => generated 227 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:37.825991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baadd5-b328-4c1b-b137-cfe4b1275ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:37.826706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baadd5-b328-4c1b-b137-cfe4b1275ad7 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.827030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baadd5-b328-4c1b-b137-cfe4b1275ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.827316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baadd5-b328-4c1b-b137-cfe4b1275ad7 None admin] PATH_INFO: `/v3/users/60a23f656b34448caf8718c86de1a2cd` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:37.828705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4baadd5-b328-4c1b-b137-cfe4b1275ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=60a23f656b34448caf8718c86de1a2cd)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:37.830241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4baadd5-b328-4c1b-b137-cfe4b1275ad7 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:37.832091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 159/309] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:37 2022] GET /identity/v3/users/60a23f656b34448caf8718c86de1a2cd => generated 294 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:37.838559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee5259-af78-4b16-b7a8-b1c5233adb6c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:37.956658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee5259-af78-4b16-b7a8-b1c5233adb6c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:37.997534 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0b981-deb7-4f25-a9be-43e755cd24c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:37.998270 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b981-deb7-4f25-a9be-43e755cd24c6 None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:37.998553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b981-deb7-4f25-a9be-43e755cd24c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:37.998832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b981-deb7-4f25-a9be-43e755cd24c6 None admin] PATH_INFO: `/v3/system/users/60a23f656b34448caf8718c86de1a2cd/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:38.000368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0b981-deb7-4f25-a9be-43e755cd24c6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=60a23f656b34448caf8718c86de1a2cd, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:38.001778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0b981-deb7-4f25-a9be-43e755cd24c6 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:38.015699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 151/310] 10.222.0.124 () {58 vars in 1339 bytes} [Mon Aug 1 16:38:37 2022] PUT /identity/v3/system/users/60a23f656b34448caf8718c86de1a2cd/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:38.209854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f32b-6c4f-444f-8da1-65a28f559641 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:38.210377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f32b-6c4f-444f-8da1-65a28f559641 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:38.210744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171f32b-6c4f-444f-8da1-65a28f559641 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:38.212523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 160/311] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:38.219623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ef119-f5cf-46c5-916f-936f6d7ba7eb None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:38.219947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ef119-f5cf-46c5-916f-936f6d7ba7eb None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:38.220165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ef119-f5cf-46c5-916f-936f6d7ba7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:38.239364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ea0ef119-f5cf-46c5-916f-936f6d7ba7eb None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:38.240577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ea0ef119-f5cf-46c5-916f-936f6d7ba7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:38.291522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:38.324875 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 152/312] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:38.348609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171f32b-6c4f-444f-8da1-65a28f559641 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:38.417936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:38.468629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171f32b-6c4f-444f-8da1-65a28f559641 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:38.521789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5003-a67a-4cea-ba33-6d7b22795fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:38.523268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5003-a67a-4cea-ba33-6d7b22795fed None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:38.523986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5003-a67a-4cea-ba33-6d7b22795fed None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:38.524521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5003-a67a-4cea-ba33-6d7b22795fed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:38.537380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e5003-a67a-4cea-ba33-6d7b22795fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-254e5003-a67a-4cea-ba33-6d7b22795fed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:38.543030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:38.543945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:38.544745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 161/313] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:38.550607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ef119-f5cf-46c5-916f-936f6d7ba7eb None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:38.661500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ef119-f5cf-46c5-916f-936f6d7ba7eb None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:38.702743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867fb7-e37c-4f24-82dc-8bdba5ae2156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:38.703408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867fb7-e37c-4f24-82dc-8bdba5ae2156 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:38.703692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867fb7-e37c-4f24-82dc-8bdba5ae2156 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:38.703966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867fb7-e37c-4f24-82dc-8bdba5ae2156 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:38.704703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3867fb7-e37c-4f24-82dc-8bdba5ae2156 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:38.705011 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3867fb7-e37c-4f24-82dc-8bdba5ae2156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:38.706408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3867fb7-e37c-4f24-82dc-8bdba5ae2156 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:38.716718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 153/314] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:38 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:38.721992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5003-a67a-4cea-ba33-6d7b22795fed None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:38.843170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5003-a67a-4cea-ba33-6d7b22795fed None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:38.864127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:38.879919 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed33af3-86b6-4453-a33e-a06eefc35d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:38.880601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed33af3-86b6-4453-a33e-a06eefc35d01 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:38.880927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed33af3-86b6-4453-a33e-a06eefc35d01 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:38.881204 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed33af3-86b6-4453-a33e-a06eefc35d01 None admin] PATH_INFO: `/v3/users/5ec828ce967d404ab2b3e02338a8266f` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:38.882499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed33af3-86b6-4453-a33e-a06eefc35d01 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec828ce967d404ab2b3e02338a8266f)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:38.884083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed33af3-86b6-4453-a33e-a06eefc35d01 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:38.886040 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 162/315] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:38 2022] GET /identity/v3/users/5ec828ce967d404ab2b3e02338a8266f => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:38.891763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867fb7-e37c-4f24-82dc-8bdba5ae2156 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:38.938066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:39.003927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867fb7-e37c-4f24-82dc-8bdba5ae2156 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:39.042002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999e8e8-5170-4667-acf3-a9d7577ddc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:39.042639 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999e8e8-5170-4667-acf3-a9d7577ddc08 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:39.042921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999e8e8-5170-4667-acf3-a9d7577ddc08 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:39.043230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999e8e8-5170-4667-acf3-a9d7577ddc08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:39.121719 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999e8e8-5170-4667-acf3-a9d7577ddc08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:39.123354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999e8e8-5170-4667-acf3-a9d7577ddc08 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:39.169665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:39.239044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 154/316] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:39.248168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed33af3-86b6-4453-a33e-a06eefc35d01 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:39.358879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed33af3-86b6-4453-a33e-a06eefc35d01 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:39.394476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc8316-d46b-4c4d-a662-199f9019d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:39.395186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc8316-d46b-4c4d-a662-199f9019d76a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:39.395470 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc8316-d46b-4c4d-a662-199f9019d76a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:39.395746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc8316-d46b-4c4d-a662-199f9019d76a None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:39.396954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc8316-d46b-4c4d-a662-199f9019d76a None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:39.399032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc8316-d46b-4c4d-a662-199f9019d76a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:39.401102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 163/317] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:39 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:39.407182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999e8e8-5170-4667-acf3-a9d7577ddc08 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:39.514322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999e8e8-5170-4667-acf3-a9d7577ddc08 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:39.550838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea5d16-c392-488f-830f-8bad91a58028 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:39.551240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea5d16-c392-488f-830f-8bad91a58028 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:39.551520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea5d16-c392-488f-830f-8bad91a58028 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:39.552340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3698c07-9db3-4ac1-b87c-63495b3015e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:39.552980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3698c07-9db3-4ac1-b87c-63495b3015e4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:39.553156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 164/318] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:39.553318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3698c07-9db3-4ac1-b87c-63495b3015e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:39.553592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3698c07-9db3-4ac1-b87c-63495b3015e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:39.554435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3698c07-9db3-4ac1-b87c-63495b3015e4 None admin] RBAC: Adding query filter params (role.id=1aeb3352b3fb4ab79fd7171fec026530, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e, user.id=5ec828ce967d404ab2b3e02338a8266f) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:39.554744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3698c07-9db3-4ac1-b87c-63495b3015e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:39.556228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3698c07-9db3-4ac1-b87c-63495b3015e4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:39.563698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22e4d0-b5f1-43df-bfe3-83cc44e835a3 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:39.564013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22e4d0-b5f1-43df-bfe3-83cc44e835a3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:39.564251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22e4d0-b5f1-43df-bfe3-83cc44e835a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:39.564349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 155/319] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:38:39 2022] GET /identity/v3/role_assignments?user.id=5ec828ce967d404ab2b3e02338a8266f&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=1aeb3352b3fb4ab79fd7171fec026530 => generated 610 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:39.584334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-0d22e4d0-b5f1-43df-bfe3-83cc44e835a3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:39.586013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0d22e4d0-b5f1-43df-bfe3-83cc44e835a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:39.645330 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:39.671144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 165/320] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:39.690361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3698c07-9db3-4ac1-b87c-63495b3015e4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:39.694816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:39.807252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3698c07-9db3-4ac1-b87c-63495b3015e4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:39.851838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc5811-2879-4a10-86a4-e624eda4b06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:39.852503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc5811-2879-4a10-86a4-e624eda4b06e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:39.852837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc5811-2879-4a10-86a4-e624eda4b06e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:39.853115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc5811-2879-4a10-86a4-e624eda4b06e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:39.854301 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc5811-2879-4a10-86a4-e624eda4b06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:39.855919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc5811-2879-4a10-86a4-e624eda4b06e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:39.859127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 156/321] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:38:39 2022] GET /identity/v3/domains/default => generated 200 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:39.867810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22e4d0-b5f1-43df-bfe3-83cc44e835a3 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:39.977022 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22e4d0-b5f1-43df-bfe3-83cc44e835a3 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:39.992249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850c70f-2ebe-4efb-9efa-53ce5244d6e2 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:39.992835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850c70f-2ebe-4efb-9efa-53ce5244d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:39.992835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850c70f-2ebe-4efb-9efa-53ce5244d6e2 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:39.994365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 157/322] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:39.999557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1d06d-99a8-4baa-a412-0cef985fdac5 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:39.999842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1d06d-99a8-4baa-a412-0cef985fdac5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:40.000235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1d06d-99a8-4baa-a412-0cef985fdac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:40.013385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf7827-477c-47bd-b3d1-43167674f97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:40.014042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7827-477c-47bd-b3d1-43167674f97f None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:40.014316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7827-477c-47bd-b3d1-43167674f97f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:40.014589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7827-477c-47bd-b3d1-43167674f97f None admin] PATH_INFO: `/v3/groups` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:40.015320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf7827-477c-47bd-b3d1-43167674f97f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:40.016780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf7827-477c-47bd-b3d1-43167674f97f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:40.019067 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-8af1d06d-99a8-4baa-a412-0cef985fdac5 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:40.020305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8af1d06d-99a8-4baa-a412-0cef985fdac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:40.035572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 166/323] 10.222.0.124 () {60 vars in 1139 bytes} [Mon Aug 1 16:38:39 2022] POST /identity/v3/groups => generated 227 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:38:40.115910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 158/324] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:40.140189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf7827-477c-47bd-b3d1-43167674f97f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:40.190279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bfd61-385f-4591-93b1-9edb430d7f11 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:40.190619 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bfd61-385f-4591-93b1-9edb430d7f11 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:40.190843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bfd61-385f-4591-93b1-9edb430d7f11 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:40.192509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 159/325] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:40.198429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549150c-7240-4026-a6bd-3dd824a7cc43 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:40.198429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549150c-7240-4026-a6bd-3dd824a7cc43 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:40.198671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549150c-7240-4026-a6bd-3dd824a7cc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:40.201098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:40.205798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:40.220915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-8549150c-7240-4026-a6bd-3dd824a7cc43 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:40.222145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8549150c-7240-4026-a6bd-3dd824a7cc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:40.270031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf7827-477c-47bd-b3d1-43167674f97f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:40.308678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 160/326] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:40.316060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5f919-3b25-46f6-83d5-4c927cf6e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:40.318650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5f919-3b25-46f6-83d5-4c927cf6e6fc None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:40.318830 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5f919-3b25-46f6-83d5-4c927cf6e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:40.319102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5f919-3b25-46f6-83d5-4c927cf6e6fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:40.331536 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5f919-3b25-46f6-83d5-4c927cf6e6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:40.333850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549150c-7240-4026-a6bd-3dd824a7cc43 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-eeb5f919-3b25-46f6-83d5-4c927cf6e6fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:40.339209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:40.340524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:40.341497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 167/327] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:40.347448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5f919-3b25-46f6-83d5-4c927cf6e6fc None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:40.481842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549150c-7240-4026-a6bd-3dd824a7cc43 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:40.497348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5f919-3b25-46f6-83d5-4c927cf6e6fc None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:40.506218 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:40.531845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:40.536948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de1a2f-2575-48e0-808b-8eec8ac3aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:40.537614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de1a2f-2575-48e0-808b-8eec8ac3aa58 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:40.537897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de1a2f-2575-48e0-808b-8eec8ac3aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:40.538210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de1a2f-2575-48e0-808b-8eec8ac3aa58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:40.542231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f77a90-f340-4fd1-ae6e-0c7dc9e25249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:40.542877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f77a90-f340-4fd1-ae6e-0c7dc9e25249 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:40.543188 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f77a90-f340-4fd1-ae6e-0c7dc9e25249 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:40.543467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f77a90-f340-4fd1-ae6e-0c7dc9e25249 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:40.544309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f77a90-f340-4fd1-ae6e-0c7dc9e25249 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:40.544631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f77a90-f340-4fd1-ae6e-0c7dc9e25249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:40.546263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f77a90-f340-4fd1-ae6e-0c7dc9e25249 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:40.552406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de1a2f-2575-48e0-808b-8eec8ac3aa58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-13de1a2f-2575-48e0-808b-8eec8ac3aa58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:40.557572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:40.558466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:40.559895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:40.560482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 168/328] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:40 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:40.563277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 161/329] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:40.564346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f77a90-f340-4fd1-ae6e-0c7dc9e25249 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:40.564664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de1a2f-2575-48e0-808b-8eec8ac3aa58 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:40.689708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f77a90-f340-4fd1-ae6e-0c7dc9e25249 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:40.694022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de1a2f-2575-48e0-808b-8eec8ac3aa58 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:40.735873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ddaca-9082-4b47-bef9-8c86bac970f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:40.736554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ddaca-9082-4b47-bef9-8c86bac970f4 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:40.736836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ddaca-9082-4b47-bef9-8c86bac970f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:40.737114 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ddaca-9082-4b47-bef9-8c86bac970f4 None admin] PATH_INFO: `/v3/users/885bfc38c00d4fb9965fc63261399b77` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:40.738377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ddaca-9082-4b47-bef9-8c86bac970f4 None admin] RBAC: Authorizing `identity:get_user(user_id=885bfc38c00d4fb9965fc63261399b77)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:40.739847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933559b-d6c9-41ef-b7c6-59d30703e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:40.740059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ddaca-9082-4b47-bef9-8c86bac970f4 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:40.740501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933559b-d6c9-41ef-b7c6-59d30703e861 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:40.740788 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933559b-d6c9-41ef-b7c6-59d30703e861 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:40.741068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933559b-d6c9-41ef-b7c6-59d30703e861 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:40.742259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933559b-d6c9-41ef-b7c6-59d30703e861 None admin] RBAC: Adding query filter params (name=member) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:40.742787 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933559b-d6c9-41ef-b7c6-59d30703e861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:40.743313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 169/330] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:40 2022] GET /identity/v3/users/885bfc38c00d4fb9965fc63261399b77 => generated 294 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:40.744796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933559b-d6c9-41ef-b7c6-59d30703e861 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:40.752086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ddaca-9082-4b47-bef9-8c86bac970f4 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:40.762430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 162/331] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:40 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:40.768364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933559b-d6c9-41ef-b7c6-59d30703e861 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:40.801437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:40.841288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:40.891634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ddaca-9082-4b47-bef9-8c86bac970f4 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:40.896948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933559b-d6c9-41ef-b7c6-59d30703e861 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:40.931806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaae3ce-2933-4564-9ee5-091f1ff62d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:40.932773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae3ce-2933-4564-9ee5-091f1ff62d0c None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:40.933158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae3ce-2933-4564-9ee5-091f1ff62d0c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:40.933539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae3ce-2933-4564-9ee5-091f1ff62d0c None admin] PATH_INFO: `/v3/system/users/885bfc38c00d4fb9965fc63261399b77/roles/1aeb3352b3fb4ab79fd7171fec026530` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:40.935453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaae3ce-2933-4564-9ee5-091f1ff62d0c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=885bfc38c00d4fb9965fc63261399b77, role_id=1aeb3352b3fb4ab79fd7171fec026530)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:40.936806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaae3ce-2933-4564-9ee5-091f1ff62d0c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:40.941215 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7304c4-f03e-419f-83b4-b50d85ee32fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:40.942134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7304c4-f03e-419f-83b4-b50d85ee32fd None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:40.942555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7304c4-f03e-419f-83b4-b50d85ee32fd None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:40.942992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7304c4-f03e-419f-83b4-b50d85ee32fd None admin] PATH_INFO: `/v3/users/60a23f656b34448caf8718c86de1a2cd` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:40.944430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7304c4-f03e-419f-83b4-b50d85ee32fd None admin] RBAC: Authorizing `identity:get_user(user_id=60a23f656b34448caf8718c86de1a2cd)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:40.946613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7304c4-f03e-419f-83b4-b50d85ee32fd None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:40.948544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 163/332] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:40 2022] GET /identity/v3/users/60a23f656b34448caf8718c86de1a2cd => generated 294 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:40.952242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 170/333] 10.222.0.124 () {58 vars in 1339 bytes} [Mon Aug 1 16:38:40 2022] PUT /identity/v3/system/users/885bfc38c00d4fb9965fc63261399b77/roles/1aeb3352b3fb4ab79fd7171fec026530 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:40.954780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaae3ce-2933-4564-9ee5-091f1ff62d0c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:41.078106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaae3ce-2933-4564-9ee5-091f1ff62d0c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:41.079849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:41.118606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f4bb9-edc5-46c8-9f46-46ac5e21db2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:41.119297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f4bb9-edc5-46c8-9f46-46ac5e21db2c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:41.119582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f4bb9-edc5-46c8-9f46-46ac5e21db2c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:41.119859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f4bb9-edc5-46c8-9f46-46ac5e21db2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:41.120694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f4bb9-edc5-46c8-9f46-46ac5e21db2c None admin] RBAC: Adding query filter params (role.id=a1ce48deeb3148e28049f10600de5fbe, user.id=60a23f656b34448caf8718c86de1a2cd, scope.system=all) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:41.121009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f4bb9-edc5-46c8-9f46-46ac5e21db2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:41.122501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f4bb9-edc5-46c8-9f46-46ac5e21db2c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:41.137262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 171/334] 10.222.0.124 () {56 vars in 1313 bytes} [Mon Aug 1 16:38:40 2022] GET /identity/v3/role_assignments?user.id=60a23f656b34448caf8718c86de1a2cd&scope.system=all&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 512 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:42.472052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b0a4-983a-4b66-ac7f-8f7a1e982769 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:42.473256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b0a4-983a-4b66-ac7f-8f7a1e982769 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:42.473743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b0a4-983a-4b66-ac7f-8f7a1e982769 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:42.475543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 164/335] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:42 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:42.481886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780187a-55b5-4260-998b-be23f4860054 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:42.482421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780187a-55b5-4260-998b-be23f4860054 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:42.482421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780187a-55b5-4260-998b-be23f4860054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:42.532093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-3780187a-55b5-4260-998b-be23f4860054 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:42.533350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3780187a-55b5-4260-998b-be23f4860054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:42.623066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 172/336] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:42.665004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9b0a4-983a-4b66-ac7f-8f7a1e982769 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:42.836041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9b0a4-983a-4b66-ac7f-8f7a1e982769 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:42.866465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:42.886515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d81379-5b98-4906-9017-8d5c1c9d44b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:42.887567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d81379-5b98-4906-9017-8d5c1c9d44b3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:42.888048 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d81379-5b98-4906-9017-8d5c1c9d44b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:42.888553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d81379-5b98-4906-9017-8d5c1c9d44b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:42.900369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d81379-5b98-4906-9017-8d5c1c9d44b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-66d81379-5b98-4906-9017-8d5c1c9d44b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:42.906341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:42.908915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:42.909697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:42.912368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 165/337] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:42.919158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780187a-55b5-4260-998b-be23f4860054 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:42.959266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13dcdc-57df-4a99-a1b3-7a43e27c0208 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:42.960020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13dcdc-57df-4a99-a1b3-7a43e27c0208 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:42.960523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13dcdc-57df-4a99-a1b3-7a43e27c0208 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:42.962132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 166/338] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:42.974253 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19b0c-2068-4639-b917-08ff11f93ab2 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:42.974849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19b0c-2068-4639-b917-08ff11f93ab2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:42.975379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19b0c-2068-4639-b917-08ff11f93ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:43.007985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e2e19b0c-2068-4639-b917-08ff11f93ab2 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:43.009565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e2e19b0c-2068-4639-b917-08ff11f93ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:43.105601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:43.131038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780187a-55b5-4260-998b-be23f4860054 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:43.189151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 167/339] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:43.227492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd4136-e12b-4c45-bd7b-ffc00e62d896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:43.228287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd4136-e12b-4c45-bd7b-ffc00e62d896 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:43.228579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd4136-e12b-4c45-bd7b-ffc00e62d896 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:43.228854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd4136-e12b-4c45-bd7b-ffc00e62d896 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:43.229114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e19b0c-2068-4639-b917-08ff11f93ab2 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:43.229605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd4136-e12b-4c45-bd7b-ffc00e62d896 None admin] RBAC: Adding query filter params (name=member) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:43.229913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd4136-e12b-4c45-bd7b-ffc00e62d896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:43.231376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd4136-e12b-4c45-bd7b-ffc00e62d896 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:43.241000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 173/340] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:42 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:43.247784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd4136-e12b-4c45-bd7b-ffc00e62d896 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:43.470972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e19b0c-2068-4639-b917-08ff11f93ab2 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:43.495320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:43.529169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd4136-e12b-4c45-bd7b-ffc00e62d896 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:43.571828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa353-3be9-4df1-a33d-2a714bba0eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:43.572518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa353-3be9-4df1-a33d-2a714bba0eb0 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:43.572793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa353-3be9-4df1-a33d-2a714bba0eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:43.573064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa353-3be9-4df1-a33d-2a714bba0eb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:43.615905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15ba9b-6d3b-4ced-a8bd-70ce1e02d1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:43.616305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaa353-3be9-4df1-a33d-2a714bba0eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:43.616615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ba9b-6d3b-4ced-a8bd-70ce1e02d1a5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:43.616908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ba9b-6d3b-4ced-a8bd-70ce1e02d1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:43.617190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ba9b-6d3b-4ced-a8bd-70ce1e02d1a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-9afaa353-3be9-4df1-a33d-2a714bba0eb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:43.621401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:43.622346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:43.623617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 168/341] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:43.633855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa353-3be9-4df1-a33d-2a714bba0eb0 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:43.652567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:43.757277 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15ba9b-6d3b-4ced-a8bd-70ce1e02d1a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:43.759671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15ba9b-6d3b-4ced-a8bd-70ce1e02d1a5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:43.918665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa353-3be9-4df1-a33d-2a714bba0eb0 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:43.941304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 174/342] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 16:38:43.942645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491232e-dd1f-4599-aad5-0931694739a3 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:43.942926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491232e-dd1f-4599-aad5-0931694739a3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:43.943222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491232e-dd1f-4599-aad5-0931694739a3 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:43.944606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 175/343] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:43.950199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86d153-cd68-4247-8e85-6f448fe5ea43 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:43.950487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86d153-cd68-4247-8e85-6f448fe5ea43 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:43.950756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86d153-cd68-4247-8e85-6f448fe5ea43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:43.985905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-aa86d153-cd68-4247-8e85-6f448fe5ea43 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:43.987177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-aa86d153-cd68-4247-8e85-6f448fe5ea43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:43.989344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d9997-f607-44f7-821b-d15210456abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:43.989981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9997-f607-44f7-821b-d15210456abd None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:43.990254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9997-f607-44f7-821b-d15210456abd None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:43.990523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9997-f607-44f7-821b-d15210456abd None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:43.991706 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d9997-f607-44f7-821b-d15210456abd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:43.992108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d9997-f607-44f7-821b-d15210456abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:43.993510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d9997-f607-44f7-821b-d15210456abd None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:44.014840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 169/344] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:43 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:44.015691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d9997-f607-44f7-821b-d15210456abd None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:44.062856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:44.065376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:44.087409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 176/345] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:44.088723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfaf57-ad66-4024-b49f-0b4ee673ffa0 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:44.089110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfaf57-ad66-4024-b49f-0b4ee673ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:44.089733 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfaf57-ad66-4024-b49f-0b4ee673ffa0 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:44.091260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 177/346] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:44.091975 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfaf57-ad66-4024-b49f-0b4ee673ffa0 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:44.144120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d9997-f607-44f7-821b-d15210456abd None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:44.181483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1373bb6-0622-46d8-b774-c8696deeb03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:44.182155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1373bb6-0622-46d8-b774-c8696deeb03c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:44.182436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1373bb6-0622-46d8-b774-c8696deeb03c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:44.182711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1373bb6-0622-46d8-b774-c8696deeb03c None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:44.183942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1373bb6-0622-46d8-b774-c8696deeb03c None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:44.185418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1373bb6-0622-46d8-b774-c8696deeb03c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:44.188363 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 170/347] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:44 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:44.189554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003e85-8d81-4b6f-9dcf-e213c2be5781 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:44.189840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003e85-8d81-4b6f-9dcf-e213c2be5781 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:44.190120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003e85-8d81-4b6f-9dcf-e213c2be5781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:44.210941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-75003e85-8d81-4b6f-9dcf-e213c2be5781 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:44.212220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-75003e85-8d81-4b6f-9dcf-e213c2be5781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:44.218509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfaf57-ad66-4024-b49f-0b4ee673ffa0 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:44.258362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d086f-6761-4c46-8017-5d9e01a955cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:44.259024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d086f-6761-4c46-8017-5d9e01a955cb None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:44.259301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d086f-6761-4c46-8017-5d9e01a955cb None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:44.259571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d086f-6761-4c46-8017-5d9e01a955cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:44.292662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 171/348] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:44.293507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75003e85-8d81-4b6f-9dcf-e213c2be5781 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:44.317297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:44.325443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:44.350054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d086f-6761-4c46-8017-5d9e01a955cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:44.352637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d086f-6761-4c46-8017-5d9e01a955cb None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:44.424696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75003e85-8d81-4b6f-9dcf-e213c2be5781 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:44.470936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5560450-dda6-4148-a410-1fe59aab7e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:44.471689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560450-dda6-4148-a410-1fe59aab7e4e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:44.471970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560450-dda6-4148-a410-1fe59aab7e4e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:44.472250 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560450-dda6-4148-a410-1fe59aab7e4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:44.485861 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5560450-dda6-4148-a410-1fe59aab7e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-b5560450-dda6-4148-a410-1fe59aab7e4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:44.491104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:44.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 172/349] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:44.493717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5560450-dda6-4148-a410-1fe59aab7e4e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:44.496464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 178/350] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:44 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:44.496691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d086f-6761-4c46-8017-5d9e01a955cb None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:44.619248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:44.636427 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:44.649524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5560450-dda6-4148-a410-1fe59aab7e4e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:44.650028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d086f-6761-4c46-8017-5d9e01a955cb None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:44.697354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ae4d-7dda-4a55-b2a9-51ecd3b8f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:44.698642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ae4d-7dda-4a55-b2a9-51ecd3b8f622 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:44.699871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ae4d-7dda-4a55-b2a9-51ecd3b8f622 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:44.699871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ae4d-7dda-4a55-b2a9-51ecd3b8f622 None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:44.704669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53daa1-aa96-44ba-b088-d7c03dc95b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:44.705656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53daa1-aa96-44ba-b088-d7c03dc95b1c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:44.706255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53daa1-aa96-44ba-b088-d7c03dc95b1c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:44.706725 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53daa1-aa96-44ba-b088-d7c03dc95b1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:44.706834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000ae4d-7dda-4a55-b2a9-51ecd3b8f622 None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:44.708509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000ae4d-7dda-4a55-b2a9-51ecd3b8f622 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:44.716223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 173/351] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:44 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:44.716223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ae4d-7dda-4a55-b2a9-51ecd3b8f622 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:44.727911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53daa1-aa96-44ba-b088-d7c03dc95b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-9e53daa1-aa96-44ba-b088-d7c03dc95b1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:44.734483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:44.735460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:44.736236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:44.738120 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 179/352] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:44.741322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53daa1-aa96-44ba-b088-d7c03dc95b1c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:44.871306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ae4d-7dda-4a55-b2a9-51ecd3b8f622 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:44.890144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53daa1-aa96-44ba-b088-d7c03dc95b1c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:44.911648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9624d-28a3-4381-924a-e560e98c232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:44.912344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9624d-28a3-4381-924a-e560e98c232c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:44.912625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9624d-28a3-4381-924a-e560e98c232c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:44.912959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9624d-28a3-4381-924a-e560e98c232c None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:44.914274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9624d-28a3-4381-924a-e560e98c232c None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:44.915803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9624d-28a3-4381-924a-e560e98c232c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:44.917733 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 174/353] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:44 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:44.919455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411732-8b60-42ae-9dfe-e8490224c1c1 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:44.919455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411732-8b60-42ae-9dfe-e8490224c1c1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:44.919455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411732-8b60-42ae-9dfe-e8490224c1c1 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:44.920663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 175/354] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:44.921372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411732-8b60-42ae-9dfe-e8490224c1c1 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:44.950066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ea7ea-176f-45bb-b2a2-164052c5713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:44.950709 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ea7ea-176f-45bb-b2a2-164052c5713e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:44.951042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ea7ea-176f-45bb-b2a2-164052c5713e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:44.951923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ea7ea-176f-45bb-b2a2-164052c5713e None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:44.952809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ea7ea-176f-45bb-b2a2-164052c5713e None admin] RBAC: Adding query filter params (name=reader) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:44.953245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ea7ea-176f-45bb-b2a2-164052c5713e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:44.955127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:44.955235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ea7ea-176f-45bb-b2a2-164052c5713e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:44.969539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 180/355] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:44 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:44.970426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ea7ea-176f-45bb-b2a2-164052c5713e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:44.978972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:45.072438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411732-8b60-42ae-9dfe-e8490224c1c1 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:45.119645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad294e1-5158-4538-8e27-3604bb68e446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:45.121381 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad294e1-5158-4538-8e27-3604bb68e446 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:45.121381 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad294e1-5158-4538-8e27-3604bb68e446 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:45.121381 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad294e1-5158-4538-8e27-3604bb68e446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:45.121619 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad294e1-5158-4538-8e27-3604bb68e446 None admin] RBAC: Adding query filter params (group.id=61c6ff75bbff426fb147e233ab6c581f, role.id=a1ce48deeb3148e28049f10600de5fbe, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:45.121942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad294e1-5158-4538-8e27-3604bb68e446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:45.123460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad294e1-5158-4538-8e27-3604bb68e446 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:45.128491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ea7ea-176f-45bb-b2a2-164052c5713e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:45.135477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 176/356] 10.222.0.124 () {56 vars in 1381 bytes} [Mon Aug 1 16:38:44 2022] GET /identity/v3/role_assignments?group.id=61c6ff75bbff426fb147e233ab6c581f&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 261 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:45.136814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad294e1-5158-4538-8e27-3604bb68e446 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:45.183566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae65d0-bd05-4340-aa5f-57ebab02f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:45.184776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae65d0-bd05-4340-aa5f-57ebab02f0bc None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:45.185251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae65d0-bd05-4340-aa5f-57ebab02f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:45.185852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae65d0-bd05-4340-aa5f-57ebab02f0bc None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:45.187367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae65d0-bd05-4340-aa5f-57ebab02f0bc None admin] RBAC: Adding query filter params (name=member) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:45.187911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae65d0-bd05-4340-aa5f-57ebab02f0bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:45.189670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae65d0-bd05-4340-aa5f-57ebab02f0bc None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:45.206475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 181/357] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:44 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:45.208478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66062-c514-453c-9e73-f923a8a5da25 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:45.209069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66062-c514-453c-9e73-f923a8a5da25 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:45.209749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66062-c514-453c-9e73-f923a8a5da25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:45.234615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-17a66062-c514-453c-9e73-f923a8a5da25 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:45.234615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-17a66062-c514-453c-9e73-f923a8a5da25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:45.287647 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:45.301648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad294e1-5158-4538-8e27-3604bb68e446 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:45.312107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:45.330996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 182/358] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:45.330996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a66062-c514-453c-9e73-f923a8a5da25 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:45.358912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a48a22-ea1c-48fa-b259-190561db1ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:45.359611 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a48a22-ea1c-48fa-b259-190561db1ba5 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:45.359893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a48a22-ea1c-48fa-b259-190561db1ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:45.360167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a48a22-ea1c-48fa-b259-190561db1ba5 None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:45.361360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a48a22-ea1c-48fa-b259-190561db1ba5 None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:45.362817 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a48a22-ea1c-48fa-b259-190561db1ba5 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:45.364814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 177/359] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:45 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:45.366759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f2d0-c3fc-40f0-9b0b-39793a49b547 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:45.366759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f2d0-c3fc-40f0-9b0b-39793a49b547 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:45.367121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f2d0-c3fc-40f0-9b0b-39793a49b547 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:45.376557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 178/360] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:45 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:45.376557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0f2d0-c3fc-40f0-9b0b-39793a49b547 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:45.486071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a66062-c514-453c-9e73-f923a8a5da25 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:45.528133 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b889f4-2c71-4f05-97e1-13c330f8743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:45.528374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0f2d0-c3fc-40f0-9b0b-39793a49b547 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:45.529349 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b889f4-2c71-4f05-97e1-13c330f8743b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:45.529636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b889f4-2c71-4f05-97e1-13c330f8743b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:45.529982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b889f4-2c71-4f05-97e1-13c330f8743b None admin] PATH_INFO: `/v3/users/885bfc38c00d4fb9965fc63261399b77` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:45.534003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b889f4-2c71-4f05-97e1-13c330f8743b None admin] RBAC: Authorizing `identity:get_user(user_id=885bfc38c00d4fb9965fc63261399b77)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:45.534366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b889f4-2c71-4f05-97e1-13c330f8743b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:45.541449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 183/361] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:38:45 2022] GET /identity/v3/users/885bfc38c00d4fb9965fc63261399b77 => generated 294 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:45.542457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b889f4-2c71-4f05-97e1-13c330f8743b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:45.577521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b4cf7-d96d-4c4c-96ce-cd3eda8bf347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:45.578326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b4cf7-d96d-4c4c-96ce-cd3eda8bf347 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:45.578612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b4cf7-d96d-4c4c-96ce-cd3eda8bf347 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:45.578889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b4cf7-d96d-4c4c-96ce-cd3eda8bf347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:45.618728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:45.631352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:45.684952 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b4cf7-d96d-4c4c-96ce-cd3eda8bf347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:45.686709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b4cf7-d96d-4c4c-96ce-cd3eda8bf347 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:45.704021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b889f4-2c71-4f05-97e1-13c330f8743b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:45.758058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c938e-dc2c-4ceb-9ce0-a3dc3e9e4e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:45.758821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c938e-dc2c-4ceb-9ce0-a3dc3e9e4e1f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:45.759144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c938e-dc2c-4ceb-9ce0-a3dc3e9e4e1f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:45.759419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c938e-dc2c-4ceb-9ce0-a3dc3e9e4e1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:45.774766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c938e-dc2c-4ceb-9ce0-a3dc3e9e4e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-294c938e-dc2c-4ceb-9ce0-a3dc3e9e4e1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:45.781754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:45.782765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:45.783613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 184/362] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:45.784324 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c938e-dc2c-4ceb-9ce0-a3dc3e9e4e1f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:45.826843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 179/363] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:45.828537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78602ca6-4488-4259-a666-cf12091b0fac None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:45.828537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78602ca6-4488-4259-a666-cf12091b0fac None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:45.828937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78602ca6-4488-4259-a666-cf12091b0fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:45.850662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-78602ca6-4488-4259-a666-cf12091b0fac None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:45.852583 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-78602ca6-4488-4259-a666-cf12091b0fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:45.913935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c938e-dc2c-4ceb-9ce0-a3dc3e9e4e1f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:45.925980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:45.947175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:45.954872 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 180/364] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:45.955613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78602ca6-4488-4259-a666-cf12091b0fac None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:45.962868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926ef8f-53d8-4fb4-bc44-619d9c7066b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:45.963900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926ef8f-53d8-4fb4-bc44-619d9c7066b3 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:45.964740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926ef8f-53d8-4fb4-bc44-619d9c7066b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:45.965218 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926ef8f-53d8-4fb4-bc44-619d9c7066b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:45.966227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926ef8f-53d8-4fb4-bc44-619d9c7066b3 None admin] RBAC: Adding query filter params (group.id=61c6ff75bbff426fb147e233ab6c581f, role.id=1f3d7dea677f4b82a9728c6f9083d706, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:45.966751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926ef8f-53d8-4fb4-bc44-619d9c7066b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:45.968526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926ef8f-53d8-4fb4-bc44-619d9c7066b3 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:45.976612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 185/365] 10.222.0.124 () {56 vars in 1381 bytes} [Mon Aug 1 16:38:45 2022] GET /identity/v3/role_assignments?group.id=61c6ff75bbff426fb147e233ab6c581f&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=1f3d7dea677f4b82a9728c6f9083d706 => generated 261 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:45.977961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926ef8f-53d8-4fb4-bc44-619d9c7066b3 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:46.104393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78602ca6-4488-4259-a666-cf12091b0fac None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:46.115786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926ef8f-53d8-4fb4-bc44-619d9c7066b3 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:46.154576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d307125-3d4c-466e-b50d-316fab4bab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:46.155285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d307125-3d4c-466e-b50d-316fab4bab2f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:46.155569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d307125-3d4c-466e-b50d-316fab4bab2f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:46.155848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d307125-3d4c-466e-b50d-316fab4bab2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:46.156731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d307125-3d4c-466e-b50d-316fab4bab2f None admin] RBAC: Adding query filter params (role.id=1aeb3352b3fb4ab79fd7171fec026530, user.id=885bfc38c00d4fb9965fc63261399b77, scope.system=all) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:46.157057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d307125-3d4c-466e-b50d-316fab4bab2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:46.158774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d307125-3d4c-466e-b50d-316fab4bab2f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:46.159510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a61b6-635f-48fa-b6cb-9df2bf485b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:46.160424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a61b6-635f-48fa-b6cb-9df2bf485b3a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:46.160947 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a61b6-635f-48fa-b6cb-9df2bf485b3a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:46.161414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a61b6-635f-48fa-b6cb-9df2bf485b3a None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:46.162376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a61b6-635f-48fa-b6cb-9df2bf485b3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:46.162969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a61b6-635f-48fa-b6cb-9df2bf485b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:46.164715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a61b6-635f-48fa-b6cb-9df2bf485b3a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:46.175975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 181/366] 10.222.0.124 () {56 vars in 1313 bytes} [Mon Aug 1 16:38:45 2022] GET /identity/v3/role_assignments?user.id=885bfc38c00d4fb9965fc63261399b77&scope.system=all&role.id=1aeb3352b3fb4ab79fd7171fec026530 => generated 512 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:46.176961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d307125-3d4c-466e-b50d-316fab4bab2f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:46.177955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 186/367] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:45 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:46.179726 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a61b6-635f-48fa-b6cb-9df2bf485b3a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:46.243643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:46.249377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:46.311065 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a61b6-635f-48fa-b6cb-9df2bf485b3a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:46.352446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd714a-5181-4d99-9356-372a8f0b7f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:46.353635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd714a-5181-4d99-9356-372a8f0b7f0f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:46.354128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd714a-5181-4d99-9356-372a8f0b7f0f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:46.354635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd714a-5181-4d99-9356-372a8f0b7f0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:46.369195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd714a-5181-4d99-9356-372a8f0b7f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:46.374029 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d307125-3d4c-466e-b50d-316fab4bab2f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-40dd714a-5181-4d99-9356-372a8f0b7f0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:46.376036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:46.376910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:46.377700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:46.380951 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 187/368] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:38:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:46.382623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd714a-5181-4d99-9356-372a8f0b7f0f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:46.443608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd741ff-719b-41b1-b338-3b8911924986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:46.444268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd741ff-719b-41b1-b338-3b8911924986 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:46.444558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd741ff-719b-41b1-b338-3b8911924986 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:46.444834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd741ff-719b-41b1-b338-3b8911924986 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:46.447258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd741ff-719b-41b1-b338-3b8911924986 None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:46.449884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd741ff-719b-41b1-b338-3b8911924986 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:46.451805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 182/369] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:46 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:46.452623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd741ff-719b-41b1-b338-3b8911924986 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:46.554773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd714a-5181-4d99-9356-372a8f0b7f0f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:46.567639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:46.599614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd209cc-13ec-4c0e-96b2-516382f9fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:46.600326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd209cc-13ec-4c0e-96b2-516382f9fe6c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:46.600614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd209cc-13ec-4c0e-96b2-516382f9fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:46.600892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd209cc-13ec-4c0e-96b2-516382f9fe6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:46.611979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd741ff-719b-41b1-b338-3b8911924986 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:46.629679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:46.655476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49270303-e9ce-4d4d-adca-8c3485886a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:46.657086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49270303-e9ce-4d4d-adca-8c3485886a38 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:46.657704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49270303-e9ce-4d4d-adca-8c3485886a38 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:46.658184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49270303-e9ce-4d4d-adca-8c3485886a38 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:46.659185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49270303-e9ce-4d4d-adca-8c3485886a38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:46.659762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49270303-e9ce-4d4d-adca-8c3485886a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:46.661452 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49270303-e9ce-4d4d-adca-8c3485886a38 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:46.679370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 183/370] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:46 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:46.680646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49270303-e9ce-4d4d-adca-8c3485886a38 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:46.696123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd209cc-13ec-4c0e-96b2-516382f9fe6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:46.697730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd209cc-13ec-4c0e-96b2-516382f9fe6c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:46.795650 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49270303-e9ce-4d4d-adca-8c3485886a38 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:46.811467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 188/371] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:46.812746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd209cc-13ec-4c0e-96b2-516382f9fe6c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:46.835622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e17ec8-3a9e-4796-b2c9-2768d70441fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:46.836708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17ec8-3a9e-4796-b2c9-2768d70441fc None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:46.837191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17ec8-3a9e-4796-b2c9-2768d70441fc None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:46.837678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17ec8-3a9e-4796-b2c9-2768d70441fc None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:46.839605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e17ec8-3a9e-4796-b2c9-2768d70441fc None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:46.841840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e17ec8-3a9e-4796-b2c9-2768d70441fc None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:46.843826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 184/372] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:46 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:46.844819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e17ec8-3a9e-4796-b2c9-2768d70441fc None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:46.867387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:46.895095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:46.959907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd209cc-13ec-4c0e-96b2-516382f9fe6c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:46.960259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e17ec8-3a9e-4796-b2c9-2768d70441fc None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:47.004280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338785-d2f2-41ae-97b5-b80b72d85f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:47.005280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338785-d2f2-41ae-97b5-b80b72d85f30 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:47.005786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338785-d2f2-41ae-97b5-b80b72d85f30 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:47.006258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338785-d2f2-41ae-97b5-b80b72d85f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:47.006642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4d4c0-d16a-48b0-95af-17b088c36906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:47.007389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4d4c0-d16a-48b0-95af-17b088c36906 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:47.007659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4d4c0-d16a-48b0-95af-17b088c36906 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:47.007933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4d4c0-d16a-48b0-95af-17b088c36906 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:47.009175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4d4c0-d16a-48b0-95af-17b088c36906 None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:47.010715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4d4c0-d16a-48b0-95af-17b088c36906 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:47.017425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 185/373] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:46 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:47.017425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4d4c0-d16a-48b0-95af-17b088c36906 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:47.129303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed338785-d2f2-41ae-97b5-b80b72d85f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:47.131113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed338785-d2f2-41ae-97b5-b80b72d85f30 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:47.144502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:47.173555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4d4c0-d16a-48b0-95af-17b088c36906 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:47.185941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:47.229065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418d335-e57b-49a0-b90a-cd66bfdc75f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:47.229631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418d335-e57b-49a0-b90a-cd66bfdc75f4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:47.229912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418d335-e57b-49a0-b90a-cd66bfdc75f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:47.230188 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418d335-e57b-49a0-b90a-cd66bfdc75f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:47.231849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418d335-e57b-49a0-b90a-cd66bfdc75f4 None admin] RBAC: Adding query filter params (group.id=61c6ff75bbff426fb147e233ab6c581f, role.id=a1ce48deeb3148e28049f10600de5fbe, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:47.232185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418d335-e57b-49a0-b90a-cd66bfdc75f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:47.233683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418d335-e57b-49a0-b90a-cd66bfdc75f4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:47.246115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 186/374] 10.222.0.124 () {56 vars in 1381 bytes} [Mon Aug 1 16:38:47 2022] GET /identity/v3/role_assignments?group.id=61c6ff75bbff426fb147e233ab6c581f&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 261 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:47.247127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418d335-e57b-49a0-b90a-cd66bfdc75f4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:47.265092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 189/375] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:47.271262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338785-d2f2-41ae-97b5-b80b72d85f30 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:47.395776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418d335-e57b-49a0-b90a-cd66bfdc75f4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:47.489465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3be1a9-ea29-4f4e-837f-85238e945f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:47.490122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be1a9-ea29-4f4e-837f-85238e945f88 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:47.490372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be1a9-ea29-4f4e-837f-85238e945f88 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:47.490648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be1a9-ea29-4f4e-837f-85238e945f88 None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:47.493423 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3be1a9-ea29-4f4e-837f-85238e945f88 None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:47.494938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3be1a9-ea29-4f4e-837f-85238e945f88 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:47.502578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338785-d2f2-41ae-97b5-b80b72d85f30 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:47.504729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 187/376] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:47 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:47.505843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3be1a9-ea29-4f4e-837f-85238e945f88 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:47.527408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:47.580641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ca9e-e736-4bb1-90fd-517ac77514f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:47.581061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ca9e-e736-4bb1-90fd-517ac77514f0 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:47.581345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ca9e-e736-4bb1-90fd-517ac77514f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:47.582280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ca9e-e736-4bb1-90fd-517ac77514f0 None admin] PATH_INFO: `/v3/projects/587d85cd8aa24181b672e7ee967eed1e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:47.585550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5ca9e-e736-4bb1-90fd-517ac77514f0 None admin] RBAC: Authorizing `identity:get_project(project_id=587d85cd8aa24181b672e7ee967eed1e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:47.587399 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5ca9e-e736-4bb1-90fd-517ac77514f0 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:47.590837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 190/377] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:47 2022] GET /identity/v3/projects/587d85cd8aa24181b672e7ee967eed1e => generated 345 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:47.593045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:47.597537 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ca9e-e736-4bb1-90fd-517ac77514f0 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:47.707108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3be1a9-ea29-4f4e-837f-85238e945f88 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:47.756300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41ee9e-425d-49ad-88d6-f47401ef0b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:47.756919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ee9e-425d-49ad-88d6-f47401ef0b8e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:47.757199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ee9e-425d-49ad-88d6-f47401ef0b8e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:47.757474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ee9e-425d-49ad-88d6-f47401ef0b8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:47.759123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41ee9e-425d-49ad-88d6-f47401ef0b8e None admin] RBAC: Adding query filter params (group.id=61c6ff75bbff426fb147e233ab6c581f, role.id=1f3d7dea677f4b82a9728c6f9083d706, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:47.759123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41ee9e-425d-49ad-88d6-f47401ef0b8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:47.760118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41ee9e-425d-49ad-88d6-f47401ef0b8e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:47.766813 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 188/378] 10.222.0.124 () {56 vars in 1381 bytes} [Mon Aug 1 16:38:47 2022] GET /identity/v3/role_assignments?group.id=61c6ff75bbff426fb147e233ab6c581f&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=1f3d7dea677f4b82a9728c6f9083d706 => generated 261 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:47.768368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6011d-cc35-41fe-8af3-b4c0ec4b6364 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:47.768663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6011d-cc35-41fe-8af3-b4c0ec4b6364 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:47.768933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6011d-cc35-41fe-8af3-b4c0ec4b6364 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:47.770542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 189/379] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:47.772291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ca9e-e736-4bb1-90fd-517ac77514f0 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:47.777291 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7a38d-7b58-4634-aac3-ee6a7ac18fcc None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:47.777632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7a38d-7b58-4634-aac3-ee6a7ac18fcc None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:47.777836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7a38d-7b58-4634-aac3-ee6a7ac18fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:47.807263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-99b7a38d-7b58-4634-aac3-ee6a7ac18fcc None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:47.808491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-99b7a38d-7b58-4634-aac3-ee6a7ac18fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:47.842878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b5ecb-07c5-4ba6-8237-7afc8ea82125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:47.843950 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b5ecb-07c5-4ba6-8237-7afc8ea82125 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:47.844459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b5ecb-07c5-4ba6-8237-7afc8ea82125 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:47.845033 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b5ecb-07c5-4ba6-8237-7afc8ea82125 None admin] PATH_INFO: `/v3/groups/369b1d7be84f462cb6a003bd40701b74` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:47.861438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b5ecb-07c5-4ba6-8237-7afc8ea82125 None admin] RBAC: Authorizing `identity:get_group(group_id=369b1d7be84f462cb6a003bd40701b74)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:47.863041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b5ecb-07c5-4ba6-8237-7afc8ea82125 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:47.865411 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 191/380] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:47 2022] GET /identity/v3/groups/369b1d7be84f462cb6a003bd40701b74 => generated 230 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:47.871614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b5ecb-07c5-4ba6-8237-7afc8ea82125 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:47.900657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 190/381] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:47.928661 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7a38d-7b58-4634-aac3-ee6a7ac18fcc None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:47.948279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:48.005228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:48.063081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b5ecb-07c5-4ba6-8237-7afc8ea82125 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:48.097747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7a38d-7b58-4634-aac3-ee6a7ac18fcc None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:48.103625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd8e45-9bec-41c4-971b-c16b1e726e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:48.104280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd8e45-9bec-41c4-971b-c16b1e726e48 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:48.104562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd8e45-9bec-41c4-971b-c16b1e726e48 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:48.104836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd8e45-9bec-41c4-971b-c16b1e726e48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:48.105826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd8e45-9bec-41c4-971b-c16b1e726e48 None admin] RBAC: Adding query filter params (group.id=369b1d7be84f462cb6a003bd40701b74, role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=587d85cd8aa24181b672e7ee967eed1e) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:48.106141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd8e45-9bec-41c4-971b-c16b1e726e48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:48.107778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd8e45-9bec-41c4-971b-c16b1e726e48 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:48.115010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 192/382] 10.222.0.124 () {56 vars in 1381 bytes} [Mon Aug 1 16:38:47 2022] GET /identity/v3/role_assignments?group.id=369b1d7be84f462cb6a003bd40701b74&scope.project.id=587d85cd8aa24181b672e7ee967eed1e&role.id=390e487a45f74246ba84773e8760bc7c => generated 261 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:48.142466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579e406-215e-42ee-a634-1a9e962bcc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:48.143134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e406-215e-42ee-a634-1a9e962bcc1e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:48.143564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e406-215e-42ee-a634-1a9e962bcc1e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:48.143708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e406-215e-42ee-a634-1a9e962bcc1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:48.157435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579e406-215e-42ee-a634-1a9e962bcc1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-f579e406-215e-42ee-a634-1a9e962bcc1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:48.162668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:48.163728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:48.164502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:48.170077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd8e45-9bec-41c4-971b-c16b1e726e48 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:48.170461 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 191/383] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:48.303912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd8e45-9bec-41c4-971b-c16b1e726e48 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:48.306921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:48.345856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf0ae9-23e2-4df0-b4b1-663cd98bf389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:48.346423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf0ae9-23e2-4df0-b4b1-663cd98bf389 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:48.346704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf0ae9-23e2-4df0-b4b1-663cd98bf389 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:48.347012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf0ae9-23e2-4df0-b4b1-663cd98bf389 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:48.347764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf0ae9-23e2-4df0-b4b1-663cd98bf389 None admin] RBAC: Adding query filter params (name=member) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:48.348087 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf0ae9-23e2-4df0-b4b1-663cd98bf389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:48.349613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf0ae9-23e2-4df0-b4b1-663cd98bf389 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:48.360030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 193/384] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:48 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:48.365310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579e406-215e-42ee-a634-1a9e962bcc1e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:48.516077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:48.523066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579e406-215e-42ee-a634-1a9e962bcc1e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:48.565264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfbc23-5c23-464e-a410-d17fcbe3595f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:48.565941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfbc23-5c23-464e-a410-d17fcbe3595f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:48.566221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfbc23-5c23-464e-a410-d17fcbe3595f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:48.566506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfbc23-5c23-464e-a410-d17fcbe3595f None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:48.567964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfbc23-5c23-464e-a410-d17fcbe3595f None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:48.569553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfbc23-5c23-464e-a410-d17fcbe3595f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:48.571885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 192/385] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:48 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:48.580077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf0ae9-23e2-4df0-b4b1-663cd98bf389 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:48.697387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf0ae9-23e2-4df0-b4b1-663cd98bf389 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:48.736153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31c90e-c505-4bc5-b152-17a6c0b669e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:48.736824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31c90e-c505-4bc5-b152-17a6c0b669e9 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:48.737108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31c90e-c505-4bc5-b152-17a6c0b669e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:48.737386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31c90e-c505-4bc5-b152-17a6c0b669e9 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:48.738612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31c90e-c505-4bc5-b152-17a6c0b669e9 None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:48.740126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31c90e-c505-4bc5-b152-17a6c0b669e9 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:48.742745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 194/386] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:48 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:48.748407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfbc23-5c23-464e-a410-d17fcbe3595f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:48.877861 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfbc23-5c23-464e-a410-d17fcbe3595f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:48.887587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda1f3f-16e1-4f5d-95ad-224918068083 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:48.888149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda1f3f-16e1-4f5d-95ad-224918068083 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:48.888149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda1f3f-16e1-4f5d-95ad-224918068083 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:48.890900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 195/387] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:48.897592 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40783d-48ee-41e4-bd8b-af5ac71476a9 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:48.898574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40783d-48ee-41e4-bd8b-af5ac71476a9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:48.899423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40783d-48ee-41e4-bd8b-af5ac71476a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:48.934979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a9ed9-3263-44c1-bc1b-cc83f0a3826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:48.934979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a9ed9-3263-44c1-bc1b-cc83f0a3826a None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:48.934979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a9ed9-3263-44c1-bc1b-cc83f0a3826a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:48.934979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a9ed9-3263-44c1-bc1b-cc83f0a3826a None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/groups/61c6ff75bbff426fb147e233ab6c581f/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:48.936262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a9ed9-3263-44c1-bc1b-cc83f0a3826a None admin] RBAC: Authorizing `identity:create_grant(project_id=32937f53ee28435c9dcbea8b3d17dd15, group_id=61c6ff75bbff426fb147e233ab6c581f, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:48.938127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a9ed9-3263-44c1-bc1b-cc83f0a3826a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:48.947076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-6c40783d-48ee-41e4-bd8b-af5ac71476a9 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:48.948748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6c40783d-48ee-41e4-bd8b-af5ac71476a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:48.965526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 193/388] 10.222.0.124 () {58 vars in 1447 bytes} [Mon Aug 1 16:38:48 2022] PUT /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/groups/61c6ff75bbff426fb147e233ab6c581f/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:49.015466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:49.039380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 196/389] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:49.073748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a9ed9-3263-44c1-bc1b-cc83f0a3826a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:49.109518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:49.230467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a9ed9-3263-44c1-bc1b-cc83f0a3826a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:49.288812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27609669-91bf-4e11-bef4-23acbcb93728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:49.289578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27609669-91bf-4e11-bef4-23acbcb93728 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:49.289869 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27609669-91bf-4e11-bef4-23acbcb93728 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:49.290154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27609669-91bf-4e11-bef4-23acbcb93728 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:49.312634 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27609669-91bf-4e11-bef4-23acbcb93728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-27609669-91bf-4e11-bef4-23acbcb93728 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:49.317933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:49.318996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:49.319782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:49.320368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 194/390] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:49.328057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40783d-48ee-41e4-bd8b-af5ac71476a9 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:49.458913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40783d-48ee-41e4-bd8b-af5ac71476a9 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:49.514996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b8c79-f219-45d1-9b00-b90d6b4af79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:49.514996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8c79-f219-45d1-9b00-b90d6b4af79c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:49.514996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8c79-f219-45d1-9b00-b90d6b4af79c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:49.514996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8c79-f219-45d1-9b00-b90d6b4af79c None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:49.515420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b8c79-f219-45d1-9b00-b90d6b4af79c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:49.515420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b8c79-f219-45d1-9b00-b90d6b4af79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:49.515420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b8c79-f219-45d1-9b00-b90d6b4af79c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:49.529077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 197/391] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:49 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:49.540134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27609669-91bf-4e11-bef4-23acbcb93728 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:49.715254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:49.738426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27609669-91bf-4e11-bef4-23acbcb93728 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:49.787176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054653b6-adc4-479c-a307-083c4935c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:49.787857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054653b6-adc4-479c-a307-083c4935c2ce None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:49.788337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054653b6-adc4-479c-a307-083c4935c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:49.788829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054653b6-adc4-479c-a307-083c4935c2ce None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:49.795905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054653b6-adc4-479c-a307-083c4935c2ce None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:49.797430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054653b6-adc4-479c-a307-083c4935c2ce None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:49.799589 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 195/392] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:49 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:49.805164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b8c79-f219-45d1-9b00-b90d6b4af79c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:49.851250 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:49.954478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b8c79-f219-45d1-9b00-b90d6b4af79c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:50.002825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6cc96-b544-4086-a8b0-9d8c92bb3f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:50.003523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6cc96-b544-4086-a8b0-9d8c92bb3f09 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:50.003811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6cc96-b544-4086-a8b0-9d8c92bb3f09 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:50.004087 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6cc96-b544-4086-a8b0-9d8c92bb3f09 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:50.005409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6cc96-b544-4086-a8b0-9d8c92bb3f09 None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:50.006921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6cc96-b544-4086-a8b0-9d8c92bb3f09 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:50.009674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 198/393] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:49 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:50.015075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054653b6-adc4-479c-a307-083c4935c2ce None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:50.096053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3e4d-00b0-45a0-ae72-3e8fa10f71e3 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:50.096229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3e4d-00b0-45a0-ae72-3e8fa10f71e3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:50.096505 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3e4d-00b0-45a0-ae72-3e8fa10f71e3 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:50.098106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 199/394] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:38:50.104524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bccbb-9ca6-4470-ba41-df10926ce13a None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:50.104857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bccbb-9ca6-4470-ba41-df10926ce13a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:50.105084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bccbb-9ca6-4470-ba41-df10926ce13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:50.140129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-775bccbb-9ca6-4470-ba41-df10926ce13a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:50.141372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-775bccbb-9ca6-4470-ba41-df10926ce13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:50.164598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054653b6-adc4-479c-a307-083c4935c2ce None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:50.217367 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a066cc-0296-46ab-9fb9-20adf7e37b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:50.218070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a066cc-0296-46ab-9fb9-20adf7e37b9a None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:50.218359 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a066cc-0296-46ab-9fb9-20adf7e37b9a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:50.218642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a066cc-0296-46ab-9fb9-20adf7e37b9a None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/groups/61c6ff75bbff426fb147e233ab6c581f/roles/1f3d7dea677f4b82a9728c6f9083d706` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:50.221036 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a066cc-0296-46ab-9fb9-20adf7e37b9a None admin] RBAC: Authorizing `identity:create_grant(project_id=32937f53ee28435c9dcbea8b3d17dd15, group_id=61c6ff75bbff426fb147e233ab6c581f, role_id=1f3d7dea677f4b82a9728c6f9083d706)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:50.222531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a066cc-0296-46ab-9fb9-20adf7e37b9a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:50.243320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 196/395] 10.222.0.124 () {58 vars in 1447 bytes} [Mon Aug 1 16:38:50 2022] PUT /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15/groups/61c6ff75bbff426fb147e233ab6c581f/roles/1f3d7dea677f4b82a9728c6f9083d706 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:50.264746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 200/396] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:50.302176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a066cc-0296-46ab-9fb9-20adf7e37b9a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:50.326707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:50.429870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24f212-39e6-4d84-9674-8e3820a2a14a None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:50.430051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24f212-39e6-4d84-9674-8e3820a2a14a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:50.430266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24f212-39e6-4d84-9674-8e3820a2a14a None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:50.432743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 201/397] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:38:50.437400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c769a-188d-499d-b01a-d075f560f4ee None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:50.437989 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c769a-188d-499d-b01a-d075f560f4ee None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:50.438461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c769a-188d-499d-b01a-d075f560f4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:50.461536 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-d15c769a-188d-499d-b01a-d075f560f4ee None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:50.464455 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d15c769a-188d-499d-b01a-d075f560f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:50.466358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a066cc-0296-46ab-9fb9-20adf7e37b9a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:50.488837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:50.521601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6541e-2db0-4f41-9b9e-8e596219543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:50.523162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6541e-2db0-4f41-9b9e-8e596219543d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:50.523667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6541e-2db0-4f41-9b9e-8e596219543d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:50.524181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6541e-2db0-4f41-9b9e-8e596219543d None admin] PATH_INFO: `/v3/roles/member` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:50.537088 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6541e-2db0-4f41-9b9e-8e596219543d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-08b6541e-2db0-4f41-9b9e-8e596219543d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:50.543889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:50.544814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:50.545610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:50.548444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 197/398] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:50.554578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6541e-2db0-4f41-9b9e-8e596219543d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:50.558026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 202/399] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:50.583606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c769a-188d-499d-b01a-d075f560f4ee None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:50.635322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:50.670015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6541e-2db0-4f41-9b9e-8e596219543d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:50.708413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c545c8-3362-46a4-8df1-b00d6c8b3c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:50.709577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c545c8-3362-46a4-8df1-b00d6c8b3c7a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:50.710161 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c545c8-3362-46a4-8df1-b00d6c8b3c7a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:50.710626 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c545c8-3362-46a4-8df1-b00d6c8b3c7a None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:50.711601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c545c8-3362-46a4-8df1-b00d6c8b3c7a None admin] RBAC: Adding query filter params (name=member) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:50.712156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c545c8-3362-46a4-8df1-b00d6c8b3c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:50.714270 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c545c8-3362-46a4-8df1-b00d6c8b3c7a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:50.724539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 198/400] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:50 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:50.730669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c545c8-3362-46a4-8df1-b00d6c8b3c7a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:50.831866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c769a-188d-499d-b01a-d075f560f4ee None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:50.896762 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c2102-ddee-408c-a28a-13ac5b2d2d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:50.897740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c2102-ddee-408c-a28a-13ac5b2d2d09 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:50.898354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c2102-ddee-408c-a28a-13ac5b2d2d09 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:50.898776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c2102-ddee-408c-a28a-13ac5b2d2d09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:50.926093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c2102-ddee-408c-a28a-13ac5b2d2d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-fe7c2102-ddee-408c-a28a-13ac5b2d2d09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:50.937965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:50.939107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:50.940126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 203/401] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:50.944765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c545c8-3362-46a4-8df1-b00d6c8b3c7a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:50.949258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c2102-ddee-408c-a28a-13ac5b2d2d09 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:50.980393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:51.023754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6390ce-0e59-4d4c-a03f-07f015c59a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:51.024436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6390ce-0e59-4d4c-a03f-07f015c59a6b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:51.024724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6390ce-0e59-4d4c-a03f-07f015c59a6b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:51.025008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6390ce-0e59-4d4c-a03f-07f015c59a6b None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:51.031801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6390ce-0e59-4d4c-a03f-07f015c59a6b None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:51.033328 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6390ce-0e59-4d4c-a03f-07f015c59a6b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:51.035418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 199/402] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:50 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:51.041218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6390ce-0e59-4d4c-a03f-07f015c59a6b None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:51.053793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:51.075990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c2102-ddee-408c-a28a-13ac5b2d2d09 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:51.113839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e537d-d163-49dc-ab60-aa67e8c76001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:51.114482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e537d-d163-49dc-ab60-aa67e8c76001 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:51.114763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e537d-d163-49dc-ab60-aa67e8c76001 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:51.115068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e537d-d163-49dc-ab60-aa67e8c76001 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:51.116085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e537d-d163-49dc-ab60-aa67e8c76001 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:51.116883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e537d-d163-49dc-ab60-aa67e8c76001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:51.118825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e537d-d163-49dc-ab60-aa67e8c76001 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:51.132918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 204/403] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:50 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:51.134414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3bc8e-f7f5-4647-8f3c-2796109543fa None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:51.134702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3bc8e-f7f5-4647-8f3c-2796109543fa None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:51.134992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3bc8e-f7f5-4647-8f3c-2796109543fa None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:51.137253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 205/404] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:51.138047 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3bc8e-f7f5-4647-8f3c-2796109543fa None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:51.228596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6390ce-0e59-4d4c-a03f-07f015c59a6b None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:51.269603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e763d93-a7c5-448e-81fe-228522584051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:51.270319 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e763d93-a7c5-448e-81fe-228522584051 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:51.270607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e763d93-a7c5-448e-81fe-228522584051 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:51.270929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e763d93-a7c5-448e-81fe-228522584051 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:51.272313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e763d93-a7c5-448e-81fe-228522584051 None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:51.273951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e763d93-a7c5-448e-81fe-228522584051 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:51.276246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 200/405] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:51 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:51.277819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408c3f-dc10-4f88-b146-98cb07b3d063 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:51.278105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408c3f-dc10-4f88-b146-98cb07b3d063 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:51.278378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408c3f-dc10-4f88-b146-98cb07b3d063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:51.292582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:51.301563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e9408c3f-dc10-4f88-b146-98cb07b3d063 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:51.303537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e9408c3f-dc10-4f88-b146-98cb07b3d063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:51.338576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3bc8e-f7f5-4647-8f3c-2796109543fa None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:51.382255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e48d0-1a29-41d7-9de0-448f6e461649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:51.383209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e48d0-1a29-41d7-9de0-448f6e461649 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:51.383496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e48d0-1a29-41d7-9de0-448f6e461649 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:51.383776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e48d0-1a29-41d7-9de0-448f6e461649 None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:51.385071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e48d0-1a29-41d7-9de0-448f6e461649 None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:51.386888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e48d0-1a29-41d7-9de0-448f6e461649 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:51.390387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 206/406] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:51 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:51.396532 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e48d0-1a29-41d7-9de0-448f6e461649 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:51.448188 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:51.460342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 201/407] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:51.462168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9408c3f-dc10-4f88-b146-98cb07b3d063 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:51.554432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e48d0-1a29-41d7-9de0-448f6e461649 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:51.597888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627af4-223b-4f28-9840-ff3c8b1d5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:51.598593 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627af4-223b-4f28-9840-ff3c8b1d5d99 None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:51.598875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627af4-223b-4f28-9840-ff3c8b1d5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:51.599188 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627af4-223b-4f28-9840-ff3c8b1d5d99 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/groups/61c6ff75bbff426fb147e233ab6c581f/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:51.601968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2627af4-223b-4f28-9840-ff3c8b1d5d99 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e, group_id=61c6ff75bbff426fb147e233ab6c581f, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:51.603729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2627af4-223b-4f28-9840-ff3c8b1d5d99 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:51.623943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 207/408] 10.222.0.124 () {58 vars in 1447 bytes} [Mon Aug 1 16:38:51 2022] PUT /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/groups/61c6ff75bbff426fb147e233ab6c581f/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:51.624958 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627af4-223b-4f28-9840-ff3c8b1d5d99 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:51.629503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:51.650892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9408c3f-dc10-4f88-b146-98cb07b3d063 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:51.738991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffcc6d-e3f5-447b-8e92-d544dfd4ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:51.740843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffcc6d-e3f5-447b-8e92-d544dfd4ff35 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:51.741733 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffcc6d-e3f5-447b-8e92-d544dfd4ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:51.742500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffcc6d-e3f5-447b-8e92-d544dfd4ff35 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:51.745299 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffcc6d-e3f5-447b-8e92-d544dfd4ff35 None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:51.755885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffcc6d-e3f5-447b-8e92-d544dfd4ff35 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:51.760330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 202/409] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:51 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:51.767516 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffcc6d-e3f5-447b-8e92-d544dfd4ff35 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:51.776590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627af4-223b-4f28-9840-ff3c8b1d5d99 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:51.821340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561815-329d-421d-9838-f9bce26419f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:51.821977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561815-329d-421d-9838-f9bce26419f3 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:51.822266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561815-329d-421d-9838-f9bce26419f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:51.822545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561815-329d-421d-9838-f9bce26419f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:51.843478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a561815-329d-421d-9838-f9bce26419f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-2a561815-329d-421d-9838-f9bce26419f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:51.849425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:51.851268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:51.852779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 208/410] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:38:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:51.858165 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561815-329d-421d-9838-f9bce26419f3 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:51.907413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:51.938662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:51.962676 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffcc6d-e3f5-447b-8e92-d544dfd4ff35 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:51.985801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561815-329d-421d-9838-f9bce26419f3 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:52.017716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859d189-2fe5-49f0-870d-6ec4118136a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:52.018763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d189-2fe5-49f0-870d-6ec4118136a5 None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:52.019263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d189-2fe5-49f0-870d-6ec4118136a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:52.019690 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d189-2fe5-49f0-870d-6ec4118136a5 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/groups/61c6ff75bbff426fb147e233ab6c581f/roles/1f3d7dea677f4b82a9728c6f9083d706` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:52.025890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859d189-2fe5-49f0-870d-6ec4118136a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e, group_id=61c6ff75bbff426fb147e233ab6c581f, role_id=1f3d7dea677f4b82a9728c6f9083d706)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:52.026579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a12c1-a600-4a38-a804-0be29e8e563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:52.026795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a12c1-a600-4a38-a804-0be29e8e563b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:52.027121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a12c1-a600-4a38-a804-0be29e8e563b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:52.027397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a12c1-a600-4a38-a804-0be29e8e563b None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:52.028148 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a12c1-a600-4a38-a804-0be29e8e563b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:52.028459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a12c1-a600-4a38-a804-0be29e8e563b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:52.029131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859d189-2fe5-49f0-870d-6ec4118136a5 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:52.029888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a12c1-a600-4a38-a804-0be29e8e563b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:52.040260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 209/411] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:51 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:52.046423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a12c1-a600-4a38-a804-0be29e8e563b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:52.067555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 203/412] 10.222.0.124 () {58 vars in 1447 bytes} [Mon Aug 1 16:38:51 2022] PUT /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e/groups/61c6ff75bbff426fb147e233ab6c581f/roles/1f3d7dea677f4b82a9728c6f9083d706 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:52.089992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc066b-dcf1-4392-9566-004991b1ef55 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:52.090533 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc066b-dcf1-4392-9566-004991b1ef55 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:52.091013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc066b-dcf1-4392-9566-004991b1ef55 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:52.097359 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 204/413] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:52.099620 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494cda1-9b8d-44d1-b553-1a043b296dd5 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:52.100123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494cda1-9b8d-44d1-b553-1a043b296dd5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:52.100577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494cda1-9b8d-44d1-b553-1a043b296dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:52.122225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f494cda1-9b8d-44d1-b553-1a043b296dd5 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:52.124183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f494cda1-9b8d-44d1-b553-1a043b296dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:52.168714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a12c1-a600-4a38-a804-0be29e8e563b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:52.200070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:52.211045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1e76c-c015-4b0a-9833-108c3659c821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:52.211784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e76c-c015-4b0a-9833-108c3659c821 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:52.212066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e76c-c015-4b0a-9833-108c3659c821 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:52.212391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e76c-c015-4b0a-9833-108c3659c821 None admin] PATH_INFO: `/v3/groups/369b1d7be84f462cb6a003bd40701b74` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:52.214123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1e76c-c015-4b0a-9833-108c3659c821 None admin] RBAC: Authorizing `identity:get_group(group_id=369b1d7be84f462cb6a003bd40701b74)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:52.215774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1e76c-c015-4b0a-9833-108c3659c821 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:52.218022 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 210/414] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:52 2022] GET /identity/v3/groups/369b1d7be84f462cb6a003bd40701b74 => generated 230 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:52.224331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 205/415] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:52.228251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1e76c-c015-4b0a-9833-108c3659c821 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:52.254067 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494cda1-9b8d-44d1-b553-1a043b296dd5 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:52.340245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:52.405018 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494cda1-9b8d-44d1-b553-1a043b296dd5 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:52.406322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1e76c-c015-4b0a-9833-108c3659c821 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:52.451604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ada20-54f5-45a0-ba7c-8cc8bf11786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:52.452282 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ada20-54f5-45a0-ba7c-8cc8bf11786f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:52.452564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ada20-54f5-45a0-ba7c-8cc8bf11786f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:52.452867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ada20-54f5-45a0-ba7c-8cc8bf11786f None admin] PATH_INFO: `/v3/roles/member` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:52.455621 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b83968-a80d-44d7-bd74-22eb4a8bb314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:52.456905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b83968-a80d-44d7-bd74-22eb4a8bb314 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:52.457258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b83968-a80d-44d7-bd74-22eb4a8bb314 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:52.457606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b83968-a80d-44d7-bd74-22eb4a8bb314 None admin] PATH_INFO: `/v3/projects/587d85cd8aa24181b672e7ee967eed1e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:52.459567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b83968-a80d-44d7-bd74-22eb4a8bb314 None admin] RBAC: Authorizing `identity:get_project(project_id=587d85cd8aa24181b672e7ee967eed1e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:52.461403 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b83968-a80d-44d7-bd74-22eb4a8bb314 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:52.464659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 211/416] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:52 2022] GET /identity/v3/projects/587d85cd8aa24181b672e7ee967eed1e => generated 345 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:52.466497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ada20-54f5-45a0-ba7c-8cc8bf11786f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-938ada20-54f5-45a0-ba7c-8cc8bf11786f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:52.471890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:52.472845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:52.474090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 206/417] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:52.475445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b83968-a80d-44d7-bd74-22eb4a8bb314 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:52.480164 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ada20-54f5-45a0-ba7c-8cc8bf11786f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:52.676302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:52.746856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ada20-54f5-45a0-ba7c-8cc8bf11786f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:52.784100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:52.806625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b83968-a80d-44d7-bd74-22eb4a8bb314 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:52.828522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547b2b-6ea7-4a1b-bde4-23295a2c3e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:52.829553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547b2b-6ea7-4a1b-bde4-23295a2c3e53 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:52.830035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547b2b-6ea7-4a1b-bde4-23295a2c3e53 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:52.830521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547b2b-6ea7-4a1b-bde4-23295a2c3e53 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:52.832154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547b2b-6ea7-4a1b-bde4-23295a2c3e53 None admin] RBAC: Adding query filter params (name=member) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:52.832695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547b2b-6ea7-4a1b-bde4-23295a2c3e53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:52.843794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547b2b-6ea7-4a1b-bde4-23295a2c3e53 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:52.873747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 207/418] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:52 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:52.880312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547b2b-6ea7-4a1b-bde4-23295a2c3e53 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:52.892039 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04616a2-2ab7-4751-a9f8-7d5dde882e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:52.893813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04616a2-2ab7-4751-a9f8-7d5dde882e1c None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:52.894616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04616a2-2ab7-4751-a9f8-7d5dde882e1c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:52.906066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04616a2-2ab7-4751-a9f8-7d5dde882e1c None admin] PATH_INFO: `/v3/projects/587d85cd8aa24181b672e7ee967eed1e/groups/369b1d7be84f462cb6a003bd40701b74/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:52.910451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04616a2-2ab7-4751-a9f8-7d5dde882e1c None admin] RBAC: Authorizing `identity:create_grant(project_id=587d85cd8aa24181b672e7ee967eed1e, group_id=369b1d7be84f462cb6a003bd40701b74, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:52.914410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04616a2-2ab7-4751-a9f8-7d5dde882e1c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:52.947131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 212/419] 10.222.0.124 () {58 vars in 1447 bytes} [Mon Aug 1 16:38:52 2022] PUT /identity/v3/projects/587d85cd8aa24181b672e7ee967eed1e/groups/369b1d7be84f462cb6a003bd40701b74/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:38:52.950934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08299f-3710-4daa-a210-61c9287f968e None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:52.953800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08299f-3710-4daa-a210-61c9287f968e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:52.954876 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08299f-3710-4daa-a210-61c9287f968e None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:52.959827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 213/420] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:52 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:52.969406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82acd92-f2d3-4ffd-8a29-d877149eaf86 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:52.970696 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82acd92-f2d3-4ffd-8a29-d877149eaf86 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:52.971579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82acd92-f2d3-4ffd-8a29-d877149eaf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:53.018107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-f82acd92-f2d3-4ffd-8a29-d877149eaf86 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:53.023406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f82acd92-f2d3-4ffd-8a29-d877149eaf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:53.121423 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547b2b-6ea7-4a1b-bde4-23295a2c3e53 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:53.165650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 214/421] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:53.190740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82acd92-f2d3-4ffd-8a29-d877149eaf86 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:53.201108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f411-10d5-467f-b68f-ebc8dbbb2bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:53.201817 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f411-10d5-467f-b68f-ebc8dbbb2bae None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:53.202103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f411-10d5-467f-b68f-ebc8dbbb2bae None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:53.202379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f411-10d5-467f-b68f-ebc8dbbb2bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:53.267774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:53.277340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:53.299783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05f411-10d5-467f-b68f-ebc8dbbb2bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:53.301528 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05f411-10d5-467f-b68f-ebc8dbbb2bae None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:53.402711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82acd92-f2d3-4ffd-8a29-d877149eaf86 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:53.529550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393e94-68b4-40f0-a10b-b2633fcba1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:53.530285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393e94-68b4-40f0-a10b-b2633fcba1e6 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:53.530561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393e94-68b4-40f0-a10b-b2633fcba1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:53.530877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393e94-68b4-40f0-a10b-b2633fcba1e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:53.573400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37393e94-68b4-40f0-a10b-b2633fcba1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-37393e94-68b4-40f0-a10b-b2633fcba1e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:53.586477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:53.587469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:53.588311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:53.596662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 215/422] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:53.601554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393e94-68b4-40f0-a10b-b2633fcba1e6 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:53.644032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 208/423] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 16:38:53.648486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f411-10d5-467f-b68f-ebc8dbbb2bae None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:53.781656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393e94-68b4-40f0-a10b-b2633fcba1e6 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:53.796741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:53.827000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515568e0-573d-40bb-b1be-5e5d0802faa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:53.827381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515568e0-573d-40bb-b1be-5e5d0802faa4 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:53.827788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515568e0-573d-40bb-b1be-5e5d0802faa4 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:53.828276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515568e0-573d-40bb-b1be-5e5d0802faa4 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:53.829657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515568e0-573d-40bb-b1be-5e5d0802faa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:53.830180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515568e0-573d-40bb-b1be-5e5d0802faa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:53.835009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515568e0-573d-40bb-b1be-5e5d0802faa4 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:53.854748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 216/424] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:53 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:53.859828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515568e0-573d-40bb-b1be-5e5d0802faa4 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:53.895346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:53.941208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f411-10d5-467f-b68f-ebc8dbbb2bae None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:54.023768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c1778-72b2-47cc-b101-aafdc3809c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:54.024450 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c1778-72b2-47cc-b101-aafdc3809c35 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:54.024739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c1778-72b2-47cc-b101-aafdc3809c35 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:54.025021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c1778-72b2-47cc-b101-aafdc3809c35 None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:54.026340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c1778-72b2-47cc-b101-aafdc3809c35 None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:54.027910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c1778-72b2-47cc-b101-aafdc3809c35 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:54.030020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 209/425] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:53 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:54.036407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515568e0-573d-40bb-b1be-5e5d0802faa4 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:54.040065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c1778-72b2-47cc-b101-aafdc3809c35 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:54.074761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce7278-1152-4801-8e2f-7ca28654d8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:54.075457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce7278-1152-4801-8e2f-7ca28654d8f4 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:54.075746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce7278-1152-4801-8e2f-7ca28654d8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:54.076022 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce7278-1152-4801-8e2f-7ca28654d8f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:54.169091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:54.213038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c1778-72b2-47cc-b101-aafdc3809c35 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:54.232459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce7278-1152-4801-8e2f-7ca28654d8f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:54.233947 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce7278-1152-4801-8e2f-7ca28654d8f4 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:54.270492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac90193-cc15-4c93-bf3d-16120929b183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:54.271189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac90193-cc15-4c93-bf3d-16120929b183 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:54.271590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac90193-cc15-4c93-bf3d-16120929b183 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:54.271915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac90193-cc15-4c93-bf3d-16120929b183 None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:54.273539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac90193-cc15-4c93-bf3d-16120929b183 None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:54.275154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac90193-cc15-4c93-bf3d-16120929b183 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:54.277197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 210/426] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:54 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:54.283351 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac90193-cc15-4c93-bf3d-16120929b183 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:54.311649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:54.399041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac90193-cc15-4c93-bf3d-16120929b183 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:54.438556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae259-f877-435e-9998-6bca123224c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:54.439235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae259-f877-435e-9998-6bca123224c2 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:54.439524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae259-f877-435e-9998-6bca123224c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:54.439806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae259-f877-435e-9998-6bca123224c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:54.440629 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ae259-f877-435e-9998-6bca123224c2 None admin] RBAC: Adding query filter params (group.id=61c6ff75bbff426fb147e233ab6c581f, role.id=a1ce48deeb3148e28049f10600de5fbe, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:54.440944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ae259-f877-435e-9998-6bca123224c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:54.442477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ae259-f877-435e-9998-6bca123224c2 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:54.450123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 211/427] 10.222.0.124 () {56 vars in 1381 bytes} [Mon Aug 1 16:38:54 2022] GET /identity/v3/role_assignments?group.id=61c6ff75bbff426fb147e233ab6c581f&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 613 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:54.544378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 217/428] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:53 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:54.550426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae259-f877-435e-9998-6bca123224c2 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:54.633559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acca32-b284-43d4-a7a0-d25e06e492f9 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:54.633805 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acca32-b284-43d4-a7a0-d25e06e492f9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:54.634174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acca32-b284-43d4-a7a0-d25e06e492f9 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:54.635847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 218/429] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:38:54.641569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993fcc7-c1be-4ff0-a48d-a20e039ca6df None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:54.641938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993fcc7-c1be-4ff0-a48d-a20e039ca6df None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:54.642129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993fcc7-c1be-4ff0-a48d-a20e039ca6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:54.662346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-c993fcc7-c1be-4ff0-a48d-a20e039ca6df None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:54.663693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c993fcc7-c1be-4ff0-a48d-a20e039ca6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:54.703974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:54.746896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 219/430] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:54.750877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae259-f877-435e-9998-6bca123224c2 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:54.773988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993fcc7-c1be-4ff0-a48d-a20e039ca6df None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:54.777333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:54.804799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e4c58-4c6b-4e48-b042-6189beb56aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:54.805467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e4c58-4c6b-4e48-b042-6189beb56aee None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:54.805739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e4c58-4c6b-4e48-b042-6189beb56aee None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:54.806014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e4c58-4c6b-4e48-b042-6189beb56aee None admin] PATH_INFO: `/v3/projects/32937f53ee28435c9dcbea8b3d17dd15` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:54.807293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e4c58-4c6b-4e48-b042-6189beb56aee None admin] RBAC: Authorizing `identity:get_project(project_id=32937f53ee28435c9dcbea8b3d17dd15)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:54.808823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e4c58-4c6b-4e48-b042-6189beb56aee None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:54.813301 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 212/431] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:54 2022] GET /identity/v3/projects/32937f53ee28435c9dcbea8b3d17dd15 => generated 299 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:54.819426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e4c58-4c6b-4e48-b042-6189beb56aee None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:54.940434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993fcc7-c1be-4ff0-a48d-a20e039ca6df None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:54.969912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e4c58-4c6b-4e48-b042-6189beb56aee None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:54.988290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a0e71-852a-40f2-8ac7-c2ff6d5afbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:54.989345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0e71-852a-40f2-8ac7-c2ff6d5afbcc None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:54.989905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0e71-852a-40f2-8ac7-c2ff6d5afbcc None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:54.990698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0e71-852a-40f2-8ac7-c2ff6d5afbcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:55.007930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a0e71-852a-40f2-8ac7-c2ff6d5afbcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:55.009684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db7b95-5162-41c8-8e12-cf19ffb3c49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:55.010361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db7b95-5162-41c8-8e12-cf19ffb3c49f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:55.010638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db7b95-5162-41c8-8e12-cf19ffb3c49f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:55.010908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db7b95-5162-41c8-8e12-cf19ffb3c49f None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:55.012216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db7b95-5162-41c8-8e12-cf19ffb3c49f None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:55.013705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db7b95-5162-41c8-8e12-cf19ffb3c49f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:55.015827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 213/432] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:54 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-923a0e71-852a-40f2-8ac7-c2ff6d5afbcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:55.016540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:55.017560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:38:55.018811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:55.019501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdd04-c1c6-49d3-b239-6c5a131c62b2 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:55.019501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdd04-c1c6-49d3-b239-6c5a131c62b2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:55.019501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdd04-c1c6-49d3-b239-6c5a131c62b2 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:55.019501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 214/433] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:55.021414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 220/434] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:38:55.027482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a0e71-852a-40f2-8ac7-c2ff6d5afbcc None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:55.028532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76973e-9b80-4f0f-83a6-9d2768efa750 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:55.029030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76973e-9b80-4f0f-83a6-9d2768efa750 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:55.029505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76973e-9b80-4f0f-83a6-9d2768efa750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:55.051556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6a76973e-9b80-4f0f-83a6-9d2768efa750 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:55.052868 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6a76973e-9b80-4f0f-83a6-9d2768efa750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:55.065493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:55.132770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:55.174532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 215/435] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:38:55.176279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76973e-9b80-4f0f-83a6-9d2768efa750 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:55.189279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a0e71-852a-40f2-8ac7-c2ff6d5afbcc None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:55.259597 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d28c2c-a631-405f-9274-07ad7557a509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:55.260682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28c2c-a631-405f-9274-07ad7557a509 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:55.261164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28c2c-a631-405f-9274-07ad7557a509 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:55.261513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28c2c-a631-405f-9274-07ad7557a509 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:55.262834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d28c2c-a631-405f-9274-07ad7557a509 None admin] RBAC: Adding query filter params (name=member) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:55.263397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d28c2c-a631-405f-9274-07ad7557a509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:55.265717 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d28c2c-a631-405f-9274-07ad7557a509 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:55.281511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 221/436] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:38:55 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:55.283089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d28c2c-a631-405f-9274-07ad7557a509 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:55.349385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76973e-9b80-4f0f-83a6-9d2768efa750 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:55.417045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b2daf-dd9b-4c3a-bfc7-77d8a2795cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:55.418057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b2daf-dd9b-4c3a-bfc7-77d8a2795cf5 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:55.418502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b2daf-dd9b-4c3a-bfc7-77d8a2795cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:55.418977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b2daf-dd9b-4c3a-bfc7-77d8a2795cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:55.420416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b2daf-dd9b-4c3a-bfc7-77d8a2795cf5 None admin] RBAC: Adding query filter params (group.id=61c6ff75bbff426fb147e233ab6c581f, role.id=1f3d7dea677f4b82a9728c6f9083d706, scope.project.id=32937f53ee28435c9dcbea8b3d17dd15) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:55.420910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b2daf-dd9b-4c3a-bfc7-77d8a2795cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:55.423491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b2daf-dd9b-4c3a-bfc7-77d8a2795cf5 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:55.443002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 216/437] 10.222.0.124 () {56 vars in 1381 bytes} [Mon Aug 1 16:38:55 2022] GET /identity/v3/role_assignments?group.id=61c6ff75bbff426fb147e233ab6c581f&scope.project.id=32937f53ee28435c9dcbea8b3d17dd15&role.id=1f3d7dea677f4b82a9728c6f9083d706 => generated 613 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:55.443002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b2daf-dd9b-4c3a-bfc7-77d8a2795cf5 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:55.465434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:55.474028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d28c2c-a631-405f-9274-07ad7557a509 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:55.506335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:55.523341 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fc3f2-16e7-4c26-8489-f7987ee19c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:55.525468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc3f2-16e7-4c26-8489-f7987ee19c1a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:55.526298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc3f2-16e7-4c26-8489-f7987ee19c1a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:55.526788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fc3f2-16e7-4c26-8489-f7987ee19c1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:55.552346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fc3f2-16e7-4c26-8489-f7987ee19c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-3a9fc3f2-16e7-4c26-8489-f7987ee19c1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:55.558574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:55.560151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:38:55.561982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:38:55.567518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 222/438] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:38:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:55.569043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fc3f2-16e7-4c26-8489-f7987ee19c1a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:55.641449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b2daf-dd9b-4c3a-bfc7-77d8a2795cf5 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:55.694711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcb75e-2d21-4225-abd4-7bcd1258724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:55.694711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcb75e-2d21-4225-abd4-7bcd1258724a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:55.694711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcb75e-2d21-4225-abd4-7bcd1258724a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:55.694711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcb75e-2d21-4225-abd4-7bcd1258724a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:55.729561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fc3f2-16e7-4c26-8489-f7987ee19c1a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:55.787679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421a87d-ae85-4ce4-9996-fbd1951582b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:55.788289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a87d-ae85-4ce4-9996-fbd1951582b4 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:55.788572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a87d-ae85-4ce4-9996-fbd1951582b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:55.788850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a87d-ae85-4ce4-9996-fbd1951582b4 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:55.789612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421a87d-ae85-4ce4-9996-fbd1951582b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:55.789920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421a87d-ae85-4ce4-9996-fbd1951582b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:55.791518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421a87d-ae85-4ce4-9996-fbd1951582b4 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:55.805581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 223/439] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:38:55 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:38:55.805581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e4a45-6987-412f-a8d5-64f26eb85424 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:55.805581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e4a45-6987-412f-a8d5-64f26eb85424 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:55.806145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e4a45-6987-412f-a8d5-64f26eb85424 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:55.807649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 224/440] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:38:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:38:55.814906 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c34ba-3d9c-4f91-8ac5-9afb8cefd974 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:55.815438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c34ba-3d9c-4f91-8ac5-9afb8cefd974 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:55.815661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c34ba-3d9c-4f91-8ac5-9afb8cefd974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:55.818486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcb75e-2d21-4225-abd4-7bcd1258724a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:55.821081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcb75e-2d21-4225-abd4-7bcd1258724a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:55.843868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-5e4c34ba-3d9c-4f91-8ac5-9afb8cefd974 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:38:55.845142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5e4c34ba-3d9c-4f91-8ac5-9afb8cefd974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:38:55.845326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:55.929645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:55.971280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 225/441] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:38:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:38:55.972843 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c34ba-3d9c-4f91-8ac5-9afb8cefd974 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:56.007950 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 217/442] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:56.008681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcb75e-2d21-4225-abd4-7bcd1258724a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:56.135313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c34ba-3d9c-4f91-8ac5-9afb8cefd974 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:56.173567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcb75e-2d21-4225-abd4-7bcd1258724a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:56.176611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923be47-1346-47ed-b2b0-2254a9b810b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:56.177303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923be47-1346-47ed-b2b0-2254a9b810b8 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:56.177622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923be47-1346-47ed-b2b0-2254a9b810b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:56.178036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923be47-1346-47ed-b2b0-2254a9b810b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:56.195598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:56.232298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57429eae-529d-4c88-80c0-427480bbd5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:56.233021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57429eae-529d-4c88-80c0-427480bbd5d4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:56.233320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57429eae-529d-4c88-80c0-427480bbd5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:56.233620 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57429eae-529d-4c88-80c0-427480bbd5d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:56.247434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:56.248377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57429eae-529d-4c88-80c0-427480bbd5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-57429eae-529d-4c88-80c0-427480bbd5d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:38:56.253990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:38:56.254941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:38:56.256228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 218/443] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:38:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:38:56.256974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57429eae-529d-4c88-80c0-427480bbd5d4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:56.281792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923be47-1346-47ed-b2b0-2254a9b810b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:56.283318 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923be47-1346-47ed-b2b0-2254a9b810b8 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:56.400079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57429eae-529d-4c88-80c0-427480bbd5d4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:56.401222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 226/444] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:56.402249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923be47-1346-47ed-b2b0-2254a9b810b8 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:56.448526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd87e6f-ff47-4a53-b03b-e4d21db1072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:56.449195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd87e6f-ff47-4a53-b03b-e4d21db1072c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:56.449479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd87e6f-ff47-4a53-b03b-e4d21db1072c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:56.449753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd87e6f-ff47-4a53-b03b-e4d21db1072c None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:56.451084 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd87e6f-ff47-4a53-b03b-e4d21db1072c None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:56.452594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd87e6f-ff47-4a53-b03b-e4d21db1072c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:56.454373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 219/445] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:56 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:56.455212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd87e6f-ff47-4a53-b03b-e4d21db1072c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:56.501576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:56.507230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:56.529402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923be47-1346-47ed-b2b0-2254a9b810b8 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:56.570515 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46157d8-c1bb-4757-be64-654ca9780406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:56.571199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46157d8-c1bb-4757-be64-654ca9780406 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:56.571484 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46157d8-c1bb-4757-be64-654ca9780406 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:56.571761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46157d8-c1bb-4757-be64-654ca9780406 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:56.572521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46157d8-c1bb-4757-be64-654ca9780406 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:56.572829 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46157d8-c1bb-4757-be64-654ca9780406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:56.574269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46157d8-c1bb-4757-be64-654ca9780406 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:56.583896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 227/446] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:38:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:56.585214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46157d8-c1bb-4757-be64-654ca9780406 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:56.593062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd87e6f-ff47-4a53-b03b-e4d21db1072c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:56.635505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa294ad5-7a7d-4719-9982-a911ac8ede10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:56.636555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa294ad5-7a7d-4719-9982-a911ac8ede10 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:56.637004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa294ad5-7a7d-4719-9982-a911ac8ede10 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:56.637448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa294ad5-7a7d-4719-9982-a911ac8ede10 None admin] PATH_INFO: `/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:56.639370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa294ad5-7a7d-4719-9982-a911ac8ede10 None admin] RBAC: Authorizing `identity:get_project(project_id=b1a53f1b3b1e4e0ca4e98c3471685e0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:56.641894 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa294ad5-7a7d-4719-9982-a911ac8ede10 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:56.644341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 220/447] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:56 2022] GET /identity/v3/projects/b1a53f1b3b1e4e0ca4e98c3471685e0e => generated 303 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:56.645366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa294ad5-7a7d-4719-9982-a911ac8ede10 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:56.722989 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46157d8-c1bb-4757-be64-654ca9780406 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:56.763196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa294ad5-7a7d-4719-9982-a911ac8ede10 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:56.764858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b729f-2ba8-4b3c-abdb-b15c82d7ee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:56.765396 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b729f-2ba8-4b3c-abdb-b15c82d7ee5e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:56.765688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b729f-2ba8-4b3c-abdb-b15c82d7ee5e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:56.765962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b729f-2ba8-4b3c-abdb-b15c82d7ee5e None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:56.767360 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b729f-2ba8-4b3c-abdb-b15c82d7ee5e None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:56.768890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b729f-2ba8-4b3c-abdb-b15c82d7ee5e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:56.770610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 228/448] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:56 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:56.771889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b729f-2ba8-4b3c-abdb-b15c82d7ee5e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:56.776931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:56.787084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:56.812839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da93255-ddfc-4c71-8a51-6d192d2dccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:56.813617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da93255-ddfc-4c71-8a51-6d192d2dccee None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:56.813990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da93255-ddfc-4c71-8a51-6d192d2dccee None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:56.814348 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da93255-ddfc-4c71-8a51-6d192d2dccee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:56.899833 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da93255-ddfc-4c71-8a51-6d192d2dccee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:56.901330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da93255-ddfc-4c71-8a51-6d192d2dccee None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:56.908561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b729f-2ba8-4b3c-abdb-b15c82d7ee5e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:56.972459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636766f5-6065-43f0-bd90-4e857bcf4533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:56.973619 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636766f5-6065-43f0-bd90-4e857bcf4533 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:56.974045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636766f5-6065-43f0-bd90-4e857bcf4533 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:56.974837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636766f5-6065-43f0-bd90-4e857bcf4533 None admin] PATH_INFO: `/v3/groups/61c6ff75bbff426fb147e233ab6c581f` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:56.976865 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636766f5-6065-43f0-bd90-4e857bcf4533 None admin] RBAC: Authorizing `identity:get_group(group_id=61c6ff75bbff426fb147e233ab6c581f)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:56.979691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636766f5-6065-43f0-bd90-4e857bcf4533 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:56.982747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 229/449] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:56 2022] GET /identity/v3/groups/61c6ff75bbff426fb147e233ab6c581f => generated 227 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:56.987827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636766f5-6065-43f0-bd90-4e857bcf4533 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:57.020487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 221/450] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:38:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:38:57.022491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da93255-ddfc-4c71-8a51-6d192d2dccee None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:57.034819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:57.084845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:57.113766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636766f5-6065-43f0-bd90-4e857bcf4533 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:57.146922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da93255-ddfc-4c71-8a51-6d192d2dccee None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:57.156711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e18f-0b4f-44a7-a091-e1bbaed6e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:57.157384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e18f-0b4f-44a7-a091-e1bbaed6e7ac None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:57.157668 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e18f-0b4f-44a7-a091-e1bbaed6e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:57.157956 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e18f-0b4f-44a7-a091-e1bbaed6e7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:57.158816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4e18f-0b4f-44a7-a091-e1bbaed6e7ac None admin] RBAC: Adding query filter params (group.id=61c6ff75bbff426fb147e233ab6c581f, role.id=a1ce48deeb3148e28049f10600de5fbe, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:57.159167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4e18f-0b4f-44a7-a091-e1bbaed6e7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:57.162100 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4e18f-0b4f-44a7-a091-e1bbaed6e7ac None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:57.169729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 230/451] 10.222.0.124 () {56 vars in 1381 bytes} [Mon Aug 1 16:38:56 2022] GET /identity/v3/role_assignments?group.id=61c6ff75bbff426fb147e233ab6c581f&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=a1ce48deeb3148e28049f10600de5fbe => generated 613 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:57.170613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e18f-0b4f-44a7-a091-e1bbaed6e7ac None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:57.188858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a4ad3-404d-459b-8e4b-2338b4336f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:57.189526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4ad3-404d-459b-8e4b-2338b4336f1f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:57.189795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4ad3-404d-459b-8e4b-2338b4336f1f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:57.190070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4ad3-404d-459b-8e4b-2338b4336f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:57.190911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a4ad3-404d-459b-8e4b-2338b4336f1f None admin] RBAC: Adding query filter params (group.id=61c6ff75bbff426fb147e233ab6c581f, role.id=1f3d7dea677f4b82a9728c6f9083d706, scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:57.191273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a4ad3-404d-459b-8e4b-2338b4336f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:57.192847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a4ad3-404d-459b-8e4b-2338b4336f1f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:57.200990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 222/452] 10.222.0.124 () {56 vars in 1381 bytes} [Mon Aug 1 16:38:57 2022] GET /identity/v3/role_assignments?group.id=61c6ff75bbff426fb147e233ab6c581f&scope.project.id=b1a53f1b3b1e4e0ca4e98c3471685e0e&role.id=1f3d7dea677f4b82a9728c6f9083d706 => generated 613 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:57.330481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e18f-0b4f-44a7-a091-e1bbaed6e7ac None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:57.378531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb754-22cf-46ac-9ef7-0a506ae829cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:57.379307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb754-22cf-46ac-9ef7-0a506ae829cb None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:57.379534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb754-22cf-46ac-9ef7-0a506ae829cb None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:57.379811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb754-22cf-46ac-9ef7-0a506ae829cb None admin] PATH_INFO: `/v3/projects/587d85cd8aa24181b672e7ee967eed1e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:57.383075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bb754-22cf-46ac-9ef7-0a506ae829cb None admin] RBAC: Authorizing `identity:get_project(project_id=587d85cd8aa24181b672e7ee967eed1e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:57.383529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bb754-22cf-46ac-9ef7-0a506ae829cb None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:57.391197 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 231/453] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:38:57 2022] GET /identity/v3/projects/587d85cd8aa24181b672e7ee967eed1e => generated 345 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:57.395742 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a4ad3-404d-459b-8e4b-2338b4336f1f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:57.504863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:57.546013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a4ad3-404d-459b-8e4b-2338b4336f1f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:57.587326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc57a64-299e-478b-b03d-adaad7e376ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:57.588441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc57a64-299e-478b-b03d-adaad7e376ae None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:57.588870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc57a64-299e-478b-b03d-adaad7e376ae None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:57.589257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc57a64-299e-478b-b03d-adaad7e376ae None admin] PATH_INFO: `/v3/groups/369b1d7be84f462cb6a003bd40701b74` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:57.591486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc57a64-299e-478b-b03d-adaad7e376ae None admin] RBAC: Authorizing `identity:get_group(group_id=369b1d7be84f462cb6a003bd40701b74)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:57.593688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc57a64-299e-478b-b03d-adaad7e376ae None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:57.596659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 223/454] 10.222.0.124 () {56 vars in 1185 bytes} [Mon Aug 1 16:38:57 2022] GET /identity/v3/groups/369b1d7be84f462cb6a003bd40701b74 => generated 230 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:38:57.603657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb754-22cf-46ac-9ef7-0a506ae829cb None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:38:57.618506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:57.756353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb754-22cf-46ac-9ef7-0a506ae829cb None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:38:57.826308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523cfa2-e7d2-498f-8ffa-dd878baf5b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:38:57.827483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523cfa2-e7d2-498f-8ffa-dd878baf5b39 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:38:57.827951 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523cfa2-e7d2-498f-8ffa-dd878baf5b39 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:38:57.828460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523cfa2-e7d2-498f-8ffa-dd878baf5b39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:38:57.830001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523cfa2-e7d2-498f-8ffa-dd878baf5b39 None admin] RBAC: Adding query filter params (group.id=369b1d7be84f462cb6a003bd40701b74, role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=587d85cd8aa24181b672e7ee967eed1e) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:38:57.830547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523cfa2-e7d2-498f-8ffa-dd878baf5b39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:38:57.834247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523cfa2-e7d2-498f-8ffa-dd878baf5b39 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:38:57.847459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 232/455] 10.222.0.124 () {56 vars in 1381 bytes} [Mon Aug 1 16:38:57 2022] GET /identity/v3/role_assignments?group.id=369b1d7be84f462cb6a003bd40701b74&scope.project.id=587d85cd8aa24181b672e7ee967eed1e&role.id=390e487a45f74246ba84773e8760bc7c => generated 613 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:00.725913 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d220-cfad-4ed4-97da-886804272dd3 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:00.726705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d220-cfad-4ed4-97da-886804272dd3 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:00.726832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d220-cfad-4ed4-97da-886804272dd3 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:00.730209 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 224/456] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:00 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:00.736508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39b1aa-a9ac-4b06-b4f7-ed0ac9e67f3c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:00.737303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39b1aa-a9ac-4b06-b4f7-ed0ac9e67f3c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:00.737600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39b1aa-a9ac-4b06-b4f7-ed0ac9e67f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:00.775943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ed39b1aa-a9ac-4b06-b4f7-ed0ac9e67f3c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:00.778907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ed39b1aa-a9ac-4b06-b4f7-ed0ac9e67f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:00.887845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 233/457] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:00.926873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827d220-cfad-4ed4-97da-886804272dd3 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:01.127303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827d220-cfad-4ed4-97da-886804272dd3 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:01.224569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c52e8e-1cca-473c-8060-8b2fc3593e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:01.225774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c52e8e-1cca-473c-8060-8b2fc3593e7f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:01.226276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c52e8e-1cca-473c-8060-8b2fc3593e7f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:01.226775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c52e8e-1cca-473c-8060-8b2fc3593e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:01.245021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:01.253340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c52e8e-1cca-473c-8060-8b2fc3593e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:01.256978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c52e8e-1cca-473c-8060-8b2fc3593e7f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-28c52e8e-1cca-473c-8060-8b2fc3593e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:01.301526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:01.302491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:01.303385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:01.303385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:01.303385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:01.303385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:01.304419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 225/458] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:39:01.310910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39b1aa-a9ac-4b06-b4f7-ed0ac9e67f3c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:01.315173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:01.557126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41395-26f2-459c-b306-6c931e5af136 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:01.557790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41395-26f2-459c-b306-6c931e5af136 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:01.558267 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41395-26f2-459c-b306-6c931e5af136 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:01.559993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 226/459] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:01.566035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4385be7-1d90-48f6-8d6a-593afb16b3d3 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:01.566657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4385be7-1d90-48f6-8d6a-593afb16b3d3 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:01.567171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4385be7-1d90-48f6-8d6a-593afb16b3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:01.588808 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d4385be7-1d90-48f6-8d6a-593afb16b3d3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:01.590521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d4385be7-1d90-48f6-8d6a-593afb16b3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:01.606086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39b1aa-a9ac-4b06-b4f7-ed0ac9e67f3c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:01.675074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 227/460] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:39:01.701428 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4385be7-1d90-48f6-8d6a-593afb16b3d3 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:01.759752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca743862-71c9-42ba-9766-f07abc81fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:01.761339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743862-71c9-42ba-9766-f07abc81fd8e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:01.762073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743862-71c9-42ba-9766-f07abc81fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:01.762565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743862-71c9-42ba-9766-f07abc81fd8e None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:01.763577 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca743862-71c9-42ba-9766-f07abc81fd8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:01.764114 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca743862-71c9-42ba-9766-f07abc81fd8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:01.765782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca743862-71c9-42ba-9766-f07abc81fd8e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:01.796956 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 234/461] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:01.820671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca743862-71c9-42ba-9766-f07abc81fd8e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:01.889731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4385be7-1d90-48f6-8d6a-593afb16b3d3 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:01.933885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:01.973145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:01.977406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbc3c2-870a-4210-b0a5-b08d1bd29554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:01.978516 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbc3c2-870a-4210-b0a5-b08d1bd29554 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:01.979252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbc3c2-870a-4210-b0a5-b08d1bd29554 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:01.979947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbc3c2-870a-4210-b0a5-b08d1bd29554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:02.023135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbc3c2-870a-4210-b0a5-b08d1bd29554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:02.026638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbc3c2-870a-4210-b0a5-b08d1bd29554 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:02.061869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca743862-71c9-42ba-9766-f07abc81fd8e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-33bbc3c2-870a-4210-b0a5-b08d1bd29554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:02.073724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:02.075649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:02.077584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:02.077584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:02.077584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:02.077584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:02.086110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 228/462] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:02.092991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbc3c2-870a-4210-b0a5-b08d1bd29554 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:02.141569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3ce30-f26b-46a1-9800-4a55a81fe265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:02.142679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ce30-f26b-46a1-9800-4a55a81fe265 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:02.143210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ce30-f26b-46a1-9800-4a55a81fe265 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:02.143701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ce30-f26b-46a1-9800-4a55a81fe265 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:02.145012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3ce30-f26b-46a1-9800-4a55a81fe265 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:02.147982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3ce30-f26b-46a1-9800-4a55a81fe265 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:02.215277 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 235/463] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:39:01 2022] POST /identity/v3/users => generated 247 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:39:02.355337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbc3c2-870a-4210-b0a5-b08d1bd29554 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:02.417530 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7bcc9-d861-4aed-bd74-8c472680c237 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:02.418001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7bcc9-d861-4aed-bd74-8c472680c237 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:02.418487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7bcc9-d861-4aed-bd74-8c472680c237 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:02.421677 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 236/464] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:02 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:39:02.437879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5491-5232-49c9-b8c7-699cd1236660 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:02.438379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5491-5232-49c9-b8c7-699cd1236660 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:02.438867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5491-5232-49c9-b8c7-699cd1236660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:02.460558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d875650-f998-4343-91b0-2fe1fd49500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:02.462011 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d875650-f998-4343-91b0-2fe1fd49500b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:02.464503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d875650-f998-4343-91b0-2fe1fd49500b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:02.468282 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d875650-f998-4343-91b0-2fe1fd49500b None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:02.468909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d875650-f998-4343-91b0-2fe1fd49500b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:02.469581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d875650-f998-4343-91b0-2fe1fd49500b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:02.471992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d875650-f998-4343-91b0-2fe1fd49500b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:02.492267 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-746a5491-5232-49c9-b8c7-699cd1236660 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:02.494496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 229/465] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:02.495594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-746a5491-5232-49c9-b8c7-699cd1236660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:02.505143 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d875650-f998-4343-91b0-2fe1fd49500b None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:02.594775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:02.677289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 237/466] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:39:02.704080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a5491-5232-49c9-b8c7-699cd1236660 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:02.767064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d875650-f998-4343-91b0-2fe1fd49500b None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:02.820355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:02.855833 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48536e54-de45-46ad-a36c-bc4a72d56d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:02.856487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536e54-de45-46ad-a36c-bc4a72d56d3f None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:02.856817 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536e54-de45-46ad-a36c-bc4a72d56d3f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:02.857049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536e54-de45-46ad-a36c-bc4a72d56d3f None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:02.857925 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48536e54-de45-46ad-a36c-bc4a72d56d3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:02.859637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48536e54-de45-46ad-a36c-bc4a72d56d3f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:02.902761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 230/467] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:39:02 2022] POST /identity/v3/users => generated 249 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:39:02.925384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20979a54-773e-4538-92d2-fee9e331dc62 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:02.925852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20979a54-773e-4538-92d2-fee9e331dc62 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:02.925984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20979a54-773e-4538-92d2-fee9e331dc62 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:02.930766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 231/468] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:02 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:02.940656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f8b99-406a-43c0-bfe3-d98d2a488bea None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:02.941142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f8b99-406a-43c0-bfe3-d98d2a488bea None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:02.941627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f8b99-406a-43c0-bfe3-d98d2a488bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:02.976582 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-760f8b99-406a-43c0-bfe3-d98d2a488bea None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:02.978730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-760f8b99-406a-43c0-bfe3-d98d2a488bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:02.979514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a5491-5232-49c9-b8c7-699cd1236660 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:03.089739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c66cc1-32e0-4166-b34a-4de02d0e4b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:03.090887 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c66cc1-32e0-4166-b34a-4de02d0e4b69 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:03.091503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c66cc1-32e0-4166-b34a-4de02d0e4b69 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:03.092225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c66cc1-32e0-4166-b34a-4de02d0e4b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:03.124200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c66cc1-32e0-4166-b34a-4de02d0e4b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:03.127369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c66cc1-32e0-4166-b34a-4de02d0e4b69 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:03.141977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 232/469] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-b3c66cc1-32e0-4166-b34a-4de02d0e4b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:03.160794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:03.163068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:03.164643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:03.164643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:03.164643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:03.164643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:03.169101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 238/470] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:39:03.179919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f8b99-406a-43c0-bfe3-d98d2a488bea None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:03.204610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c66cc1-32e0-4166-b34a-4de02d0e4b69 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:03.226994 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:03.410066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f8b99-406a-43c0-bfe3-d98d2a488bea None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:03.461720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b1a24-929f-40ea-a521-89d7751808f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:03.463177 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b1a24-929f-40ea-a521-89d7751808f9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:03.463585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b1a24-929f-40ea-a521-89d7751808f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:03.464056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b1a24-929f-40ea-a521-89d7751808f9 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:03.465687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b1a24-929f-40ea-a521-89d7751808f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:03.466230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b1a24-929f-40ea-a521-89d7751808f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:03.466791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:03.470038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b1a24-929f-40ea-a521-89d7751808f9 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:03.473205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c66cc1-32e0-4166-b34a-4de02d0e4b69 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:03.494987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 233/471] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:03.496652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd6688-ba1a-40ea-8cf4-5953567b1533 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:03.497116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd6688-ba1a-40ea-8cf4-5953567b1533 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:03.497589 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd6688-ba1a-40ea-8cf4-5953567b1533 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:03.500335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 234/472] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:03 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:03.501662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd6688-ba1a-40ea-8cf4-5953567b1533 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:03.536481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd9c5-dace-4de6-86b3-033e2d51a30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:03.537944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd9c5-dace-4de6-86b3-033e2d51a30a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:03.538454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd9c5-dace-4de6-86b3-033e2d51a30a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:03.538977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd9c5-dace-4de6-86b3-033e2d51a30a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:03.552602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccd9c5-dace-4de6-86b3-033e2d51a30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:03.554553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccd9c5-dace-4de6-86b3-033e2d51a30a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-2bccd9c5-dace-4de6-86b3-033e2d51a30a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:03.573523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:03.574441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:03.575322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:03.575322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:03.575322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:03.575322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:03.577412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 239/473] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:03.582853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38654c-5e6e-44ae-800b-df3e70d7c106 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:03.582853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38654c-5e6e-44ae-800b-df3e70d7c106 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:03.582853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38654c-5e6e-44ae-800b-df3e70d7c106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:03.608586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-fc38654c-5e6e-44ae-800b-df3e70d7c106 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:03.610216 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-fc38654c-5e6e-44ae-800b-df3e70d7c106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:03.694566 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:03.711044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 240/474] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:03.713342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38654c-5e6e-44ae-800b-df3e70d7c106 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:03.725855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd6688-ba1a-40ea-8cf4-5953567b1533 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:03.775995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbdb07-9c0d-4d7b-9c48-36ea59160c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:03.777077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbdb07-9c0d-4d7b-9c48-36ea59160c6d None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:03.777561 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbdb07-9c0d-4d7b-9c48-36ea59160c6d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:03.778022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbdb07-9c0d-4d7b-9c48-36ea59160c6d None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:03.779286 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbdb07-9c0d-4d7b-9c48-36ea59160c6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:03.781152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbdb07-9c0d-4d7b-9c48-36ea59160c6d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:03.812946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 235/475] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:39:03 2022] POST /identity/v3/users => generated 249 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:39:03.814311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbdb07-9c0d-4d7b-9c48-36ea59160c6d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:03.892116 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:03.930053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38654c-5e6e-44ae-800b-df3e70d7c106 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:03.968428 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbdb07-9c0d-4d7b-9c48-36ea59160c6d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:04.003115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507df9a-dd28-429f-8654-5b323e11ffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:04.004378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507df9a-dd28-429f-8654-5b323e11ffab None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:04.005096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507df9a-dd28-429f-8654-5b323e11ffab None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:04.005668 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507df9a-dd28-429f-8654-5b323e11ffab None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:04.007583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507df9a-dd28-429f-8654-5b323e11ffab None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:04.008479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507df9a-dd28-429f-8654-5b323e11ffab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:04.011007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507df9a-dd28-429f-8654-5b323e11ffab None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:04.053713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 241/476] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:04.057311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507df9a-dd28-429f-8654-5b323e11ffab None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:04.081264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5a89-7811-4aa5-9259-bccb1bbf9648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:04.082412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5a89-7811-4aa5-9259-bccb1bbf9648 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:04.082878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5a89-7811-4aa5-9259-bccb1bbf9648 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:04.083452 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5a89-7811-4aa5-9259-bccb1bbf9648 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:04.084899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba5a89-7811-4aa5-9259-bccb1bbf9648 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:04.087938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba5a89-7811-4aa5-9259-bccb1bbf9648 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:04.102083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:04.109522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.sql.core [None req-2eba5a89-7811-4aa5-9259-bccb1bbf9648 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 16:39:04.109522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 16:39:04.109522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [parameters: {'id': '92a83219abb94739a3e52286d3cf92dc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 16:39:04.109522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92121) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-2eba5a89-7811-4aa5-9259-bccb1bbf9648 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result.read() Aug 01 16:39:04.153415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return ref.to_dict() Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:39:04.155163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application yield resource Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise self.value Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application session.commit() Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 16:39:04.156699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.session.flush() Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application compat.raise_( Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 16:39:04.158556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:39:04.160378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result.read() Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:39:04.162269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [parameters: {'id': '92a83219abb94739a3e52286d3cf92dc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:04.164146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 16:39:04.166014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:04.168000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 236/477] 10.222.0.124 () {60 vars in 1136 bytes} [Mon Aug 1 16:39:03 2022] POST /identity/v3/roles => generated 144 bytes in 342 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:04.172272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5a89-7811-4aa5-9259-bccb1bbf9648 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:04.328541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507df9a-dd28-429f-8654-5b323e11ffab None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:04.371908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5a89-7811-4aa5-9259-bccb1bbf9648 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:04.422446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd6e8-d733-4e98-ada4-144a83fa42ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:04.423917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd6e8-d733-4e98-ada4-144a83fa42ab None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:04.424706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd6e8-d733-4e98-ada4-144a83fa42ab None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:04.426023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd6e8-d733-4e98-ada4-144a83fa42ab None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:04.430435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd6e8-d733-4e98-ada4-144a83fa42ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:04.433486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd6e8-d733-4e98-ada4-144a83fa42ab None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:04.498176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06c113-cc79-4204-8f56-5427366b656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:04.498679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:04.499961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06c113-cc79-4204-8f56-5427366b656b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:04.504529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 242/478] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:39:04 2022] POST /identity/v3/users => generated 250 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:39:04.505032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06c113-cc79-4204-8f56-5427366b656b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:04.505539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06c113-cc79-4204-8f56-5427366b656b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:04.537489 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06c113-cc79-4204-8f56-5427366b656b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-4e06c113-cc79-4204-8f56-5427366b656b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:04.548488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:04.550227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:04.552591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 237/479] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:39:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:04.557669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd6e8-d733-4e98-ada4-144a83fa42ab None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:04.801581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd6e8-d733-4e98-ada4-144a83fa42ab None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:04.873004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeba11-7b33-4251-b31a-a539d3a816a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:04.874030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeba11-7b33-4251-b31a-a539d3a816a5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:04.874516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeba11-7b33-4251-b31a-a539d3a816a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:04.875043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeba11-7b33-4251-b31a-a539d3a816a5 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:04.876479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeba11-7b33-4251-b31a-a539d3a816a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:04.877065 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeba11-7b33-4251-b31a-a539d3a816a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:04.879925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeba11-7b33-4251-b31a-a539d3a816a5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:04.897359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 243/480] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:04 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:05.799310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd87068-3e74-49cd-8b57-668240e5f89d None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:05.800344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd87068-3e74-49cd-8b57-668240e5f89d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:05.800835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd87068-3e74-49cd-8b57-668240e5f89d None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:05.803188 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 238/481] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:05 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:05.808867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc29e17-1f48-40ad-a6f4-0ce53d09439e None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:05.809483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc29e17-1f48-40ad-a6f4-0ce53d09439e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:05.809973 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc29e17-1f48-40ad-a6f4-0ce53d09439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:05.838446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-2dc29e17-1f48-40ad-a6f4-0ce53d09439e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:05.840152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2dc29e17-1f48-40ad-a6f4-0ce53d09439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:05.928222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:05.954752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 244/482] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:05.991671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd87068-3e74-49cd-8b57-668240e5f89d None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:06.131667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:06.242913 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd87068-3e74-49cd-8b57-668240e5f89d None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:06.316038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1bb54-d07c-4835-99a4-1a05efb04629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:06.317206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1bb54-d07c-4835-99a4-1a05efb04629 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:06.317708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1bb54-d07c-4835-99a4-1a05efb04629 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:06.318194 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1bb54-d07c-4835-99a4-1a05efb04629 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:06.340091 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1bb54-d07c-4835-99a4-1a05efb04629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-69b1bb54-d07c-4835-99a4-1a05efb04629 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:06.350380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:06.351379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:06.352244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:06.353073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 239/483] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:06.362549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc29e17-1f48-40ad-a6f4-0ce53d09439e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:06.452170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b564e58-cd83-44ac-82b0-988a923942a5 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:06.452568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b564e58-cd83-44ac-82b0-988a923942a5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:06.453058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b564e58-cd83-44ac-82b0-988a923942a5 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:06.456141 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 240/484] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:06 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:06.466534 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3a8e4-f3a7-438d-b581-31b49ec5cf46 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:06.467086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3a8e4-f3a7-438d-b581-31b49ec5cf46 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:06.467582 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3a8e4-f3a7-438d-b581-31b49ec5cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:06.546092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-fbd3a8e4-f3a7-438d-b581-31b49ec5cf46 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:06.548370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fbd3a8e4-f3a7-438d-b581-31b49ec5cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:06.693061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc29e17-1f48-40ad-a6f4-0ce53d09439e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:06.779193 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 241/485] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:06.800331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f9a16-3e0f-4bf5-808a-79ed8fd66b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:06.801437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9a16-3e0f-4bf5-808a-79ed8fd66b28 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:06.801965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9a16-3e0f-4bf5-808a-79ed8fd66b28 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:06.802465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9a16-3e0f-4bf5-808a-79ed8fd66b28 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:06.803908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f9a16-3e0f-4bf5-808a-79ed8fd66b28 None admin] RBAC: Adding query filter params (name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:06.804459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f9a16-3e0f-4bf5-808a-79ed8fd66b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:06.807180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f9a16-3e0f-4bf5-808a-79ed8fd66b28 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:06.820738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3a8e4-f3a7-438d-b581-31b49ec5cf46 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:06.833876 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 245/486] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:06.843512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f9a16-3e0f-4bf5-808a-79ed8fd66b28 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:06.945102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:07.047622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:07.080752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3a8e4-f3a7-438d-b581-31b49ec5cf46 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:07.187719 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ea4ac-1e93-4366-918d-2a7c7ad39fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:07.188985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ea4ac-1e93-4366-918d-2a7c7ad39fe2 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:07.189541 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ea4ac-1e93-4366-918d-2a7c7ad39fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:07.190112 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ea4ac-1e93-4366-918d-2a7c7ad39fe2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:07.220319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f9a16-3e0f-4bf5-808a-79ed8fd66b28 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:07.227049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ea4ac-1e93-4366-918d-2a7c7ad39fe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-7f7ea4ac-1e93-4366-918d-2a7c7ad39fe2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:07.241219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:07.243251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:07.245303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:07.248399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 242/487] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:39:07.251456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ea4ac-1e93-4366-918d-2a7c7ad39fe2 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:07.300379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d1a12-941c-4f3c-a477-f3b6989b1e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:07.301991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d1a12-941c-4f3c-a477-f3b6989b1e6b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:07.302796 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d1a12-941c-4f3c-a477-f3b6989b1e6b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:07.303539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d1a12-941c-4f3c-a477-f3b6989b1e6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:07.330546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d1a12-941c-4f3c-a477-f3b6989b1e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:07.335081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d1a12-941c-4f3c-a477-f3b6989b1e6b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-5a5d1a12-941c-4f3c-a477-f3b6989b1e6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:07.358103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:07.359775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:07.360640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:07.360640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:07.360640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:07.360640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:07.361588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 246/488] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 519 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:39:07.364302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d802ac2-25ed-465c-a6e8-e0f2b2ecb696 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:07.365042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d802ac2-25ed-465c-a6e8-e0f2b2ecb696 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:07.365706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d802ac2-25ed-465c-a6e8-e0f2b2ecb696 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:07.369401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 247/489] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:07 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:07.371550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d802ac2-25ed-465c-a6e8-e0f2b2ecb696 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:07.465644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ea4ac-1e93-4366-918d-2a7c7ad39fe2 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:07.491783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:07.532049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c417fe-4f76-4bdc-b23d-575c36f7ff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:07.533114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c417fe-4f76-4bdc-b23d-575c36f7ff1b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:07.533593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c417fe-4f76-4bdc-b23d-575c36f7ff1b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:07.534058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c417fe-4f76-4bdc-b23d-575c36f7ff1b None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:07.535044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c417fe-4f76-4bdc-b23d-575c36f7ff1b None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:07.535574 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c417fe-4f76-4bdc-b23d-575c36f7ff1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:07.538211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c417fe-4f76-4bdc-b23d-575c36f7ff1b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:07.549353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 243/490] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:39:07.551242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a272a3c-163b-4fc0-a384-1beab879bbc1 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:07.551870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a272a3c-163b-4fc0-a384-1beab879bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:07.552351 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a272a3c-163b-4fc0-a384-1beab879bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:07.574035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-0a272a3c-163b-4fc0-a384-1beab879bbc1 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:07.575667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0a272a3c-163b-4fc0-a384-1beab879bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:07.588357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d802ac2-25ed-465c-a6e8-e0f2b2ecb696 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:07.594829 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:07.649722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf83aa9-cbd2-4a5a-8486-e89c8702fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:07.651123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83aa9-cbd2-4a5a-8486-e89c8702fa96 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:07.651645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83aa9-cbd2-4a5a-8486-e89c8702fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:07.652128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83aa9-cbd2-4a5a-8486-e89c8702fa96 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:07.653161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf83aa9-cbd2-4a5a-8486-e89c8702fa96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:07.653675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf83aa9-cbd2-4a5a-8486-e89c8702fa96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:07.655500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf83aa9-cbd2-4a5a-8486-e89c8702fa96 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:07.676964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 248/491] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:07.677891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf83aa9-cbd2-4a5a-8486-e89c8702fa96 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:07.679194 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 244/492] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:07.685541 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a272a3c-163b-4fc0-a384-1beab879bbc1 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:07.822499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf83aa9-cbd2-4a5a-8486-e89c8702fa96 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:07.867460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c308a-44d8-49b6-b575-ba670699a2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:07.868134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c308a-44d8-49b6-b575-ba670699a2b5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:07.868579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c308a-44d8-49b6-b575-ba670699a2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:07.868826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c308a-44d8-49b6-b575-ba670699a2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:07.881473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:07.882664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c308a-44d8-49b6-b575-ba670699a2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:07.884249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c308a-44d8-49b6-b575-ba670699a2b5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:07.886765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a272a3c-163b-4fc0-a384-1beab879bbc1 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-7a9c308a-44d8-49b6-b575-ba670699a2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:07.905307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:07.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:07.909079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:07.909079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:07.909079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:07.909079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:07.909079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 249/493] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:07.909079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c308a-44d8-49b6-b575-ba670699a2b5 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:07.936128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a8663-9b46-4c31-bbd5-efe42d1955d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:07.936472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:07.936795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8663-9b46-4c31-bbd5-efe42d1955d8 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:07.937079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8663-9b46-4c31-bbd5-efe42d1955d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:07.937356 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8663-9b46-4c31-bbd5-efe42d1955d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:07.945777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a8663-9b46-4c31-bbd5-efe42d1955d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:07.947297 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a8663-9b46-4c31-bbd5-efe42d1955d8 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-ee1a8663-9b46-4c31-bbd5-efe42d1955d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:07.961673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:07.963439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:07.964554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:07.964554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:07.964554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:07.964554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:07.964554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:07.964554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:07.964554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:07.964554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:07.964554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:07.964554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:07.964554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 245/494] 10.222.0.124 () {56 vars in 1098 bytes} [Mon Aug 1 16:39:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:07.965433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002c92a-c126-49e1-a281-c0c3ebfc1ab5 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:07.965433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002c92a-c126-49e1-a281-c0c3ebfc1ab5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:07.965433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002c92a-c126-49e1-a281-c0c3ebfc1ab5 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:07.966896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 246/495] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:07.967467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002c92a-c126-49e1-a281-c0c3ebfc1ab5 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:08.044906 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c308a-44d8-49b6-b575-ba670699a2b5 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:08.085951 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a691f7-5da2-40ec-94f1-ec9786071698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:08.086746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a691f7-5da2-40ec-94f1-ec9786071698 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:08.086746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a691f7-5da2-40ec-94f1-ec9786071698 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:08.087474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a691f7-5da2-40ec-94f1-ec9786071698 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:08.094791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002c92a-c126-49e1-a281-c0c3ebfc1ab5 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:08.105261 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a691f7-5da2-40ec-94f1-ec9786071698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d8a691f7-5da2-40ec-94f1-ec9786071698 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:08.115833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:08.117252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:08.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 250/496] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:08.120531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabce2d8-17f3-4ac9-a5b7-26a6208b8cf6 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:08.120978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabce2d8-17f3-4ac9-a5b7-26a6208b8cf6 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:08.121446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabce2d8-17f3-4ac9-a5b7-26a6208b8cf6 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:08.123894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 251/497] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:08.125920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabce2d8-17f3-4ac9-a5b7-26a6208b8cf6 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:08.142767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73577679-8b4d-4fc0-83ef-71166dce5b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:08.143497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577679-8b4d-4fc0-83ef-71166dce5b0b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:08.143785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577679-8b4d-4fc0-83ef-71166dce5b0b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:08.144064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577679-8b4d-4fc0-83ef-71166dce5b0b None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:08.144825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73577679-8b4d-4fc0-83ef-71166dce5b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:08.145198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73577679-8b4d-4fc0-83ef-71166dce5b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:08.147630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73577679-8b4d-4fc0-83ef-71166dce5b0b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:08.164494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 247/498] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:08.167723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c068a-3045-4925-99ec-f08ceb4a2b79 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:08.168166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c068a-3045-4925-99ec-f08ceb4a2b79 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:08.168556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c068a-3045-4925-99ec-f08ceb4a2b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:08.197200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-9b6c068a-3045-4925-99ec-f08ceb4a2b79 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:08.199179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9b6c068a-3045-4925-99ec-f08ceb4a2b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:08.218582 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:08.250623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:08.281461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabce2d8-17f3-4ac9-a5b7-26a6208b8cf6 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:08.293719 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 248/499] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:08.294835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c068a-3045-4925-99ec-f08ceb4a2b79 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:08.355678 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23452f-ffb1-49ce-9acf-6230985ce2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:08.356336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23452f-ffb1-49ce-9acf-6230985ce2a2 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:08.356694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23452f-ffb1-49ce-9acf-6230985ce2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:08.357036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23452f-ffb1-49ce-9acf-6230985ce2a2 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:08.358076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23452f-ffb1-49ce-9acf-6230985ce2a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:08.358506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23452f-ffb1-49ce-9acf-6230985ce2a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:08.360719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23452f-ffb1-49ce-9acf-6230985ce2a2 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:08.419697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 252/500] 10.222.0.124 () {56 vars in 1138 bytes} [Mon Aug 1 16:39:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:08.422495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6338a-5dff-4d4e-a03b-e43d23502890 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:08.422980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6338a-5dff-4d4e-a03b-e43d23502890 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:08.423459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6338a-5dff-4d4e-a03b-e43d23502890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:08.433447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c068a-3045-4925-99ec-f08ceb4a2b79 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:08.449321 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-feb6338a-5dff-4d4e-a03b-e43d23502890 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:08.450603 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-feb6338a-5dff-4d4e-a03b-e43d23502890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:08.480676 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204b25c-68e8-4577-9fce-d30007d1eeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:08.481511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b25c-68e8-4577-9fce-d30007d1eeef None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:08.481881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b25c-68e8-4577-9fce-d30007d1eeef None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:08.482242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b25c-68e8-4577-9fce-d30007d1eeef None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:08.483171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204b25c-68e8-4577-9fce-d30007d1eeef None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:08.483569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204b25c-68e8-4577-9fce-d30007d1eeef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:08.485291 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204b25c-68e8-4577-9fce-d30007d1eeef None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:08.502450 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 249/501] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:08 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:08.504008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204b25c-68e8-4577-9fce-d30007d1eeef None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:08.524634 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:08.554062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 253/502] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:08.554735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6338a-5dff-4d4e-a03b-e43d23502890 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:08.652514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204b25c-68e8-4577-9fce-d30007d1eeef None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:08.671455 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:08.701927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93794-6023-4b7e-b132-827189539556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:08.703106 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93794-6023-4b7e-b132-827189539556 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:08.703626 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93794-6023-4b7e-b132-827189539556 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:08.704127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93794-6023-4b7e-b132-827189539556 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:08.718068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6338a-5dff-4d4e-a03b-e43d23502890 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:08.719343 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93794-6023-4b7e-b132-827189539556 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:08.722730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93794-6023-4b7e-b132-827189539556 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-e0b93794-6023-4b7e-b132-827189539556 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:08.741000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:08.744538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 250/503] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:08.746471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93794-6023-4b7e-b132-827189539556 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:08.777019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f33fa5-67e2-4b45-92f8-48943561ed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:08.779118 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f33fa5-67e2-4b45-92f8-48943561ed31 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:08.779601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f33fa5-67e2-4b45-92f8-48943561ed31 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:08.780086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f33fa5-67e2-4b45-92f8-48943561ed31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:08.800877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f33fa5-67e2-4b45-92f8-48943561ed31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-61f33fa5-67e2-4b45-92f8-48943561ed31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:08.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:08.812885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 254/504] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:08.814472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f33fa5-67e2-4b45-92f8-48943561ed31 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:08.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:08.899296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93794-6023-4b7e-b132-827189539556 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:08.952258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f33fa5-67e2-4b45-92f8-48943561ed31 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:08.955884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fb6a7-4c6e-4ecb-8581-9f2fb7120240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:08.956988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb6a7-4c6e-4ecb-8581-9f2fb7120240 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:08.957446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb6a7-4c6e-4ecb-8581-9f2fb7120240 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:08.958076 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb6a7-4c6e-4ecb-8581-9f2fb7120240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:08.986021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:09.010934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bb883-e494-4999-99ff-b66d949e6232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:09.011635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bb883-e494-4999-99ff-b66d949e6232 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:09.011918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bb883-e494-4999-99ff-b66d949e6232 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:09.012193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bb883-e494-4999-99ff-b66d949e6232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:09.031937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bb883-e494-4999-99ff-b66d949e6232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:09.034766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bb883-e494-4999-99ff-b66d949e6232 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d08bb883-e494-4999-99ff-b66d949e6232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:09.062262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:09.064357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:09.065926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:09.065926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:09.065926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:09.065926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:09.065926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 255/505] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:09.065926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bb883-e494-4999-99ff-b66d949e6232 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:09.074380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fb6a7-4c6e-4ecb-8581-9f2fb7120240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:09.075979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fb6a7-4c6e-4ecb-8581-9f2fb7120240 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:09.197781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:09.246712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 251/506] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:09.247675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fb6a7-4c6e-4ecb-8581-9f2fb7120240 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:09.274104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bb883-e494-4999-99ff-b66d949e6232 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:09.346089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b338-850c-4dfb-ab16-f58044133b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:09.347269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b338-850c-4dfb-ab16-f58044133b3a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:09.347774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b338-850c-4dfb-ab16-f58044133b3a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:09.348344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b338-850c-4dfb-ab16-f58044133b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:09.364826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6b338-850c-4dfb-ab16-f58044133b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:09.366436 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6b338-850c-4dfb-ab16-f58044133b3a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-cda6b338-850c-4dfb-ab16-f58044133b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:09.390814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:09.392742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:09.394315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:09.394315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:09.394315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:09.394315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:09.394315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 256/507] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:09.394315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b338-850c-4dfb-ab16-f58044133b3a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:09.433893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fb6a7-4c6e-4ecb-8581-9f2fb7120240 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:09.447605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:09.502570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93beee-4561-4580-8d59-545c1da28cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:09.503560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93beee-4561-4580-8d59-545c1da28cca None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:09.504035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93beee-4561-4580-8d59-545c1da28cca None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:09.505168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93beee-4561-4580-8d59-545c1da28cca None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:09.506735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93beee-4561-4580-8d59-545c1da28cca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:09.507291 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93beee-4561-4580-8d59-545c1da28cca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:09.510052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93beee-4561-4580-8d59-545c1da28cca None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:09.572428 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b338-850c-4dfb-ab16-f58044133b3a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:09.601596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 252/508] 10.222.0.124 () {56 vars in 1142 bytes} [Mon Aug 1 16:39:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:09.603159 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93beee-4561-4580-8d59-545c1da28cca None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:09.627338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e1a4c-6d1a-4b0b-ac5f-777eb84a35bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:09.628313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e1a4c-6d1a-4b0b-ac5f-777eb84a35bf None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:09.628756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e1a4c-6d1a-4b0b-ac5f-777eb84a35bf None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:09.629206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e1a4c-6d1a-4b0b-ac5f-777eb84a35bf None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:09.630628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e1a4c-6d1a-4b0b-ac5f-777eb84a35bf None admin] RBAC: Adding query filter params (name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:09.631202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e1a4c-6d1a-4b0b-ac5f-777eb84a35bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:09.633702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e1a4c-6d1a-4b0b-ac5f-777eb84a35bf None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:09.648948 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 257/509] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:09 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:09.650428 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e1a4c-6d1a-4b0b-ac5f-777eb84a35bf None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:09.661263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:09.783937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93beee-4561-4580-8d59-545c1da28cca None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:09.817949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:09.836360 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e1a4c-6d1a-4b0b-ac5f-777eb84a35bf None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:09.839884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb0cbf-59ed-4f51-b6cd-759824104006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:09.840898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb0cbf-59ed-4f51-b6cd-759824104006 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:09.841361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb0cbf-59ed-4f51-b6cd-759824104006 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:09.841813 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb0cbf-59ed-4f51-b6cd-759824104006 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:09.843093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb0cbf-59ed-4f51-b6cd-759824104006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:09.843619 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb0cbf-59ed-4f51-b6cd-759824104006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:09.846091 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb0cbf-59ed-4f51-b6cd-759824104006 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:09.869287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 253/510] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:09.870297 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb0cbf-59ed-4f51-b6cd-759824104006 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:09.898625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d67bf-48f7-4c9f-b0eb-f395c5c453f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:09.900520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d67bf-48f7-4c9f-b0eb-f395c5c453f6 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:09.900857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d67bf-48f7-4c9f-b0eb-f395c5c453f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:09.901298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d67bf-48f7-4c9f-b0eb-f395c5c453f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:09.925814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d67bf-48f7-4c9f-b0eb-f395c5c453f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:09.928972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d67bf-48f7-4c9f-b0eb-f395c5c453f6 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-cc4d67bf-48f7-4c9f-b0eb-f395c5c453f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:09.949009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:09.951135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:09.952850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:09.952850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:09.952850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:09.952850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:09.952850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 258/511] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:09.952850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d67bf-48f7-4c9f-b0eb-f395c5c453f6 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:10.042692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:10.063633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb0cbf-59ed-4f51-b6cd-759824104006 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:10.133523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d67bf-48f7-4c9f-b0eb-f395c5c453f6 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:10.134995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955670ce-852c-474b-afa6-f9a94dbae831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:10.136322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955670ce-852c-474b-afa6-f9a94dbae831 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:10.136823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955670ce-852c-474b-afa6-f9a94dbae831 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:10.137308 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955670ce-852c-474b-afa6-f9a94dbae831 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:10.139289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955670ce-852c-474b-afa6-f9a94dbae831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:10.139826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955670ce-852c-474b-afa6-f9a94dbae831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:10.142532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955670ce-852c-474b-afa6-f9a94dbae831 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:10.171839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 254/512] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:10.173237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955670ce-852c-474b-afa6-f9a94dbae831 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:10.186793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f655-ecee-4e53-a768-1a674ecd7f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:10.187720 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f655-ecee-4e53-a768-1a674ecd7f2a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:10.188072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f655-ecee-4e53-a768-1a674ecd7f2a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:10.188408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f655-ecee-4e53-a768-1a674ecd7f2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:10.212638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:10.308662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f655-ecee-4e53-a768-1a674ecd7f2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:10.311788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f655-ecee-4e53-a768-1a674ecd7f2a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:10.353085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955670ce-852c-474b-afa6-f9a94dbae831 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:10.411224 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfb8c9-e1a2-43fc-a9b3-f29fb39ea18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:10.412329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb8c9-e1a2-43fc-a9b3-f29fb39ea18d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:10.412780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb8c9-e1a2-43fc-a9b3-f29fb39ea18d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:10.413228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb8c9-e1a2-43fc-a9b3-f29fb39ea18d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:10.431598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfb8c9-e1a2-43fc-a9b3-f29fb39ea18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:10.434172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfb8c9-e1a2-43fc-a9b3-f29fb39ea18d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-11dfb8c9-e1a2-43fc-a9b3-f29fb39ea18d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:10.460340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:10.469711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:10.471386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:10.471386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:10.471386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:10.471386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:10.471776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 259/513] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:10.471893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 255/514] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:10.472003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f655-ecee-4e53-a768-1a674ecd7f2a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:10.472123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfb8c9-e1a2-43fc-a9b3-f29fb39ea18d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:10.472819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:10.529968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:10.612629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f655-ecee-4e53-a768-1a674ecd7f2a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:10.618139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfb8c9-e1a2-43fc-a9b3-f29fb39ea18d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:10.668159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a748dbf-4f60-4b32-8a26-51e7bb49c76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:10.669025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748dbf-4f60-4b32-8a26-51e7bb49c76f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:10.669390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748dbf-4f60-4b32-8a26-51e7bb49c76f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:10.669747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748dbf-4f60-4b32-8a26-51e7bb49c76f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:10.672435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ae91d-4850-4aeb-86ad-21c8fb9aa495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:10.673179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ae91d-4850-4aeb-86ad-21c8fb9aa495 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:10.673528 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ae91d-4850-4aeb-86ad-21c8fb9aa495 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:10.673981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ae91d-4850-4aeb-86ad-21c8fb9aa495 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:10.674918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ae91d-4850-4aeb-86ad-21c8fb9aa495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:10.675331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ae91d-4850-4aeb-86ad-21c8fb9aa495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:10.677017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ae91d-4850-4aeb-86ad-21c8fb9aa495 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:10.680631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a748dbf-4f60-4b32-8a26-51e7bb49c76f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:10.683596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a748dbf-4f60-4b32-8a26-51e7bb49c76f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:10.704256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 256/515] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:10.704256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ae91d-4850-4aeb-86ad-21c8fb9aa495 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-8a748dbf-4f60-4b32-8a26-51e7bb49c76f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:10.707610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:10.708763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:10.709740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:10.709740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:10.709740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:10.709740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:10.709740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:10.709740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:10.709740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:10.709740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:10.709740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:39:10.709740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:10.709740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 260/516] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:10.711460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a748dbf-4f60-4b32-8a26-51e7bb49c76f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:10.800033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:10.851045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ae91d-4850-4aeb-86ad-21c8fb9aa495 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:10.859370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a748dbf-4f60-4b32-8a26-51e7bb49c76f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:10.861289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:10.889926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7e14b-52aa-4bd2-bdf1-ea77e86fcd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:10.890474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7e14b-52aa-4bd2-bdf1-ea77e86fcd54 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:10.890756 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7e14b-52aa-4bd2-bdf1-ea77e86fcd54 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:10.891071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7e14b-52aa-4bd2-bdf1-ea77e86fcd54 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:10.891780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7e14b-52aa-4bd2-bdf1-ea77e86fcd54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:10.893277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7e14b-52aa-4bd2-bdf1-ea77e86fcd54 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:10.899844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53176e-2d04-4842-9d03-73af42cd371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:10.900491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53176e-2d04-4842-9d03-73af42cd371e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:10.900891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53176e-2d04-4842-9d03-73af42cd371e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:10.901247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53176e-2d04-4842-9d03-73af42cd371e None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:10.902056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53176e-2d04-4842-9d03-73af42cd371e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:10.902371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53176e-2d04-4842-9d03-73af42cd371e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:10.903858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53176e-2d04-4842-9d03-73af42cd371e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:10.918373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 257/517] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:39:10 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:39:10.919301 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7e14b-52aa-4bd2-bdf1-ea77e86fcd54 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:10.926790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 261/518] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:10.926790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53176e-2d04-4842-9d03-73af42cd371e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:11.087791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53176e-2d04-4842-9d03-73af42cd371e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:11.106244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7e14b-52aa-4bd2-bdf1-ea77e86fcd54 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:11.131764 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:11.141337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b2018-c3e5-4eb3-a1e9-9f89ce29a817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:11.142765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2018-c3e5-4eb3-a1e9-9f89ce29a817 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:11.143264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2018-c3e5-4eb3-a1e9-9f89ce29a817 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:11.143707 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2018-c3e5-4eb3-a1e9-9f89ce29a817 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:11.158156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b2018-c3e5-4eb3-a1e9-9f89ce29a817 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:11.160081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b2018-c3e5-4eb3-a1e9-9f89ce29a817 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:11.168100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca64cb-a7c5-45fc-969a-e9430c9ac562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:11.169211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca64cb-a7c5-45fc-969a-e9430c9ac562 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:11.169669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca64cb-a7c5-45fc-969a-e9430c9ac562 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:11.170118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca64cb-a7c5-45fc-969a-e9430c9ac562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-060b2018-c3e5-4eb3-a1e9-9f89ce29a817 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:11.182794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:11.184497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:11.186644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:11.186644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:11.186644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:11.186644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:11.186644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:11.186644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:11.186644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:11.186644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:11.186644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 262/519] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:11.186644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b2018-c3e5-4eb3-a1e9-9f89ce29a817 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:11.194521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca64cb-a7c5-45fc-969a-e9430c9ac562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:11.197147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca64cb-a7c5-45fc-969a-e9430c9ac562 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-4fca64cb-a7c5-45fc-969a-e9430c9ac562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:11.226045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:11.227900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:11.229641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:11.229641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:11.229641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:11.229641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:11.229641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 258/520] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:11.229641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca64cb-a7c5-45fc-969a-e9430c9ac562 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:11.231878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:11.348148 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b2018-c3e5-4eb3-a1e9-9f89ce29a817 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:11.405775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca64cb-a7c5-45fc-969a-e9430c9ac562 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:11.405971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba379b7c-c275-4501-8208-defc13d2803e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:11.407153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba379b7c-c275-4501-8208-defc13d2803e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:11.407587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba379b7c-c275-4501-8208-defc13d2803e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:11.408011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba379b7c-c275-4501-8208-defc13d2803e None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:11.409545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba379b7c-c275-4501-8208-defc13d2803e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:11.410015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba379b7c-c275-4501-8208-defc13d2803e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:11.413149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba379b7c-c275-4501-8208-defc13d2803e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:11.449141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 263/521] 10.222.0.124 () {56 vars in 1142 bytes} [Mon Aug 1 16:39:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:11.450735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba379b7c-c275-4501-8208-defc13d2803e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:11.481890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083e80b-b8f9-4616-85ab-4a4fb62bebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:11.483207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083e80b-b8f9-4616-85ab-4a4fb62bebbb None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:11.483485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083e80b-b8f9-4616-85ab-4a4fb62bebbb None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:11.483766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083e80b-b8f9-4616-85ab-4a4fb62bebbb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:11.497056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083e80b-b8f9-4616-85ab-4a4fb62bebbb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:11.498692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083e80b-b8f9-4616-85ab-4a4fb62bebbb None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-3083e80b-b8f9-4616-85ab-4a4fb62bebbb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:11.519637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:11.521938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 259/522] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:11.524753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083e80b-b8f9-4616-85ab-4a4fb62bebbb None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:11.591867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:11.607159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:11.637245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba379b7c-c275-4501-8208-defc13d2803e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:11.704110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f536ac-21b9-4458-a945-1a6fb4bdb747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:11.705081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f536ac-21b9-4458-a945-1a6fb4bdb747 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:11.705812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f536ac-21b9-4458-a945-1a6fb4bdb747 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:11.706300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f536ac-21b9-4458-a945-1a6fb4bdb747 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:11.708402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f536ac-21b9-4458-a945-1a6fb4bdb747 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:11.708978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f536ac-21b9-4458-a945-1a6fb4bdb747 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:11.712141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f536ac-21b9-4458-a945-1a6fb4bdb747 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:11.736456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083e80b-b8f9-4616-85ab-4a4fb62bebbb None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:11.763974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 264/523] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:11.766071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f536ac-21b9-4458-a945-1a6fb4bdb747 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:11.783197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae59b4-1f7b-43ba-8bf3-dbf4bcb88ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:11.784033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae59b4-1f7b-43ba-8bf3-dbf4bcb88ac1 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:11.784331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae59b4-1f7b-43ba-8bf3-dbf4bcb88ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:11.784673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae59b4-1f7b-43ba-8bf3-dbf4bcb88ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:11.785682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae59b4-1f7b-43ba-8bf3-dbf4bcb88ac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:11.786038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae59b4-1f7b-43ba-8bf3-dbf4bcb88ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:11.787982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae59b4-1f7b-43ba-8bf3-dbf4bcb88ac1 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:11.806201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 260/524] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:11.807822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae59b4-1f7b-43ba-8bf3-dbf4bcb88ac1 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:11.947412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:11.966106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f536ac-21b9-4458-a945-1a6fb4bdb747 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:11.966581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae59b4-1f7b-43ba-8bf3-dbf4bcb88ac1 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:12.010048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f569ca-f52e-4701-b5a3-53d5ad69ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:12.010709 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f569ca-f52e-4701-b5a3-53d5ad69ab28 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:12.011024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f569ca-f52e-4701-b5a3-53d5ad69ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:12.011311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f569ca-f52e-4701-b5a3-53d5ad69ab28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:12.025760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:12.035935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d209d-c309-43db-b7d0-02524848519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:12.036987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d209d-c309-43db-b7d0-02524848519e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:12.037277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d209d-c309-43db-b7d0-02524848519e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:12.037564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d209d-c309-43db-b7d0-02524848519e None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:12.038420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d209d-c309-43db-b7d0-02524848519e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:12.038741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d209d-c309-43db-b7d0-02524848519e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:12.040283 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d209d-c309-43db-b7d0-02524848519e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:12.070825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 261/525] 10.222.0.124 () {56 vars in 1144 bytes} [Mon Aug 1 16:39:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:12.070825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d209d-c309-43db-b7d0-02524848519e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:12.140596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f569ca-f52e-4701-b5a3-53d5ad69ab28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:12.143417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f569ca-f52e-4701-b5a3-53d5ad69ab28 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:12.216066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d209d-c309-43db-b7d0-02524848519e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:12.280757 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609311de-29dd-46fd-9c67-4debbb6ac972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:12.281755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609311de-29dd-46fd-9c67-4debbb6ac972 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:12.282225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609311de-29dd-46fd-9c67-4debbb6ac972 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:12.282694 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609311de-29dd-46fd-9c67-4debbb6ac972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:12.283887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609311de-29dd-46fd-9c67-4debbb6ac972 None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=9728f2fe7b5a40cd9f8ead5cf99af581) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:12.284416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609311de-29dd-46fd-9c67-4debbb6ac972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:12.288055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609311de-29dd-46fd-9c67-4debbb6ac972 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:12.297656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 262/526] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:12 2022] GET /identity/v3/role_assignments?user.id=9728f2fe7b5a40cd9f8ead5cf99af581&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:12.299537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609311de-29dd-46fd-9c67-4debbb6ac972 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:12.332263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:12.366488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 265/527] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:12.369567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f569ca-f52e-4701-b5a3-53d5ad69ab28 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:12.458408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:12.493871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609311de-29dd-46fd-9c67-4debbb6ac972 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:12.547190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e473-49da-463b-924e-493fedee4914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:12.547964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e473-49da-463b-924e-493fedee4914 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:12.548915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e473-49da-463b-924e-493fedee4914 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:12.549247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e473-49da-463b-924e-493fedee4914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:12.560318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6e473-49da-463b-924e-493fedee4914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:12.561925 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6e473-49da-463b-924e-493fedee4914 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-72f6e473-49da-463b-924e-493fedee4914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:12.585586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:12.588247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:12.589961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:12.589961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:12.589961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:12.589961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:12.589961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:12.589961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:12.589961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:12.589961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:12.590714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f569ca-f52e-4701-b5a3-53d5ad69ab28 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:12.595288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 263/528] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:12.597396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e473-49da-463b-924e-493fedee4914 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:12.637183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684c264-6900-4592-b927-5d36109a4f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:12.637841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c264-6900-4592-b927-5d36109a4f1f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:12.638122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c264-6900-4592-b927-5d36109a4f1f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:12.638397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c264-6900-4592-b927-5d36109a4f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:12.738784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684c264-6900-4592-b927-5d36109a4f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:12.739908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:12.742207 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684c264-6900-4592-b927-5d36109a4f1f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:12.793101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e473-49da-463b-924e-493fedee4914 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:12.842654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef380-4dce-4be8-aeb1-36080be1b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:12.843265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef380-4dce-4be8-aeb1-36080be1b170 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:12.843551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef380-4dce-4be8-aeb1-36080be1b170 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:12.843830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef380-4dce-4be8-aeb1-36080be1b170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:12.845354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:12.860355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ef380-4dce-4be8-aeb1-36080be1b170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:12.861937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ef380-4dce-4be8-aeb1-36080be1b170 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-7a3ef380-4dce-4be8-aeb1-36080be1b170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:12.883978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:12.886063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:12.888069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:12.888069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:12.888069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:12.888069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:12.888069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 264/529] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:12.888069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef380-4dce-4be8-aeb1-36080be1b170 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:12.954363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 266/530] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:12.956496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684c264-6900-4592-b927-5d36109a4f1f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:13.118974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef380-4dce-4be8-aeb1-36080be1b170 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:13.177463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684c264-6900-4592-b927-5d36109a4f1f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:13.180436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:13.205671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ebfcf-b794-4108-ae2f-56b9e8308e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:13.206718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ebfcf-b794-4108-ae2f-56b9e8308e35 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:13.207366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ebfcf-b794-4108-ae2f-56b9e8308e35 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:13.208374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ebfcf-b794-4108-ae2f-56b9e8308e35 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:13.210043 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ebfcf-b794-4108-ae2f-56b9e8308e35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:13.210601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ebfcf-b794-4108-ae2f-56b9e8308e35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:13.213974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ebfcf-b794-4108-ae2f-56b9e8308e35 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:13.266500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 265/531] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:13.266500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ebfcf-b794-4108-ae2f-56b9e8308e35 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:13.268616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1af896-5844-48ae-8492-15b649c61e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:13.269414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1af896-5844-48ae-8492-15b649c61e53 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:13.269965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1af896-5844-48ae-8492-15b649c61e53 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:13.270449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1af896-5844-48ae-8492-15b649c61e53 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:13.271832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1af896-5844-48ae-8492-15b649c61e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:13.272371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1af896-5844-48ae-8492-15b649c61e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:13.275476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1af896-5844-48ae-8492-15b649c61e53 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:13.296799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:13.311268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 267/532] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:13.313783 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1af896-5844-48ae-8492-15b649c61e53 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:13.521114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ebfcf-b794-4108-ae2f-56b9e8308e35 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:13.555128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1af896-5844-48ae-8492-15b649c61e53 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:13.602384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e980db-a47c-409a-b0ea-492c0ac61cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:13.603936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e980db-a47c-409a-b0ea-492c0ac61cb3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:13.604433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e980db-a47c-409a-b0ea-492c0ac61cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:13.604928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e980db-a47c-409a-b0ea-492c0ac61cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:13.631016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e980db-a47c-409a-b0ea-492c0ac61cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:13.633306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e980db-a47c-409a-b0ea-492c0ac61cb3 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:13.635245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d79d6-67a3-47c6-a944-d050eb36a4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:13.636479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d79d6-67a3-47c6-a944-d050eb36a4c5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:13.637379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d79d6-67a3-47c6-a944-d050eb36a4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:13.637842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d79d6-67a3-47c6-a944-d050eb36a4c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:13.639838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d79d6-67a3-47c6-a944-d050eb36a4c5 None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=b1cabb41d38a40acb7d41c169cc90cb7) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:13.640329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d79d6-67a3-47c6-a944-d050eb36a4c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:13.643433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d79d6-67a3-47c6-a944-d050eb36a4c5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:13.662694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 268/533] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:13 2022] GET /identity/v3/role_assignments?user.id=b1cabb41d38a40acb7d41c169cc90cb7&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 260 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:13.664576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d79d6-67a3-47c6-a944-d050eb36a4c5 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-e1e980db-a47c-409a-b0ea-492c0ac61cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:13.666400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:13.667834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:13.669243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:13.669243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:13.669243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:13.669243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:13.672196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 266/534] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:13.681819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e980db-a47c-409a-b0ea-492c0ac61cb3 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:13.783759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:13.870210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:13.928368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e980db-a47c-409a-b0ea-492c0ac61cb3 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:13.948784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d79d6-67a3-47c6-a944-d050eb36a4c5 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:13.981762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc7cbf-737c-46c4-9830-906b90366f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:13.982442 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7cbf-737c-46c4-9830-906b90366f4a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:13.982684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7cbf-737c-46c4-9830-906b90366f4a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:13.982990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7cbf-737c-46c4-9830-906b90366f4a None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:13.983717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc7cbf-737c-46c4-9830-906b90366f4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:13.984022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc7cbf-737c-46c4-9830-906b90366f4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:13.985461 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc7cbf-737c-46c4-9830-906b90366f4a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:14.000114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 267/535] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:14.001592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362b15-cbd9-4108-a4b8-36009709a099 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:14.001902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362b15-cbd9-4108-a4b8-36009709a099 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:14.002156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362b15-cbd9-4108-a4b8-36009709a099 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:14.003919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 268/536] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:14.005414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09362b15-cbd9-4108-a4b8-36009709a099 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:14.021472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06692-5fe0-46f3-acc1-08e4b23e0e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:14.022525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06692-5fe0-46f3-acc1-08e4b23e0e4c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:14.023013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06692-5fe0-46f3-acc1-08e4b23e0e4c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:14.023484 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06692-5fe0-46f3-acc1-08e4b23e0e4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:14.048178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06692-5fe0-46f3-acc1-08e4b23e0e4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:14.049614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06692-5fe0-46f3-acc1-08e4b23e0e4c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-82a06692-5fe0-46f3-acc1-08e4b23e0e4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:14.064602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:14.066105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:14.068419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:14.068419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:14.068419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:14.068419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:14.068419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:14.068419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:14.068419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:14.068419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:14.070866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 269/537] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:14.072853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f4e5-424c-4748-b265-2daceb90121e None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:14.073155 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f4e5-424c-4748-b265-2daceb90121e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:14.073449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f4e5-424c-4748-b265-2daceb90121e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:14.095730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4960f4e5-424c-4748-b265-2daceb90121e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:14.097000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4960f4e5-424c-4748-b265-2daceb90121e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:14.177487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:14.187622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09362b15-cbd9-4108-a4b8-36009709a099 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:14.242156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 270/538] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:14.245573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960f4e5-424c-4748-b265-2daceb90121e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:14.249503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8115179-63b7-49fe-a97a-3c78b797cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:14.250170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8115179-63b7-49fe-a97a-3c78b797cde8 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:14.250449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8115179-63b7-49fe-a97a-3c78b797cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:14.250721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8115179-63b7-49fe-a97a-3c78b797cde8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:14.260011 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8115179-63b7-49fe-a97a-3c78b797cde8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:14.261555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8115179-63b7-49fe-a97a-3c78b797cde8 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-c8115179-63b7-49fe-a97a-3c78b797cde8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:14.274900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:14.277207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:14.278791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:14.278791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:14.278791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:14.278791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:14.278791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:14.278791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:14.278791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:14.278791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:14.278791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 269/539] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:39:14.288090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8115179-63b7-49fe-a97a-3c78b797cde8 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:14.378668 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:14.430740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8115179-63b7-49fe-a97a-3c78b797cde8 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:14.473094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29268c91-e82c-447f-a31e-43f654e69a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:14.473768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29268c91-e82c-447f-a31e-43f654e69a22 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:14.474057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29268c91-e82c-447f-a31e-43f654e69a22 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:14.474593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29268c91-e82c-447f-a31e-43f654e69a22 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:14.475289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29268c91-e82c-447f-a31e-43f654e69a22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:14.475596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29268c91-e82c-447f-a31e-43f654e69a22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:14.477320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29268c91-e82c-447f-a31e-43f654e69a22 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:14.483159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960f4e5-424c-4748-b265-2daceb90121e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:14.492342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 270/540] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:14.493324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29268c91-e82c-447f-a31e-43f654e69a22 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:14.520962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:14.587043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f517b83-5964-478c-9258-c93aa7e17c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:14.589205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517b83-5964-478c-9258-c93aa7e17c09 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:14.589994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517b83-5964-478c-9258-c93aa7e17c09 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:14.590749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517b83-5964-478c-9258-c93aa7e17c09 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:14.592461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f517b83-5964-478c-9258-c93aa7e17c09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:14.593304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f517b83-5964-478c-9258-c93aa7e17c09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:14.596574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f517b83-5964-478c-9258-c93aa7e17c09 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:14.621138 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 271/541] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:14.623441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f517b83-5964-478c-9258-c93aa7e17c09 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:14.634633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29268c91-e82c-447f-a31e-43f654e69a22 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:14.681712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceef5b-f89c-438c-b9b8-12a9d3f4345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:14.682394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceef5b-f89c-438c-b9b8-12a9d3f4345a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:14.682824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceef5b-f89c-438c-b9b8-12a9d3f4345a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:14.683158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceef5b-f89c-438c-b9b8-12a9d3f4345a None admin] PATH_INFO: `/v3/roles/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:14.697185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ceef5b-f89c-438c-b9b8-12a9d3f4345a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-d7ceef5b-f89c-438c-b9b8-12a9d3f4345a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:14.701290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:14.703081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:14.704651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:14.708009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 271/542] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:14.709090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceef5b-f89c-438c-b9b8-12a9d3f4345a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:14.804976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:14.835695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceef5b-f89c-438c-b9b8-12a9d3f4345a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:14.837442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f517b83-5964-478c-9258-c93aa7e17c09 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:14.863706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:14.884878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7094-e8be-4fb8-8a72-bc77465b95df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:14.885423 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7094-e8be-4fb8-8a72-bc77465b95df None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:14.885693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7094-e8be-4fb8-8a72-bc77465b95df None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:14.885972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7094-e8be-4fb8-8a72-bc77465b95df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:14.886791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d7094-e8be-4fb8-8a72-bc77465b95df None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=8d0c157c2bd44a0089f5efb058be372b) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:14.887136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d7094-e8be-4fb8-8a72-bc77465b95df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:14.888632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d7094-e8be-4fb8-8a72-bc77465b95df None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:14.902990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 272/543] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:14 2022] GET /identity/v3/role_assignments?user.id=8d0c157c2bd44a0089f5efb058be372b&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:14.902990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7094-e8be-4fb8-8a72-bc77465b95df None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:14.908913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a3547-40b9-4c2e-876f-68c6b3eca20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:14.910882 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3547-40b9-4c2e-876f-68c6b3eca20f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:14.911598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3547-40b9-4c2e-876f-68c6b3eca20f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:14.912272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3547-40b9-4c2e-876f-68c6b3eca20f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:14.914275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a3547-40b9-4c2e-876f-68c6b3eca20f None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=dcfe4d6c32064d79835c415d9fc02cfb) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:14.915564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a3547-40b9-4c2e-876f-68c6b3eca20f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:14.918879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a3547-40b9-4c2e-876f-68c6b3eca20f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:14.931539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 272/544] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:14 2022] GET /identity/v3/role_assignments?user.id=dcfe4d6c32064d79835c415d9fc02cfb&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 260 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:14.934348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523b65-fe72-453f-934a-bcd3db5a138d None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:14.934985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523b65-fe72-453f-934a-bcd3db5a138d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:14.935586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523b65-fe72-453f-934a-bcd3db5a138d None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:14.938678 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 273/545] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:14 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:14.949491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1909-7d60-4e57-8a72-3255c9ddd510 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:14.950177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1909-7d60-4e57-8a72-3255c9ddd510 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:14.950779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1909-7d60-4e57-8a72-3255c9ddd510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:15.014652 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-744d1909-7d60-4e57-8a72-3255c9ddd510 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:15.017053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-744d1909-7d60-4e57-8a72-3255c9ddd510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:15.091775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7094-e8be-4fb8-8a72-bc77465b95df None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:15.137440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7530ff5-5bc3-4d81-8ec9-0e9eb725f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:15.138019 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7530ff5-5bc3-4d81-8ec9-0e9eb725f5cb None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:15.138314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7530ff5-5bc3-4d81-8ec9-0e9eb725f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:15.138617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7530ff5-5bc3-4d81-8ec9-0e9eb725f5cb None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:15.139389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7530ff5-5bc3-4d81-8ec9-0e9eb725f5cb None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:15.139706 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7530ff5-5bc3-4d81-8ec9-0e9eb725f5cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:15.141175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7530ff5-5bc3-4d81-8ec9-0e9eb725f5cb None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:15.156893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 273/546] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:15.170742 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7530ff5-5bc3-4d81-8ec9-0e9eb725f5cb None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:15.175394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:15.199107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 274/547] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:15.217153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d1909-7d60-4e57-8a72-3255c9ddd510 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:15.319295 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7530ff5-5bc3-4d81-8ec9-0e9eb725f5cb None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:15.343416 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d1909-7d60-4e57-8a72-3255c9ddd510 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:15.363512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:15.379352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca97f51-2f17-4b7a-a762-de905c92cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:15.380757 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca97f51-2f17-4b7a-a762-de905c92cedc None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:15.381197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca97f51-2f17-4b7a-a762-de905c92cedc None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:15.381630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca97f51-2f17-4b7a-a762-de905c92cedc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:15.397926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca97f51-2f17-4b7a-a762-de905c92cedc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:15.400131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca97f51-2f17-4b7a-a762-de905c92cedc None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:15.415491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79650dc-99d1-4d06-aae4-e2b7a7a3a565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:15.416908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79650dc-99d1-4d06-aae4-e2b7a7a3a565 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:15.417504 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79650dc-99d1-4d06-aae4-e2b7a7a3a565 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:15.418095 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79650dc-99d1-4d06-aae4-e2b7a7a3a565 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-7ca97f51-2f17-4b7a-a762-de905c92cedc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:15.418920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:15.419938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:15.420944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:15.420944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:15.420944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:15.420944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:15.423209 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 274/548] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:15.430644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca97f51-2f17-4b7a-a762-de905c92cedc None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:15.450174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79650dc-99d1-4d06-aae4-e2b7a7a3a565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-e79650dc-99d1-4d06-aae4-e2b7a7a3a565 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:15.460358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:15.462265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:15.463524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:15.471215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 275/549] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:15.476614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79650dc-99d1-4d06-aae4-e2b7a7a3a565 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:15.518145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:15.654564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca97f51-2f17-4b7a-a762-de905c92cedc None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:15.668941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79650dc-99d1-4d06-aae4-e2b7a7a3a565 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:15.789270 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd394f-0448-4a6a-a3b4-5ef9de3de03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:15.791357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e28e7-4d8a-498f-aa5f-be17796ae0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:15.792411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd394f-0448-4a6a-a3b4-5ef9de3de03c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:15.792759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e28e7-4d8a-498f-aa5f-be17796ae0b2 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:15.793249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e28e7-4d8a-498f-aa5f-be17796ae0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:15.793724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e28e7-4d8a-498f-aa5f-be17796ae0b2 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:15.794160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd394f-0448-4a6a-a3b4-5ef9de3de03c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:15.794937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd394f-0448-4a6a-a3b4-5ef9de3de03c None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:15.795135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e28e7-4d8a-498f-aa5f-be17796ae0b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:15.795715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e28e7-4d8a-498f-aa5f-be17796ae0b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:15.797121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd394f-0448-4a6a-a3b4-5ef9de3de03c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:15.797942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd394f-0448-4a6a-a3b4-5ef9de3de03c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:15.798394 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e28e7-4d8a-498f-aa5f-be17796ae0b2 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:15.801253 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd394f-0448-4a6a-a3b4-5ef9de3de03c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:15.819974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 276/550] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:15 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:15.829492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e28e7-4d8a-498f-aa5f-be17796ae0b2 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:15.831333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 275/551] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:15.841288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd394f-0448-4a6a-a3b4-5ef9de3de03c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:15.879542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:15.967564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e28e7-4d8a-498f-aa5f-be17796ae0b2 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:16.012283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12224fe-01be-4971-9adb-333e04d6a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:16.013262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12224fe-01be-4971-9adb-333e04d6a93e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:16.013730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12224fe-01be-4971-9adb-333e04d6a93e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:16.014102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12224fe-01be-4971-9adb-333e04d6a93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:16.028726 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12224fe-01be-4971-9adb-333e04d6a93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:16.030594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12224fe-01be-4971-9adb-333e04d6a93e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-e12224fe-01be-4971-9adb-333e04d6a93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:16.049271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:16.052124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:16.054583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:16.054583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:16.054583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:16.054583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:16.054583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 277/552] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:16.064533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12224fe-01be-4971-9adb-333e04d6a93e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:16.191952 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:16.210632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12224fe-01be-4971-9adb-333e04d6a93e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:16.246531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd394f-0448-4a6a-a3b4-5ef9de3de03c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:16.278986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1c45e-5571-4cb9-8330-292148d1e3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:16.278986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1c45e-5571-4cb9-8330-292148d1e3de None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:16.278986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1c45e-5571-4cb9-8330-292148d1e3de None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:16.278986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1c45e-5571-4cb9-8330-292148d1e3de None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:16.279633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1c45e-5571-4cb9-8330-292148d1e3de None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:16.279633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1c45e-5571-4cb9-8330-292148d1e3de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:16.279633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1c45e-5571-4cb9-8330-292148d1e3de None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:16.295316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 278/553] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:39:16.303298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:16.305123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1c45e-5571-4cb9-8330-292148d1e3de None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:16.392469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296957c-07ac-4390-af8c-c5e05e4bc9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:16.393757 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296957c-07ac-4390-af8c-c5e05e4bc9d0 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:16.394268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296957c-07ac-4390-af8c-c5e05e4bc9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:16.395803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296957c-07ac-4390-af8c-c5e05e4bc9d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:16.415726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296957c-07ac-4390-af8c-c5e05e4bc9d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:16.429627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296957c-07ac-4390-af8c-c5e05e4bc9d0 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-3296957c-07ac-4390-af8c-c5e05e4bc9d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:16.470459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:16.472379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:16.474508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:16.474508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:16.474508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:16.474508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:16.474508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:16.474508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:16.474508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:16.474508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:16.474508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:39:16.474508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:16.474508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 276/554] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 633 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:39:16.486822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296957c-07ac-4390-af8c-c5e05e4bc9d0 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:16.557308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1c45e-5571-4cb9-8330-292148d1e3de None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:16.641296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494ad47-0589-483d-b510-26a8aa1280d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:16.642403 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494ad47-0589-483d-b510-26a8aa1280d1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:16.643171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494ad47-0589-483d-b510-26a8aa1280d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:16.643718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494ad47-0589-483d-b510-26a8aa1280d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:16.661426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494ad47-0589-483d-b510-26a8aa1280d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:16.664426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494ad47-0589-483d-b510-26a8aa1280d1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-0494ad47-0589-483d-b510-26a8aa1280d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:16.689763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:16.695071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 279/555] 10.222.0.124 () {56 vars in 1098 bytes} [Mon Aug 1 16:39:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:16.703867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494ad47-0589-483d-b510-26a8aa1280d1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:16.709723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:16.902877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296957c-07ac-4390-af8c-c5e05e4bc9d0 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:16.929835 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494ad47-0589-483d-b510-26a8aa1280d1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:16.991621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10766d3-4aa7-49c4-b7df-08b548e1d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:16.992282 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10766d3-4aa7-49c4-b7df-08b548e1d635 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:16.992567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10766d3-4aa7-49c4-b7df-08b548e1d635 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:16.992812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10766d3-4aa7-49c4-b7df-08b548e1d635 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:16.993668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10766d3-4aa7-49c4-b7df-08b548e1d635 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:16.993963 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10766d3-4aa7-49c4-b7df-08b548e1d635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:16.995538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10766d3-4aa7-49c4-b7df-08b548e1d635 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:17.031010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cc34f-5cb3-4ab8-afa4-0c88bca2d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:17.031681 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cc34f-5cb3-4ab8-afa4-0c88bca2d2ca None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:17.031972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cc34f-5cb3-4ab8-afa4-0c88bca2d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:17.032240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cc34f-5cb3-4ab8-afa4-0c88bca2d2ca None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:17.033099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cc34f-5cb3-4ab8-afa4-0c88bca2d2ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:17.033410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cc34f-5cb3-4ab8-afa4-0c88bca2d2ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:17.035029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cc34f-5cb3-4ab8-afa4-0c88bca2d2ca None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:17.042620 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 277/556] 10.222.0.124 () {56 vars in 1140 bytes} [Mon Aug 1 16:39:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 557 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:17.048877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10766d3-4aa7-49c4-b7df-08b548e1d635 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:17.072606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 280/557] 10.222.0.124 () {56 vars in 1138 bytes} [Mon Aug 1 16:39:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:17.079743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cc34f-5cb3-4ab8-afa4-0c88bca2d2ca None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:17.107477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:17.222337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:17.242989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10766d3-4aa7-49c4-b7df-08b548e1d635 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:17.298863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafc90d-6633-4b5a-8bc7-64e0ebc14021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:17.299716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafc90d-6633-4b5a-8bc7-64e0ebc14021 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:17.300220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafc90d-6633-4b5a-8bc7-64e0ebc14021 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:17.300936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafc90d-6633-4b5a-8bc7-64e0ebc14021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:17.336005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cc34f-5cb3-4ab8-afa4-0c88bca2d2ca None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:17.425160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafc90d-6633-4b5a-8bc7-64e0ebc14021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:17.427297 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafc90d-6633-4b5a-8bc7-64e0ebc14021 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:17.454492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f3270-cec3-4d83-ab9e-8539e8fa572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:17.456100 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f3270-cec3-4d83-ab9e-8539e8fa572a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:17.456938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f3270-cec3-4d83-ab9e-8539e8fa572a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:17.457969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f3270-cec3-4d83-ab9e-8539e8fa572a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:17.464558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:17.524850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f3270-cec3-4d83-ab9e-8539e8fa572a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:17.527536 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f3270-cec3-4d83-ab9e-8539e8fa572a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:17.558272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 278/558] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:17 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:17.564396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafc90d-6633-4b5a-8bc7-64e0ebc14021 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-417f3270-cec3-4d83-ab9e-8539e8fa572a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:17.582682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:17.583860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:17.584741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:17.584741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:17.584741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:17.584741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:17.592959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 281/559] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 514 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:17.601904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f3270-cec3-4d83-ab9e-8539e8fa572a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:17.704845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafc90d-6633-4b5a-8bc7-64e0ebc14021 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:17.743696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:17.751864 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1b9c-9652-4311-970a-0f1906072650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:17.752914 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1b9c-9652-4311-970a-0f1906072650 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:17.753474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1b9c-9652-4311-970a-0f1906072650 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:17.754227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1b9c-9652-4311-970a-0f1906072650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:17.768477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e1b9c-9652-4311-970a-0f1906072650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:17.771196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e1b9c-9652-4311-970a-0f1906072650 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-775e1b9c-9652-4311-970a-0f1906072650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:17.790222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:17.791571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:17.792471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:17.792471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:17.792471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:17.792471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:17.794900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 279/560] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:17.801337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f19f-2494-440c-a632-bbf9f5d760fe None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:17.802154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f19f-2494-440c-a632-bbf9f5d760fe None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:17.802640 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4f19f-2494-440c-a632-bbf9f5d760fe None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:17.804777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 280/561] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:17 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:17.806925 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4f19f-2494-440c-a632-bbf9f5d760fe None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:17.865243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f3270-cec3-4d83-ab9e-8539e8fa572a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:17.891398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:17.934143 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a84858-fb51-40fa-a21c-3f5792697067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:17.936742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a84858-fb51-40fa-a21c-3f5792697067 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:17.937238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a84858-fb51-40fa-a21c-3f5792697067 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:17.937954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a84858-fb51-40fa-a21c-3f5792697067 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:17.939083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a84858-fb51-40fa-a21c-3f5792697067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:17.939589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a84858-fb51-40fa-a21c-3f5792697067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:17.943141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a84858-fb51-40fa-a21c-3f5792697067 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:17.951593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4f19f-2494-440c-a632-bbf9f5d760fe None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:17.970894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 282/562] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:39:17.970894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb8826-76ef-4614-81a2-e11da0f99a7c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:17.970894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb8826-76ef-4614-81a2-e11da0f99a7c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:17.970894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb8826-76ef-4614-81a2-e11da0f99a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:18.002400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-56cb8826-76ef-4614-81a2-e11da0f99a7c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:18.003385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a181b0d-4075-4c41-9ac6-f924143b8655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:18.004617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-56cb8826-76ef-4614-81a2-e11da0f99a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:18.005090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a181b0d-4075-4c41-9ac6-f924143b8655 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:18.005722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a181b0d-4075-4c41-9ac6-f924143b8655 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:18.006238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a181b0d-4075-4c41-9ac6-f924143b8655 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:18.007278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a181b0d-4075-4c41-9ac6-f924143b8655 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:18.007804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a181b0d-4075-4c41-9ac6-f924143b8655 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:18.009716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a181b0d-4075-4c41-9ac6-f924143b8655 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:18.030554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 281/563] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:18.032049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a181b0d-4075-4c41-9ac6-f924143b8655 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:18.092510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:18.144935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 283/564] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:18.144935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb8826-76ef-4614-81a2-e11da0f99a7c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:18.189846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a181b0d-4075-4c41-9ac6-f924143b8655 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:18.229969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63517260-94d9-4d3c-9b55-70c9a70e3f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:18.230806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63517260-94d9-4d3c-9b55-70c9a70e3f4c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:18.231117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63517260-94d9-4d3c-9b55-70c9a70e3f4c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:18.231437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63517260-94d9-4d3c-9b55-70c9a70e3f4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:18.240846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63517260-94d9-4d3c-9b55-70c9a70e3f4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:18.242395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63517260-94d9-4d3c-9b55-70c9a70e3f4c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-63517260-94d9-4d3c-9b55-70c9a70e3f4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:18.255119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:18.256335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:18.257259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:18.257259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:18.257259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:18.257259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:18.257259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:18.257259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:18.257259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:18.257259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:18.257259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 282/565] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:18.258107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f767c-aaf7-4925-83fe-c6c64f731498 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:18.258537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f767c-aaf7-4925-83fe-c6c64f731498 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:18.258634 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f767c-aaf7-4925-83fe-c6c64f731498 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:18.265154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 283/566] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:18 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:18.266165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f767c-aaf7-4925-83fe-c6c64f731498 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:18.337105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb8826-76ef-4614-81a2-e11da0f99a7c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:18.339843 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:18.396155 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee487480-37fc-4fbc-b6de-3fac5c9b2a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:18.397400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee487480-37fc-4fbc-b6de-3fac5c9b2a87 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:18.397720 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee487480-37fc-4fbc-b6de-3fac5c9b2a87 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:18.397964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee487480-37fc-4fbc-b6de-3fac5c9b2a87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:18.408407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee487480-37fc-4fbc-b6de-3fac5c9b2a87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:18.409984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee487480-37fc-4fbc-b6de-3fac5c9b2a87 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-ee487480-37fc-4fbc-b6de-3fac5c9b2a87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:18.425533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:18.428240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:18.429994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:18.429994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:18.429994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:18.429994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:18.429994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:18.429994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:18.429994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:18.429994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:18.429994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 284/567] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:18.429994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc40feb-9e00-454b-8ccf-0e7650432f9a None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:18.429994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc40feb-9e00-454b-8ccf-0e7650432f9a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:18.431202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc40feb-9e00-454b-8ccf-0e7650432f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:18.444505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f767c-aaf7-4925-83fe-c6c64f731498 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:18.452353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-3fc40feb-9e00-454b-8ccf-0e7650432f9a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:18.453813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3fc40feb-9e00-454b-8ccf-0e7650432f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:18.459020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:18.510162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1083b-ec0e-4b3c-a4ca-44d327ba660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:18.510988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1083b-ec0e-4b3c-a4ca-44d327ba660e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:18.511382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1083b-ec0e-4b3c-a4ca-44d327ba660e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:18.511661 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1083b-ec0e-4b3c-a4ca-44d327ba660e None admin] PATH_INFO: `/v3/roles/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:18.525981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1083b-ec0e-4b3c-a4ca-44d327ba660e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-e6f1083b-ec0e-4b3c-a4ca-44d327ba660e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:18.531960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:18.533004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:18.534280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 284/568] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:18.540410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1083b-ec0e-4b3c-a4ca-44d327ba660e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:18.574230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 285/569] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:18.574230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc40feb-9e00-454b-8ccf-0e7650432f9a None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:18.705779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1083b-ec0e-4b3c-a4ca-44d327ba660e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:18.724795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:18.735955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc40feb-9e00-454b-8ccf-0e7650432f9a None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:18.757442 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179db82-7d2b-4e9d-8cd4-6bed9eab2a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:18.758141 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179db82-7d2b-4e9d-8cd4-6bed9eab2a8f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:18.758459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179db82-7d2b-4e9d-8cd4-6bed9eab2a8f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:18.758776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179db82-7d2b-4e9d-8cd4-6bed9eab2a8f None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:18.759679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179db82-7d2b-4e9d-8cd4-6bed9eab2a8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:18.760089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179db82-7d2b-4e9d-8cd4-6bed9eab2a8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:18.761714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179db82-7d2b-4e9d-8cd4-6bed9eab2a8f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:18.776935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 285/570] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:18.777837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179db82-7d2b-4e9d-8cd4-6bed9eab2a8f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:18.784406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49238083-9340-4cb6-841e-2b88bc8db40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:18.785626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238083-9340-4cb6-841e-2b88bc8db40e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:18.785915 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238083-9340-4cb6-841e-2b88bc8db40e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:18.786239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238083-9340-4cb6-841e-2b88bc8db40e None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:18.787074 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49238083-9340-4cb6-841e-2b88bc8db40e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:18.787390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49238083-9340-4cb6-841e-2b88bc8db40e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:18.789568 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49238083-9340-4cb6-841e-2b88bc8db40e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:18.804646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 286/571] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:18.805569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49238083-9340-4cb6-841e-2b88bc8db40e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:18.817175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:18.913206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179db82-7d2b-4e9d-8cd4-6bed9eab2a8f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:18.963778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29995b-ec3d-4fe1-aa64-9a94a3b2341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:18.964121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49238083-9340-4cb6-841e-2b88bc8db40e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:18.964875 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29995b-ec3d-4fe1-aa64-9a94a3b2341f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:18.964875 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29995b-ec3d-4fe1-aa64-9a94a3b2341f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:18.965189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29995b-ec3d-4fe1-aa64-9a94a3b2341f None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:18.966142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29995b-ec3d-4fe1-aa64-9a94a3b2341f None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:18.966657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29995b-ec3d-4fe1-aa64-9a94a3b2341f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:18.968335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29995b-ec3d-4fe1-aa64-9a94a3b2341f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:18.980941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 286/572] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:18 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:18.983212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50d1ad-7d51-4abb-a7f7-59ff2ac0e172 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:18.983708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50d1ad-7d51-4abb-a7f7-59ff2ac0e172 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:18.984175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50d1ad-7d51-4abb-a7f7-59ff2ac0e172 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:18.990075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 287/573] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:18 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:18.990075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50d1ad-7d51-4abb-a7f7-59ff2ac0e172 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:19.025243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef908b5-ff90-4158-9e5e-ffb62acc1e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:19.026339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef908b5-ff90-4158-9e5e-ffb62acc1e7b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:19.026806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef908b5-ff90-4158-9e5e-ffb62acc1e7b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:19.027311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef908b5-ff90-4158-9e5e-ffb62acc1e7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:19.048383 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef908b5-ff90-4158-9e5e-ffb62acc1e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-0ef908b5-ff90-4158-9e5e-ffb62acc1e7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:19.059791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:19.061273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:19.062573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 287/574] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:19.063945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef908b5-ff90-4158-9e5e-ffb62acc1e7b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:19.090714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:19.111695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:19.136358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50d1ad-7d51-4abb-a7f7-59ff2ac0e172 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:19.181023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd0ffd-61e8-4b47-9a52-7eb8a6f98b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:19.182093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd0ffd-61e8-4b47-9a52-7eb8a6f98b1f None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:19.182520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd0ffd-61e8-4b47-9a52-7eb8a6f98b1f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:19.183016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd0ffd-61e8-4b47-9a52-7eb8a6f98b1f None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/9728f2fe7b5a40cd9f8ead5cf99af581/roles/3e4fc6b2b9bb4951bc7eda99c41e5733` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:19.207044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd0ffd-61e8-4b47-9a52-7eb8a6f98b1f None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=9728f2fe7b5a40cd9f8ead5cf99af581, role_id=3e4fc6b2b9bb4951bc7eda99c41e5733)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:19.208721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd0ffd-61e8-4b47-9a52-7eb8a6f98b1f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:19.216773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef908b5-ff90-4158-9e5e-ffb62acc1e7b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:19.227431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 288/575] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:39:18 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/9728f2fe7b5a40cd9f8ead5cf99af581/roles/3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:39:19.228848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd0ffd-61e8-4b47-9a52-7eb8a6f98b1f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:19.265979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56144e-5724-4b93-946f-a5be1af4cbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:19.266642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56144e-5724-4b93-946f-a5be1af4cbce None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:19.267066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56144e-5724-4b93-946f-a5be1af4cbce None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:19.267406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56144e-5724-4b93-946f-a5be1af4cbce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:19.268320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56144e-5724-4b93-946f-a5be1af4cbce None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=7b46aa077b4147c9836b646cf42cff50) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:19.268697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56144e-5724-4b93-946f-a5be1af4cbce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:19.270732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56144e-5724-4b93-946f-a5be1af4cbce None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:19.291223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 288/576] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:19 2022] GET /identity/v3/role_assignments?user.id=7b46aa077b4147c9836b646cf42cff50&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:19.291223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5322e44-94fa-4af6-b5bc-0ad28359554d None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:19.291223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5322e44-94fa-4af6-b5bc-0ad28359554d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:19.291223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5322e44-94fa-4af6-b5bc-0ad28359554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:19.318525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-f5322e44-94fa-4af6-b5bc-0ad28359554d None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:19.320991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f5322e44-94fa-4af6-b5bc-0ad28359554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:19.453723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 289/577] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:19.456028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5322e44-94fa-4af6-b5bc-0ad28359554d None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:19.474184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:19.490654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd0ffd-61e8-4b47-9a52-7eb8a6f98b1f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:19.572986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de2c4-6a15-4539-8711-162217c9c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:19.574122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de2c4-6a15-4539-8711-162217c9c811 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:19.574628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de2c4-6a15-4539-8711-162217c9c811 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:19.575171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de2c4-6a15-4539-8711-162217c9c811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:19.580873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:19.597856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981de2c4-6a15-4539-8711-162217c9c811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:19.600659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981de2c4-6a15-4539-8711-162217c9c811 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-981de2c4-6a15-4539-8711-162217c9c811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:19.631259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:19.632200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:19.633063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:19.633063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:19.633063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:19.633063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:19.633975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 289/578] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:19.635412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de2c4-6a15-4539-8711-162217c9c811 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:19.657686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5322e44-94fa-4af6-b5bc-0ad28359554d None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:19.714483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27870d0-b97b-457e-9ec6-d5b34a2c28de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:19.715267 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27870d0-b97b-457e-9ec6-d5b34a2c28de None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:19.716244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27870d0-b97b-457e-9ec6-d5b34a2c28de None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:19.716556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27870d0-b97b-457e-9ec6-d5b34a2c28de None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:19.717358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27870d0-b97b-457e-9ec6-d5b34a2c28de None admin] RBAC: Adding query filter params (name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:19.717994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27870d0-b97b-457e-9ec6-d5b34a2c28de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:19.719534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27870d0-b97b-457e-9ec6-d5b34a2c28de None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:19.738094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 290/579] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:19 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:19.739692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27870d0-b97b-457e-9ec6-d5b34a2c28de None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:19.835226 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de2c4-6a15-4539-8711-162217c9c811 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:19.841488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:19.892524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27870d0-b97b-457e-9ec6-d5b34a2c28de None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:19.900601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a8e6e-9beb-4db6-ab33-4627376d08c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:19.901641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a8e6e-9beb-4db6-ab33-4627376d08c6 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:19.902081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a8e6e-9beb-4db6-ab33-4627376d08c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:19.902531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a8e6e-9beb-4db6-ab33-4627376d08c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:19.924431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a8e6e-9beb-4db6-ab33-4627376d08c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-581a8e6e-9beb-4db6-ab33-4627376d08c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:19.935495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:19.936732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:19.937704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:19.938379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 290/580] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:19.939272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a8e6e-9beb-4db6-ab33-4627376d08c6 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:19.957242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35e33d-c330-4bbb-8467-610c77a17151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:19.959257 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e33d-c330-4bbb-8467-610c77a17151 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:19.959722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e33d-c330-4bbb-8467-610c77a17151 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:19.960169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e33d-c330-4bbb-8467-610c77a17151 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:19.961751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35e33d-c330-4bbb-8467-610c77a17151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:19.962247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35e33d-c330-4bbb-8467-610c77a17151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:19.965570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35e33d-c330-4bbb-8467-610c77a17151 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:19.993391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 291/581] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:19.995177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35e33d-c330-4bbb-8467-610c77a17151 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:20.037622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:20.104374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a8e6e-9beb-4db6-ab33-4627376d08c6 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:20.120966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35e33d-c330-4bbb-8467-610c77a17151 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:20.144257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0161cba-5dd3-464a-be43-97bf369a3666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:20.145128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161cba-5dd3-464a-be43-97bf369a3666 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:20.145409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161cba-5dd3-464a-be43-97bf369a3666 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:20.145804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161cba-5dd3-464a-be43-97bf369a3666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:20.156354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:20.159206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0161cba-5dd3-464a-be43-97bf369a3666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:20.161470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0161cba-5dd3-464a-be43-97bf369a3666 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:20.168710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54352f9-e7bf-4a70-bc83-2b972675b3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:20.169743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54352f9-e7bf-4a70-bc83-2b972675b3f7 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:20.170212 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54352f9-e7bf-4a70-bc83-2b972675b3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:20.170667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54352f9-e7bf-4a70-bc83-2b972675b3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:20.171702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54352f9-e7bf-4a70-bc83-2b972675b3f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:20.172234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54352f9-e7bf-4a70-bc83-2b972675b3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:20.174031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54352f9-e7bf-4a70-bc83-2b972675b3f7 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-b0161cba-5dd3-464a-be43-97bf369a3666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:20.179330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:20.180285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:20.181210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:20.181210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:20.181210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:20.181210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:20.181210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 291/582] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:20.181498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0161cba-5dd3-464a-be43-97bf369a3666 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:20.188481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 292/583] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:19 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:20.189706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54352f9-e7bf-4a70-bc83-2b972675b3f7 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:20.296622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:20.300175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0161cba-5dd3-464a-be43-97bf369a3666 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:20.315402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54352f9-e7bf-4a70-bc83-2b972675b3f7 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:20.341800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc041a-beab-4e6d-a743-c0392f433a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:20.342473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc041a-beab-4e6d-a743-c0392f433a8a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:20.342751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc041a-beab-4e6d-a743-c0392f433a8a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:20.343056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc041a-beab-4e6d-a743-c0392f433a8a None admin] PATH_INFO: `/v3/users/glance` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:20.352546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc041a-beab-4e6d-a743-c0392f433a8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:20.354129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc041a-beab-4e6d-a743-c0392f433a8a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:20.359656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01e4b3-cf8f-427a-a3fa-e094700e0b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:20.360316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e4b3-cf8f-427a-a3fa-e094700e0b73 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:20.360600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e4b3-cf8f-427a-a3fa-e094700e0b73 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:20.360877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e4b3-cf8f-427a-a3fa-e094700e0b73 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:20.361603 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01e4b3-cf8f-427a-a3fa-e094700e0b73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:20.361912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01e4b3-cf8f-427a-a3fa-e094700e0b73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:20.363887 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01e4b3-cf8f-427a-a3fa-e094700e0b73 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-77bc041a-beab-4e6d-a743-c0392f433a8a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:20.367016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:20.367993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 292/584] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:20.369401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc041a-beab-4e6d-a743-c0392f433a8a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:20.379317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 293/585] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:20.380588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01e4b3-cf8f-427a-a3fa-e094700e0b73 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:20.443205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:20.493712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc041a-beab-4e6d-a743-c0392f433a8a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:20.512270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01e4b3-cf8f-427a-a3fa-e094700e0b73 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:20.535795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba261c0-ac97-43c6-ad75-7dc4452f60dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:20.536611 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba261c0-ac97-43c6-ad75-7dc4452f60dc None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:20.536898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba261c0-ac97-43c6-ad75-7dc4452f60dc None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:20.537173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba261c0-ac97-43c6-ad75-7dc4452f60dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:20.550786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba261c0-ac97-43c6-ad75-7dc4452f60dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:20.552630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba261c0-ac97-43c6-ad75-7dc4452f60dc None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:20.556109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160ed2b-c43d-4f17-8257-91af53782981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:20.557741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160ed2b-c43d-4f17-8257-91af53782981 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:20.558858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160ed2b-c43d-4f17-8257-91af53782981 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:20.559512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160ed2b-c43d-4f17-8257-91af53782981 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:20.560573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160ed2b-c43d-4f17-8257-91af53782981 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:20.561064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160ed2b-c43d-4f17-8257-91af53782981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:20.562738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160ed2b-c43d-4f17-8257-91af53782981 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-2ba261c0-ac97-43c6-ad75-7dc4452f60dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:20.570617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:20.571838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:20.572931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:20.572931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:20.572931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:20.572931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:20.572931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 293/586] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:20.573230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba261c0-ac97-43c6-ad75-7dc4452f60dc None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:20.589156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 294/587] 10.222.0.124 () {56 vars in 1142 bytes} [Mon Aug 1 16:39:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:20.590424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160ed2b-c43d-4f17-8257-91af53782981 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:20.593128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:20.700185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba261c0-ac97-43c6-ad75-7dc4452f60dc None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:20.744089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160ed2b-c43d-4f17-8257-91af53782981 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:20.753911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9480075-67a5-4269-bbea-1069e7e2131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:20.756074 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:20.757255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9480075-67a5-4269-bbea-1069e7e2131f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:20.758293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9480075-67a5-4269-bbea-1069e7e2131f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:20.759074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9480075-67a5-4269-bbea-1069e7e2131f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:20.773247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9480075-67a5-4269-bbea-1069e7e2131f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:20.776327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9480075-67a5-4269-bbea-1069e7e2131f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:20.788056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2362a3-14b5-468b-9f13-efd4abd197e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:20.788701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2362a3-14b5-468b-9f13-efd4abd197e7 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:20.788974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2362a3-14b5-468b-9f13-efd4abd197e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:20.789240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2362a3-14b5-468b-9f13-efd4abd197e7 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:20.790099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2362a3-14b5-468b-9f13-efd4abd197e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:20.790408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2362a3-14b5-468b-9f13-efd4abd197e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:20.791890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2362a3-14b5-468b-9f13-efd4abd197e7 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-f9480075-67a5-4269-bbea-1069e7e2131f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:20.795939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:20.796951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:20.797893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:20.797893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:20.797893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:20.797893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:20.797893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:20.797893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:20.797893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:20.797893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:20.797893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:39:20.797893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:20.802602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 294/588] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:20.803207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9480075-67a5-4269-bbea-1069e7e2131f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:20.810591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 295/589] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:20.812152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2362a3-14b5-468b-9f13-efd4abd197e7 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:20.896391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:20.940341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9480075-67a5-4269-bbea-1069e7e2131f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:20.981507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a463b-1470-4be8-be0e-0761713888d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:20.982229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a463b-1470-4be8-be0e-0761713888d8 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:20.982621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a463b-1470-4be8-be0e-0761713888d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:20.982895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a463b-1470-4be8-be0e-0761713888d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:20.984748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2362a3-14b5-468b-9f13-efd4abd197e7 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:20.996249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a463b-1470-4be8-be0e-0761713888d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:20.997978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a463b-1470-4be8-be0e-0761713888d8 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-c08a463b-1470-4be8-be0e-0761713888d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:21.015413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:21.016377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:21.017266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:21.017266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:21.017266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:21.017266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:21.017266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 295/590] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:21.017921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a463b-1470-4be8-be0e-0761713888d8 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:21.044240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7d0c7-52c9-4e32-b079-9f5baa45de18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:21.045329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d0c7-52c9-4e32-b079-9f5baa45de18 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:21.046561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d0c7-52c9-4e32-b079-9f5baa45de18 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:21.047075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d0c7-52c9-4e32-b079-9f5baa45de18 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:21.048499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7d0c7-52c9-4e32-b079-9f5baa45de18 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:21.049016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7d0c7-52c9-4e32-b079-9f5baa45de18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:21.052278 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7d0c7-52c9-4e32-b079-9f5baa45de18 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:21.081692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 296/591] 10.222.0.124 () {56 vars in 1142 bytes} [Mon Aug 1 16:39:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:21.083780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7d0c7-52c9-4e32-b079-9f5baa45de18 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:21.130453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:21.153969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a463b-1470-4be8-be0e-0761713888d8 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:21.194546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:21.213791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f51c-fb58-4aff-881d-ba3cd8b62d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:21.215282 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f51c-fb58-4aff-881d-ba3cd8b62d72 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:21.215793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f51c-fb58-4aff-881d-ba3cd8b62d72 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:21.216255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f51c-fb58-4aff-881d-ba3cd8b62d72 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:21.228302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7d0c7-52c9-4e32-b079-9f5baa45de18 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:21.229921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367f51c-fb58-4aff-881d-ba3cd8b62d72 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:21.233238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367f51c-fb58-4aff-881d-ba3cd8b62d72 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-f367f51c-fb58-4aff-881d-ba3cd8b62d72 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:21.251973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:21.253050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:21.254575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:21.254575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:21.254575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:21.254575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:21.254575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:21.254575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:21.254575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:21.254575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:21.254575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:39:21.254575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:21.262340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 296/592] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:21.262340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f51c-fb58-4aff-881d-ba3cd8b62d72 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:21.283191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8ef2c-215a-47cf-946b-f2efd9c70216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:21.285251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8ef2c-215a-47cf-946b-f2efd9c70216 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:21.285801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8ef2c-215a-47cf-946b-f2efd9c70216 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:21.286378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8ef2c-215a-47cf-946b-f2efd9c70216 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:21.288215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8ef2c-215a-47cf-946b-f2efd9c70216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:21.288995 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8ef2c-215a-47cf-946b-f2efd9c70216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:21.291235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8ef2c-215a-47cf-946b-f2efd9c70216 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:21.312641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 297/593] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:21.314570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8ef2c-215a-47cf-946b-f2efd9c70216 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:21.394600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f51c-fb58-4aff-881d-ba3cd8b62d72 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:21.447911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:21.459491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe49873-ee00-409a-baaf-b2a5e23fd51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:21.460322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49873-ee00-409a-baaf-b2a5e23fd51c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:21.460525 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49873-ee00-409a-baaf-b2a5e23fd51c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:21.460797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49873-ee00-409a-baaf-b2a5e23fd51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:21.474033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe49873-ee00-409a-baaf-b2a5e23fd51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:21.475584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe49873-ee00-409a-baaf-b2a5e23fd51c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:21.476017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8ef2c-215a-47cf-946b-f2efd9c70216 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-4fe49873-ee00-409a-baaf-b2a5e23fd51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:21.493198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:21.494667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:21.495608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:21.495608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:21.495608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:21.495608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:21.495608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 297/594] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:21.495883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe49873-ee00-409a-baaf-b2a5e23fd51c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:21.529306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07911430-99dd-4c5c-98b3-dd9c46b7c6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:21.530393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07911430-99dd-4c5c-98b3-dd9c46b7c6f6 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:21.530938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07911430-99dd-4c5c-98b3-dd9c46b7c6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:21.531562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07911430-99dd-4c5c-98b3-dd9c46b7c6f6 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:21.532742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07911430-99dd-4c5c-98b3-dd9c46b7c6f6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:21.533312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07911430-99dd-4c5c-98b3-dd9c46b7c6f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:21.535672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07911430-99dd-4c5c-98b3-dd9c46b7c6f6 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:21.540898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:21.565562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 298/595] 10.222.0.124 () {56 vars in 1144 bytes} [Mon Aug 1 16:39:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:21.567688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07911430-99dd-4c5c-98b3-dd9c46b7c6f6 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:21.625168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe49873-ee00-409a-baaf-b2a5e23fd51c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:21.668643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab3f7-56a9-4433-ade1-af9f5132c3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:21.669300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab3f7-56a9-4433-ade1-af9f5132c3b3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:21.669766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab3f7-56a9-4433-ade1-af9f5132c3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:21.670042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab3f7-56a9-4433-ade1-af9f5132c3b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:21.679097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab3f7-56a9-4433-ade1-af9f5132c3b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:21.680897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab3f7-56a9-4433-ade1-af9f5132c3b3 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-4ebab3f7-56a9-4433-ade1-af9f5132c3b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:21.694768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:21.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:21.696693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:21.696693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:21.696693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:21.696693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:21.696693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:21.696693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:21.696693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:21.696693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:21.696693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 298/596] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:21.697946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab3f7-56a9-4433-ade1-af9f5132c3b3 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:21.707667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07911430-99dd-4c5c-98b3-dd9c46b7c6f6 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:21.751718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc59c29-e990-459a-953e-e14c6687a632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:21.752406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc59c29-e990-459a-953e-e14c6687a632 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:21.753105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc59c29-e990-459a-953e-e14c6687a632 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:21.753105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc59c29-e990-459a-953e-e14c6687a632 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:21.753999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc59c29-e990-459a-953e-e14c6687a632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:21.754335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc59c29-e990-459a-953e-e14c6687a632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:21.755840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc59c29-e990-459a-953e-e14c6687a632 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:21.776224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 299/597] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:21.776224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d0a1-5674-4d6c-84ae-e06d904230a9 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:21.776224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d0a1-5674-4d6c-84ae-e06d904230a9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:21.776224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d0a1-5674-4d6c-84ae-e06d904230a9 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:21.776224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 300/598] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:21.776787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2d0a1-5674-4d6c-84ae-e06d904230a9 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:21.782022 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:21.826152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:21.837548 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab3f7-56a9-4433-ade1-af9f5132c3b3 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:21.886613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7454c9-51be-41d7-bdfc-148ef263a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:21.887619 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7454c9-51be-41d7-bdfc-148ef263a199 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:21.888074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7454c9-51be-41d7-bdfc-148ef263a199 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:21.888488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7454c9-51be-41d7-bdfc-148ef263a199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:21.903540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7454c9-51be-41d7-bdfc-148ef263a199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:21.905318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7454c9-51be-41d7-bdfc-148ef263a199 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:21.926039 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2d0a1-5674-4d6c-84ae-e06d904230a9 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-de7454c9-51be-41d7-bdfc-148ef263a199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:21.933549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:21.934564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:21.935487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:21.935487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:21.935487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:21.935487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:21.936211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 299/599] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:21.937334 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7454c9-51be-41d7-bdfc-148ef263a199 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:21.982887 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51abff5-4255-49e1-b4e8-20724275ccf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:21.984299 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51abff5-4255-49e1-b4e8-20724275ccf6 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:21.984992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51abff5-4255-49e1-b4e8-20724275ccf6 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:21.985584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51abff5-4255-49e1-b4e8-20724275ccf6 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:21.986635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51abff5-4255-49e1-b4e8-20724275ccf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:21.986837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51abff5-4255-49e1-b4e8-20724275ccf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:21.990703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51abff5-4255-49e1-b4e8-20724275ccf6 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:22.020628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 301/600] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:22.020628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0650-d6dd-4393-a938-0fb11bb66f29 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:22.020628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0650-d6dd-4393-a938-0fb11bb66f29 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:22.020628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0650-d6dd-4393-a938-0fb11bb66f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:22.051711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ccaa0650-d6dd-4393-a938-0fb11bb66f29 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:22.053727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ccaa0650-d6dd-4393-a938-0fb11bb66f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:22.134496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7454c9-51be-41d7-bdfc-148ef263a199 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:22.169901 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:22.191466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 302/601] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:22.191466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa0650-d6dd-4393-a938-0fb11bb66f29 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:22.212393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8b38a-47d3-4717-bddc-27825b2ff497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:22.213829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8b38a-47d3-4717-bddc-27825b2ff497 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:22.214524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8b38a-47d3-4717-bddc-27825b2ff497 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:22.215272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8b38a-47d3-4717-bddc-27825b2ff497 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:22.229154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8b38a-47d3-4717-bddc-27825b2ff497 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:22.232327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8b38a-47d3-4717-bddc-27825b2ff497 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-88d8b38a-47d3-4717-bddc-27825b2ff497 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:22.255365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:22.257272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:22.259294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:22.259294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:22.259294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:22.259294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:22.259294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:22.259294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:22.259294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:22.259294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:22.262517 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 300/602] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:22.264297 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8b38a-47d3-4717-bddc-27825b2ff497 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:22.285791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:22.360695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa0650-d6dd-4393-a938-0fb11bb66f29 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:22.413366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d33d9-3854-428a-b620-6119fc403eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:22.414103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d33d9-3854-428a-b620-6119fc403eed None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:22.414474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d33d9-3854-428a-b620-6119fc403eed None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:22.414854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d33d9-3854-428a-b620-6119fc403eed None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:22.415825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d33d9-3854-428a-b620-6119fc403eed None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:22.416253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d33d9-3854-428a-b620-6119fc403eed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:22.417751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d33d9-3854-428a-b620-6119fc403eed None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:22.435228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 303/603] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:22.436703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d33d9-3854-428a-b620-6119fc403eed None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:22.484651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8b38a-47d3-4717-bddc-27825b2ff497 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:22.537427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:22.548094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d3e67-d18b-44f4-8118-c48337ac4ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:22.549665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d3e67-d18b-44f4-8118-c48337ac4ad7 None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:22.549665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d3e67-d18b-44f4-8118-c48337ac4ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:22.550133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d3e67-d18b-44f4-8118-c48337ac4ad7 None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/b1cabb41d38a40acb7d41c169cc90cb7/roles/3e4fc6b2b9bb4951bc7eda99c41e5733` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:22.573811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d3e67-d18b-44f4-8118-c48337ac4ad7 None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=b1cabb41d38a40acb7d41c169cc90cb7, role_id=3e4fc6b2b9bb4951bc7eda99c41e5733)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:22.575815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d3e67-d18b-44f4-8118-c48337ac4ad7 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:22.607095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 301/604] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:39:22 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/b1cabb41d38a40acb7d41c169cc90cb7/roles/3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:39:22.607095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d3e67-d18b-44f4-8118-c48337ac4ad7 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:22.647366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d33d9-3854-428a-b620-6119fc403eed None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:22.707615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098f9c-8dd4-4ed9-9e24-0c4f8c999c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:22.708537 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098f9c-8dd4-4ed9-9e24-0c4f8c999c73 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:22.708950 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098f9c-8dd4-4ed9-9e24-0c4f8c999c73 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:22.709421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098f9c-8dd4-4ed9-9e24-0c4f8c999c73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:22.724936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7098f9c-8dd4-4ed9-9e24-0c4f8c999c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:22.728654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-e7098f9c-8dd4-4ed9-9e24-0c4f8c999c73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:22.732161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:22.734195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:22.735963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 304/605] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:22.739245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098f9c-8dd4-4ed9-9e24-0c4f8c999c73 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:22.816863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d3e67-d18b-44f4-8118-c48337ac4ad7 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:22.893175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c641e-a2ee-4608-9a8e-8e0e6e7b911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:22.894236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c641e-a2ee-4608-9a8e-8e0e6e7b911a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:22.894673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c641e-a2ee-4608-9a8e-8e0e6e7b911a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:22.895137 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c641e-a2ee-4608-9a8e-8e0e6e7b911a None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:22.896499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c641e-a2ee-4608-9a8e-8e0e6e7b911a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:22.896986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c641e-a2ee-4608-9a8e-8e0e6e7b911a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:22.899490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c641e-a2ee-4608-9a8e-8e0e6e7b911a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:22.921733 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 302/606] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:22.922998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098f9c-8dd4-4ed9-9e24-0c4f8c999c73 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:22.924432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4224-e220-4da1-bfd6-36fa2e813d5d None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:22.924896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4224-e220-4da1-bfd6-36fa2e813d5d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:22.925424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4224-e220-4da1-bfd6-36fa2e813d5d None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:22.928702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 303/607] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:22 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:22.929871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba4224-e220-4da1-bfd6-36fa2e813d5d None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:22.959921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:23.023575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39187e72-3bee-4a2c-b163-ec74e4e55126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:23.026898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39187e72-3bee-4a2c-b163-ec74e4e55126 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:23.027420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39187e72-3bee-4a2c-b163-ec74e4e55126 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:23.028620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39187e72-3bee-4a2c-b163-ec74e4e55126 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:23.042145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39187e72-3bee-4a2c-b163-ec74e4e55126 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:23.044916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39187e72-3bee-4a2c-b163-ec74e4e55126 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-39187e72-3bee-4a2c-b163-ec74e4e55126 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:23.067751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:23.069550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:23.071478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:23.071478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:23.071478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:23.071478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:23.071478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:23.071478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:23.071478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:23.071478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:23.071478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 305/608] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:23.072447 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39187e72-3bee-4a2c-b163-ec74e4e55126 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:23.116266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba4224-e220-4da1-bfd6-36fa2e813d5d None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:23.147151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:23.177284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54e5c2-7122-4ace-bf7d-a16ff15eb9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:23.178627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e5c2-7122-4ace-bf7d-a16ff15eb9d4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:23.178804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e5c2-7122-4ace-bf7d-a16ff15eb9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:23.179379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e5c2-7122-4ace-bf7d-a16ff15eb9d4 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:23.180280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54e5c2-7122-4ace-bf7d-a16ff15eb9d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:23.180787 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54e5c2-7122-4ace-bf7d-a16ff15eb9d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:23.182666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54e5c2-7122-4ace-bf7d-a16ff15eb9d4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:23.194642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 304/609] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:22 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:23.196156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4952aca-93a0-4f07-ae15-98043a7fd286 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:23.196583 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4952aca-93a0-4f07-ae15-98043a7fd286 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:23.196988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4952aca-93a0-4f07-ae15-98043a7fd286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:23.225740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f4952aca-93a0-4f07-ae15-98043a7fd286 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:23.227855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f4952aca-93a0-4f07-ae15-98043a7fd286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:23.280086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39187e72-3bee-4a2c-b163-ec74e4e55126 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:23.344173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 305/610] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:23.345766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4952aca-93a0-4f07-ae15-98043a7fd286 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:23.357041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83371-3e31-4113-990c-05d365c7c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:23.358753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83371-3e31-4113-990c-05d365c7c7b6 None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:23.359524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83371-3e31-4113-990c-05d365c7c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:23.360189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83371-3e31-4113-990c-05d365c7c7b6 None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/8d0c157c2bd44a0089f5efb058be372b/roles/3e4fc6b2b9bb4951bc7eda99c41e5733` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:23.390064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e83371-3e31-4113-990c-05d365c7c7b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=8d0c157c2bd44a0089f5efb058be372b, role_id=3e4fc6b2b9bb4951bc7eda99c41e5733)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:23.392874 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e83371-3e31-4113-990c-05d365c7c7b6 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:23.414897 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 306/611] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:39:23 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/8d0c157c2bd44a0089f5efb058be372b/roles/3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:39:23.425832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83371-3e31-4113-990c-05d365c7c7b6 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:23.478192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:23.586537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4952aca-93a0-4f07-ae15-98043a7fd286 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:23.617702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83371-3e31-4113-990c-05d365c7c7b6 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:23.618583 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:23.655830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83ecb3-c96b-47ee-9845-8a05e85bdf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:23.656939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ecb3-c96b-47ee-9845-8a05e85bdf4f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:23.657446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ecb3-c96b-47ee-9845-8a05e85bdf4f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:23.657986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ecb3-c96b-47ee-9845-8a05e85bdf4f None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:23.659076 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83ecb3-c96b-47ee-9845-8a05e85bdf4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:23.659667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83ecb3-c96b-47ee-9845-8a05e85bdf4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:23.661857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83ecb3-c96b-47ee-9845-8a05e85bdf4f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:23.680355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 306/612] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:23.681780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83ecb3-c96b-47ee-9845-8a05e85bdf4f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:23.696637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361930-84f0-4b89-a335-af9c605bd8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:23.697718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361930-84f0-4b89-a335-af9c605bd8bb None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:23.698234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361930-84f0-4b89-a335-af9c605bd8bb None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:23.698714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361930-84f0-4b89-a335-af9c605bd8bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:23.716810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361930-84f0-4b89-a335-af9c605bd8bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:23.718762 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361930-84f0-4b89-a335-af9c605bd8bb None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-64361930-84f0-4b89-a335-af9c605bd8bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:23.737639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:23.739790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:23.741522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:23.741522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:23.741522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:23.741522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:23.744150 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 307/613] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:23.745181 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361930-84f0-4b89-a335-af9c605bd8bb None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:23.929723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83ecb3-c96b-47ee-9845-8a05e85bdf4f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:23.931510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:23.995546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361930-84f0-4b89-a335-af9c605bd8bb None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:24.002797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdc199-c8da-4bbd-9989-e8d2c8903634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:24.003225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdc199-c8da-4bbd-9989-e8d2c8903634 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:24.003863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdc199-c8da-4bbd-9989-e8d2c8903634 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:24.004546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdc199-c8da-4bbd-9989-e8d2c8903634 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:24.027324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdc199-c8da-4bbd-9989-e8d2c8903634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-86cdc199-c8da-4bbd-9989-e8d2c8903634 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:24.040042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:24.041496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:24.042783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 307/614] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:24.051418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdc199-c8da-4bbd-9989-e8d2c8903634 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:24.086642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f604d9-fb07-4b50-8e58-a1fd769c6087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:24.087827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f604d9-fb07-4b50-8e58-a1fd769c6087 None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:24.088318 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f604d9-fb07-4b50-8e58-a1fd769c6087 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:24.088789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f604d9-fb07-4b50-8e58-a1fd769c6087 None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/dcfe4d6c32064d79835c415d9fc02cfb/roles/3e4fc6b2b9bb4951bc7eda99c41e5733` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:24.119876 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f604d9-fb07-4b50-8e58-a1fd769c6087 None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=dcfe4d6c32064d79835c415d9fc02cfb, role_id=3e4fc6b2b9bb4951bc7eda99c41e5733)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:24.122738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f604d9-fb07-4b50-8e58-a1fd769c6087 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:24.123449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:24.149658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 308/615] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:39:23 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/dcfe4d6c32064d79835c415d9fc02cfb/roles/3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:39:24.151357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f604d9-fb07-4b50-8e58-a1fd769c6087 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:24.281367 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdc199-c8da-4bbd-9989-e8d2c8903634 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:24.352825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb63c61-e727-42b6-b808-1c07e8c55c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:24.354417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb63c61-e727-42b6-b808-1c07e8c55c4f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:24.355203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb63c61-e727-42b6-b808-1c07e8c55c4f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:24.355921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb63c61-e727-42b6-b808-1c07e8c55c4f None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:24.357521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb63c61-e727-42b6-b808-1c07e8c55c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:24.358432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb63c61-e727-42b6-b808-1c07e8c55c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:24.361079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb63c61-e727-42b6-b808-1c07e8c55c4f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:24.371061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f604d9-fb07-4b50-8e58-a1fd769c6087 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:24.386006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 308/616] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:24.392775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb63c61-e727-42b6-b808-1c07e8c55c4f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:24.468326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:24.484896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e499e4-2a62-4fe8-9ef5-3ace0298447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:24.485990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e499e4-2a62-4fe8-9ef5-3ace0298447d None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:24.486463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e499e4-2a62-4fe8-9ef5-3ace0298447d None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:24.487638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e499e4-2a62-4fe8-9ef5-3ace0298447d None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:24.489312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e499e4-2a62-4fe8-9ef5-3ace0298447d None admin] RBAC: Adding query filter params (name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:24.489887 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e499e4-2a62-4fe8-9ef5-3ace0298447d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:24.492561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e499e4-2a62-4fe8-9ef5-3ace0298447d None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:24.513785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 309/617] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:24 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:24.525238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e499e4-2a62-4fe8-9ef5-3ace0298447d None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:24.635459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:24.679845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb63c61-e727-42b6-b808-1c07e8c55c4f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:24.784671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b69e64-8d8b-4348-b669-86f80feaff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:24.786028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69e64-8d8b-4348-b669-86f80feaff30 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:24.786495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69e64-8d8b-4348-b669-86f80feaff30 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:24.787010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69e64-8d8b-4348-b669-86f80feaff30 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:24.812956 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e499e4-2a62-4fe8-9ef5-3ace0298447d None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:24.818026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b69e64-8d8b-4348-b669-86f80feaff30 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:24.820797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b69e64-8d8b-4348-b669-86f80feaff30 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:24.859332 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7433d-454e-47ff-b73f-2717046c9661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:24.860511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7433d-454e-47ff-b73f-2717046c9661 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:24.861023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7433d-454e-47ff-b73f-2717046c9661 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:24.861544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7433d-454e-47ff-b73f-2717046c9661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-95b69e64-8d8b-4348-b669-86f80feaff30 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:24.866254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:24.868315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:24.870179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:24.870179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:24.870179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:24.870179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:24.870179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:24.870179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:24.870179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:24.870179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:24.870179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:39:24.870179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:24.875578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 309/618] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 484 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:24.881933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7433d-454e-47ff-b73f-2717046c9661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:24.883545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7433d-454e-47ff-b73f-2717046c9661 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:24.885803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b69e64-8d8b-4348-b669-86f80feaff30 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-6fb7433d-454e-47ff-b73f-2717046c9661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:24.918070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:24.921896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:24.925745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:24.925745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:24.925745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:24.925745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:24.925745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 310/619] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:24.936165 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7433d-454e-47ff-b73f-2717046c9661 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:25.010303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:25.140893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7433d-454e-47ff-b73f-2717046c9661 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:25.205408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b69e64-8d8b-4348-b669-86f80feaff30 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:25.216008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c806581-14b9-4499-8b0b-704064070ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:25.217722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c806581-14b9-4499-8b0b-704064070ecf None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:25.218680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c806581-14b9-4499-8b0b-704064070ecf None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:25.219564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c806581-14b9-4499-8b0b-704064070ecf None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:25.221262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c806581-14b9-4499-8b0b-704064070ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:25.222235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c806581-14b9-4499-8b0b-704064070ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:25.225334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c806581-14b9-4499-8b0b-704064070ecf None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:25.252337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 311/620] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:39:25.262794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c806581-14b9-4499-8b0b-704064070ecf None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:25.324252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c2eca-40be-4ac7-9b92-4d5ebb305b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:25.324583 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c2eca-40be-4ac7-9b92-4d5ebb305b4c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:25.324929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c2eca-40be-4ac7-9b92-4d5ebb305b4c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:25.325093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c2eca-40be-4ac7-9b92-4d5ebb305b4c None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:25.325880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c2eca-40be-4ac7-9b92-4d5ebb305b4c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:25.326195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c2eca-40be-4ac7-9b92-4d5ebb305b4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:25.327902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c2eca-40be-4ac7-9b92-4d5ebb305b4c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:25.365281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 310/621] 10.222.0.124 () {56 vars in 1140 bytes} [Mon Aug 1 16:39:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:39:25.371842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c2eca-40be-4ac7-9b92-4d5ebb305b4c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:25.422137 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:25.520347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:25.526270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c806581-14b9-4499-8b0b-704064070ecf None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:25.654510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d21da4-6320-444f-a64a-40473e9cc0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:25.655624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d21da4-6320-444f-a64a-40473e9cc0fc None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:25.656124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d21da4-6320-444f-a64a-40473e9cc0fc None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:25.656598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d21da4-6320-444f-a64a-40473e9cc0fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:25.685231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d21da4-6320-444f-a64a-40473e9cc0fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:25.687930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d21da4-6320-444f-a64a-40473e9cc0fc None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:25.704468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c2eca-40be-4ac7-9b92-4d5ebb305b4c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-c8d21da4-6320-444f-a64a-40473e9cc0fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:25.726990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:25.728849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:25.730747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:25.730747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:25.730747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:25.730747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:25.730747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:25.730747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:25.730747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:25.730747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:25.730747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:25.730747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:25.735392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 312/622] 10.222.0.124 () {56 vars in 1098 bytes} [Mon Aug 1 16:39:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:25.744722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d21da4-6320-444f-a64a-40473e9cc0fc None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:25.785293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd4e0-59f7-4b16-aeae-f9ff7a9864d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:25.786430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd4e0-59f7-4b16-aeae-f9ff7a9864d4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:25.786900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd4e0-59f7-4b16-aeae-f9ff7a9864d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:25.787413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd4e0-59f7-4b16-aeae-f9ff7a9864d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:25.832489 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fd4e0-59f7-4b16-aeae-f9ff7a9864d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:25.834805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fd4e0-59f7-4b16-aeae-f9ff7a9864d4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-616fd4e0-59f7-4b16-aeae-f9ff7a9864d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:25.897405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:25.899180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:25.900900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:25.900900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:25.900900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:25.900900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:25.900900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 311/623] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 529 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:25.908221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd4e0-59f7-4b16-aeae-f9ff7a9864d4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:26.098076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d21da4-6320-444f-a64a-40473e9cc0fc None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:26.134664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:26.172513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f29ac-2af5-4fa6-b27e-dd42ccb0064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:26.174941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f29ac-2af5-4fa6-b27e-dd42ccb0064c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:26.175657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f29ac-2af5-4fa6-b27e-dd42ccb0064c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:26.176147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f29ac-2af5-4fa6-b27e-dd42ccb0064c None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:26.177741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f29ac-2af5-4fa6-b27e-dd42ccb0064c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:26.178280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f29ac-2af5-4fa6-b27e-dd42ccb0064c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:26.181196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f29ac-2af5-4fa6-b27e-dd42ccb0064c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:26.218603 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 313/624] 10.222.0.124 () {56 vars in 1138 bytes} [Mon Aug 1 16:39:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:39:26.228310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92ef7d-ca3e-452f-b012-5d448c433b76 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:26.228806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92ef7d-ca3e-452f-b012-5d448c433b76 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:26.229285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92ef7d-ca3e-452f-b012-5d448c433b76 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:26.238605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 314/625] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:26 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:26.238605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92ef7d-ca3e-452f-b012-5d448c433b76 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:26.245568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd4e0-59f7-4b16-aeae-f9ff7a9864d4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:26.276613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:26.330475 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279f087-0384-43c5-b526-9653fc1e9640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:26.332272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f087-0384-43c5-b526-9653fc1e9640 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:26.333131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f087-0384-43c5-b526-9653fc1e9640 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:26.333906 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f087-0384-43c5-b526-9653fc1e9640 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:26.335883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279f087-0384-43c5-b526-9653fc1e9640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:26.337784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279f087-0384-43c5-b526-9653fc1e9640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:26.341388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279f087-0384-43c5-b526-9653fc1e9640 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:26.372871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 312/626] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:26.376841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22269c-95ad-428d-83f3-34d86c8da574 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:26.377671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22269c-95ad-428d-83f3-34d86c8da574 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:26.379387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22269c-95ad-428d-83f3-34d86c8da574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:26.421350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-cc22269c-95ad-428d-83f3-34d86c8da574 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:26.424174 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cc22269c-95ad-428d-83f3-34d86c8da574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:26.479941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92ef7d-ca3e-452f-b012-5d448c433b76 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:26.566215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f308b1-9369-4454-b594-fa5df41a7b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:26.567404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f308b1-9369-4454-b594-fa5df41a7b8a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:26.567944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f308b1-9369-4454-b594-fa5df41a7b8a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:26.568429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f308b1-9369-4454-b594-fa5df41a7b8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:26.585279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 313/627] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:26.587674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22269c-95ad-428d-83f3-34d86c8da574 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:26.720503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f308b1-9369-4454-b594-fa5df41a7b8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:26.723311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f308b1-9369-4454-b594-fa5df41a7b8a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:26.726627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:26.768905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:26.818829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22269c-95ad-428d-83f3-34d86c8da574 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:26.861053 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570a21e-b28c-4b9e-aef4-fe0761e46929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:26.861918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570a21e-b28c-4b9e-aef4-fe0761e46929 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:26.862392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570a21e-b28c-4b9e-aef4-fe0761e46929 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:26.862892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570a21e-b28c-4b9e-aef4-fe0761e46929 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:26.872095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570a21e-b28c-4b9e-aef4-fe0761e46929 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:26.873829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570a21e-b28c-4b9e-aef4-fe0761e46929 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-c570a21e-b28c-4b9e-aef4-fe0761e46929 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:26.887453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:26.889454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:26.892557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:26.892557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:26.892557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:26.892557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:26.892557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:26.892557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:26.892557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:26.892557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:26.892557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 314/628] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:26.892557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570a21e-b28c-4b9e-aef4-fe0761e46929 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:26.975227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 315/629] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:26.977190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f308b1-9369-4454-b594-fa5df41a7b8a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:27.013743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570a21e-b28c-4b9e-aef4-fe0761e46929 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:27.026674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:27.054274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcc47f-809b-45f7-854a-7490b641d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:27.054942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc47f-809b-45f7-854a-7490b641d558 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:27.055249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc47f-809b-45f7-854a-7490b641d558 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:27.055521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc47f-809b-45f7-854a-7490b641d558 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:27.068775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcc47f-809b-45f7-854a-7490b641d558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-70fcc47f-809b-45f7-854a-7490b641d558 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:27.075170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:27.076738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 315/630] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:27.078337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcc47f-809b-45f7-854a-7490b641d558 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:27.159416 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f308b1-9369-4454-b594-fa5df41a7b8a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:27.187118 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:27.212646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d4fd-fbf0-463d-bb34-cccd87539265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:27.213418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d4fd-fbf0-463d-bb34-cccd87539265 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:27.213850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d4fd-fbf0-463d-bb34-cccd87539265 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:27.214241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d4fd-fbf0-463d-bb34-cccd87539265 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:27.215269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d4fd-fbf0-463d-bb34-cccd87539265 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:27.215676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d4fd-fbf0-463d-bb34-cccd87539265 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:27.217275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d4fd-fbf0-463d-bb34-cccd87539265 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:27.225747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcc47f-809b-45f7-854a-7490b641d558 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:27.232878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 316/631] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:27.234915 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ec3eb-f2d5-4ed6-8e60-5af64671273f None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:27.235425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ec3eb-f2d5-4ed6-8e60-5af64671273f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:27.235908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ec3eb-f2d5-4ed6-8e60-5af64671273f None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:27.239252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 317/632] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:27 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:27.241467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c281af-c6ae-4f98-b82a-23525719b829 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:27.241928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c281af-c6ae-4f98-b82a-23525719b829 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:27.242370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c281af-c6ae-4f98-b82a-23525719b829 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:27.244365 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 318/633] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:27 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:27.245749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c281af-c6ae-4f98-b82a-23525719b829 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:27.274720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432c3ba-6cf2-4895-b65a-582ef289d839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:27.275437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432c3ba-6cf2-4895-b65a-582ef289d839 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:27.275704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432c3ba-6cf2-4895-b65a-582ef289d839 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:27.275976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432c3ba-6cf2-4895-b65a-582ef289d839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:27.288897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432c3ba-6cf2-4895-b65a-582ef289d839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:27.290412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432c3ba-6cf2-4895-b65a-582ef289d839 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-0432c3ba-6cf2-4895-b65a-582ef289d839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:27.307433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:27.309354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:27.311062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:27.311062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:27.311062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:27.311062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:27.313528 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 316/634] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:27.314509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432c3ba-6cf2-4895-b65a-582ef289d839 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:27.348431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:27.384196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c281af-c6ae-4f98-b82a-23525719b829 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:27.439269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34a218-3496-44a5-9c74-16fd02d0e266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:27.440373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a218-3496-44a5-9c74-16fd02d0e266 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:27.441175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a218-3496-44a5-9c74-16fd02d0e266 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:27.441410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a218-3496-44a5-9c74-16fd02d0e266 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:27.442627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34a218-3496-44a5-9c74-16fd02d0e266 None admin] RBAC: Adding query filter params (name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:27.443165 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34a218-3496-44a5-9c74-16fd02d0e266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:27.445612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34a218-3496-44a5-9c74-16fd02d0e266 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:27.462707 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 319/635] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:27 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:27.465398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11accefa-b206-4c86-a66f-398692a56b76 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:27.465895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11accefa-b206-4c86-a66f-398692a56b76 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:27.466391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11accefa-b206-4c86-a66f-398692a56b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:27.475619 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432c3ba-6cf2-4895-b65a-582ef289d839 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:27.497926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-11accefa-b206-4c86-a66f-398692a56b76 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:27.500314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-11accefa-b206-4c86-a66f-398692a56b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:27.529622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e1405-c31d-45b4-bb28-0685f18d545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:27.530976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1405-c31d-45b4-bb28-0685f18d545e None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:27.531462 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1405-c31d-45b4-bb28-0685f18d545e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:27.531880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1405-c31d-45b4-bb28-0685f18d545e None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/7b46aa077b4147c9836b646cf42cff50/roles/3e4fc6b2b9bb4951bc7eda99c41e5733` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:27.554102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e1405-c31d-45b4-bb28-0685f18d545e None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=7b46aa077b4147c9836b646cf42cff50, role_id=3e4fc6b2b9bb4951bc7eda99c41e5733)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:27.555966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e1405-c31d-45b4-bb28-0685f18d545e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:27.558191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:27.574532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 317/636] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:39:27 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/7b46aa077b4147c9836b646cf42cff50/roles/3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:39:27.575898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b2c7-f254-44a1-825d-43fdc67cfacf None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:27.576465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b2c7-f254-44a1-825d-43fdc67cfacf None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:27.576629 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b2c7-f254-44a1-825d-43fdc67cfacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:27.606666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 320/637] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:27.607493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11accefa-b206-4c86-a66f-398692a56b76 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:27.608573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e1f0b2c7-f254-44a1-825d-43fdc67cfacf None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:27.610236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e1f0b2c7-f254-44a1-825d-43fdc67cfacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:27.723750 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 318/638] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:27.725365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0b2c7-f254-44a1-825d-43fdc67cfacf None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:27.729835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:27.767698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11accefa-b206-4c86-a66f-398692a56b76 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:27.813008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26d9d6-cd4f-4bec-8807-489e5924b453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:27.813669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d9d6-cd4f-4bec-8807-489e5924b453 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:27.813949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d9d6-cd4f-4bec-8807-489e5924b453 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:27.814226 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d9d6-cd4f-4bec-8807-489e5924b453 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:27.815003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26d9d6-cd4f-4bec-8807-489e5924b453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:27.815442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26d9d6-cd4f-4bec-8807-489e5924b453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:27.817299 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26d9d6-cd4f-4bec-8807-489e5924b453 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:27.833779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 321/639] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:27.835222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26d9d6-cd4f-4bec-8807-489e5924b453 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:27.873997 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:27.905290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0b2c7-f254-44a1-825d-43fdc67cfacf None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:27.949585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeabab-eca8-4fb6-993e-a5e5c2d38a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:27.950287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeabab-eca8-4fb6-993e-a5e5c2d38a88 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:27.950575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeabab-eca8-4fb6-993e-a5e5c2d38a88 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:27.950915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeabab-eca8-4fb6-993e-a5e5c2d38a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:27.964439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeabab-eca8-4fb6-993e-a5e5c2d38a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:27.966024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeabab-eca8-4fb6-993e-a5e5c2d38a88 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:27.971266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26d9d6-cd4f-4bec-8807-489e5924b453 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-69aeabab-eca8-4fb6-993e-a5e5c2d38a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:27.982682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:27.984630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:27.986439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:27.986439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:27.986439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:27.986439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:27.986439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 319/640] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:27.986439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeabab-eca8-4fb6-993e-a5e5c2d38a88 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:28.021164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81a7d9-b775-46d2-a502-53df04630a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:28.021827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81a7d9-b775-46d2-a502-53df04630a6c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:28.022076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81a7d9-b775-46d2-a502-53df04630a6c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:28.022353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81a7d9-b775-46d2-a502-53df04630a6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:28.036014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81a7d9-b775-46d2-a502-53df04630a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-ee81a7d9-b775-46d2-a502-53df04630a6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:28.041769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:28.042789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 322/641] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:28.044024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81a7d9-b775-46d2-a502-53df04630a6c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:28.106340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:28.192488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:28.203568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeabab-eca8-4fb6-993e-a5e5c2d38a88 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:28.212716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81a7d9-b775-46d2-a502-53df04630a6c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:28.282316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c684caf-0ae6-4713-bdfa-fd8dcaff8121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:28.283673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c684caf-0ae6-4713-bdfa-fd8dcaff8121 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:28.284884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c684caf-0ae6-4713-bdfa-fd8dcaff8121 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:28.285747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c684caf-0ae6-4713-bdfa-fd8dcaff8121 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:28.295666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965841-c61a-46e6-ad22-dd30e884b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:28.297105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965841-c61a-46e6-ad22-dd30e884b6ac None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:28.297585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965841-c61a-46e6-ad22-dd30e884b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:28.298078 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965841-c61a-46e6-ad22-dd30e884b6ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:28.298325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c684caf-0ae6-4713-bdfa-fd8dcaff8121 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:28.301042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c684caf-0ae6-4713-bdfa-fd8dcaff8121 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-7c684caf-0ae6-4713-bdfa-fd8dcaff8121 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:28.323355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:28.324571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:28.325511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:28.325511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:28.325511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:28.325511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:28.325511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:28.325511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:28.325511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:28.325511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:28.327452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 323/642] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:28.328558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92965841-c61a-46e6-ad22-dd30e884b6ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:28.328938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c684caf-0ae6-4713-bdfa-fd8dcaff8121 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-92965841-c61a-46e6-ad22-dd30e884b6ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:28.339832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:28.340956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:28.341855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:28.347057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 320/643] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:28.347057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965841-c61a-46e6-ad22-dd30e884b6ac None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:28.491397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c684caf-0ae6-4713-bdfa-fd8dcaff8121 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:28.543346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965841-c61a-46e6-ad22-dd30e884b6ac None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:28.562262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b769fea-33e8-4af3-8738-62983595f0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:28.562599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b769fea-33e8-4af3-8738-62983595f0a2 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:28.562933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b769fea-33e8-4af3-8738-62983595f0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:28.563110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b769fea-33e8-4af3-8738-62983595f0a2 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:28.563865 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b769fea-33e8-4af3-8738-62983595f0a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:28.564130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b769fea-33e8-4af3-8738-62983595f0a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:28.566032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b769fea-33e8-4af3-8738-62983595f0a2 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:28.573852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:28.588487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 324/644] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:28.589704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b769fea-33e8-4af3-8738-62983595f0a2 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:28.607769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:28.617322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a88baa-da17-482e-8657-4379aa7fee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:28.618184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a88baa-da17-482e-8657-4379aa7fee12 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:28.618676 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a88baa-da17-482e-8657-4379aa7fee12 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:28.619231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a88baa-da17-482e-8657-4379aa7fee12 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:28.620672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a88baa-da17-482e-8657-4379aa7fee12 None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:28.621259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a88baa-da17-482e-8657-4379aa7fee12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:28.624189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a88baa-da17-482e-8657-4379aa7fee12 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:28.641402 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 321/645] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:28 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:28.642988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a88baa-da17-482e-8657-4379aa7fee12 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:28.783489 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b769fea-33e8-4af3-8738-62983595f0a2 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:28.848683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a88baa-da17-482e-8657-4379aa7fee12 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:28.858321 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497721-687b-428c-afbe-a3398150a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:28.859458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497721-687b-428c-afbe-a3398150a46f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:28.860606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497721-687b-428c-afbe-a3398150a46f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:28.861329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497721-687b-428c-afbe-a3398150a46f None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:28.863684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f497721-687b-428c-afbe-a3398150a46f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:28.864391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f497721-687b-428c-afbe-a3398150a46f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:28.867172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f497721-687b-428c-afbe-a3398150a46f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:28.897483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 325/646] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:28.897483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497721-687b-428c-afbe-a3398150a46f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:28.907896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17761f6-952b-4187-b25e-df5659aac2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:28.908833 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17761f6-952b-4187-b25e-df5659aac2f2 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:28.909294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17761f6-952b-4187-b25e-df5659aac2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:28.909717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17761f6-952b-4187-b25e-df5659aac2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:28.910667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17761f6-952b-4187-b25e-df5659aac2f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:28.911226 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17761f6-952b-4187-b25e-df5659aac2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:28.913334 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17761f6-952b-4187-b25e-df5659aac2f2 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:28.931721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 322/647] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:28 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:28.933990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17761f6-952b-4187-b25e-df5659aac2f2 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:29.014425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:29.016576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:29.061808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497721-687b-428c-afbe-a3398150a46f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:29.115296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340fe87-5b1e-4a6d-aa2b-1ade2a44f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:29.116736 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340fe87-5b1e-4a6d-aa2b-1ade2a44f571 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:29.117096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340fe87-5b1e-4a6d-aa2b-1ade2a44f571 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:29.117547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340fe87-5b1e-4a6d-aa2b-1ade2a44f571 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:29.131536 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340fe87-5b1e-4a6d-aa2b-1ade2a44f571 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:29.134116 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340fe87-5b1e-4a6d-aa2b-1ade2a44f571 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:29.156253 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17761f6-952b-4187-b25e-df5659aac2f2 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d340fe87-5b1e-4a6d-aa2b-1ade2a44f571 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:29.157280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:29.158244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:29.159898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:29.159898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:29.159898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:29.159898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:29.159898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:29.159898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:29.159898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:29.159898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:29.159898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:39:29.159898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:29.167584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 326/648] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:29.169405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340fe87-5b1e-4a6d-aa2b-1ade2a44f571 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:29.224837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629cdf5-3814-424e-a4a8-9a9f7cc9fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:29.225929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629cdf5-3814-424e-a4a8-9a9f7cc9fb70 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:29.226407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629cdf5-3814-424e-a4a8-9a9f7cc9fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:29.226880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629cdf5-3814-424e-a4a8-9a9f7cc9fb70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:29.248442 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629cdf5-3814-424e-a4a8-9a9f7cc9fb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:29.251305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629cdf5-3814-424e-a4a8-9a9f7cc9fb70 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-8629cdf5-3814-424e-a4a8-9a9f7cc9fb70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:29.280665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:29.281947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:29.289120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:29.289120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:29.289120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:29.289120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:29.289120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 323/649] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:29.289120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629cdf5-3814-424e-a4a8-9a9f7cc9fb70 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:29.341222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340fe87-5b1e-4a6d-aa2b-1ade2a44f571 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:29.399549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:29.409872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e63f61-35d4-4c8b-b153-baaaf8620ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:29.410225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e63f61-35d4-4c8b-b153-baaaf8620ca8 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:29.410422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e63f61-35d4-4c8b-b153-baaaf8620ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:29.411044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e63f61-35d4-4c8b-b153-baaaf8620ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:29.411789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e63f61-35d4-4c8b-b153-baaaf8620ca8 None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=9728f2fe7b5a40cd9f8ead5cf99af581) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:29.412152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e63f61-35d4-4c8b-b153-baaaf8620ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:29.413708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e63f61-35d4-4c8b-b153-baaaf8620ca8 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:29.421548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 327/650] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:29 2022] GET /identity/v3/role_assignments?user.id=9728f2fe7b5a40cd9f8ead5cf99af581&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 610 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:29.422475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e63f61-35d4-4c8b-b153-baaaf8620ca8 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:29.527582 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:29.545764 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629cdf5-3814-424e-a4a8-9a9f7cc9fb70 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:29.619259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e63f61-35d4-4c8b-b153-baaaf8620ca8 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:29.628275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea36c-bc4c-48c5-bb2e-e43d2d508a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:29.629532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea36c-bc4c-48c5-bb2e-e43d2d508a9a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:29.630012 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea36c-bc4c-48c5-bb2e-e43d2d508a9a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:29.630453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea36c-bc4c-48c5-bb2e-e43d2d508a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:29.654074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea36c-bc4c-48c5-bb2e-e43d2d508a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:29.656887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea36c-bc4c-48c5-bb2e-e43d2d508a9a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:29.675144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adae35e-b07a-4835-979a-fbf96c445904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:29.676214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adae35e-b07a-4835-979a-fbf96c445904 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:29.676676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adae35e-b07a-4835-979a-fbf96c445904 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:29.677142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adae35e-b07a-4835-979a-fbf96c445904 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:29.678671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adae35e-b07a-4835-979a-fbf96c445904 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:29.679233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adae35e-b07a-4835-979a-fbf96c445904 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:29.682229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adae35e-b07a-4835-979a-fbf96c445904 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-f8dea36c-bc4c-48c5-bb2e-e43d2d508a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:29.683845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:29.684807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:29.685696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:29.685696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:29.685696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:29.685696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:29.689664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 324/651] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:29.691013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea36c-bc4c-48c5-bb2e-e43d2d508a9a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:29.730420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 328/652] 10.222.0.124 () {56 vars in 1142 bytes} [Mon Aug 1 16:39:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:29.735219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adae35e-b07a-4835-979a-fbf96c445904 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:29.857163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:29.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea36c-bc4c-48c5-bb2e-e43d2d508a9a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:29.943980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826789c-c2d6-465f-a96d-eda2b2a9ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:29.945021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826789c-c2d6-465f-a96d-eda2b2a9ce97 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:29.945555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826789c-c2d6-465f-a96d-eda2b2a9ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:29.946032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826789c-c2d6-465f-a96d-eda2b2a9ce97 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:29.946996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826789c-c2d6-465f-a96d-eda2b2a9ce97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:29.947549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826789c-c2d6-465f-a96d-eda2b2a9ce97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:29.949218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826789c-c2d6-465f-a96d-eda2b2a9ce97 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:29.963080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adae35e-b07a-4835-979a-fbf96c445904 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:29.964974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 325/653] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:29.966086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826789c-c2d6-465f-a96d-eda2b2a9ce97 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:29.969277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:30.046100 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d31145-0513-4add-9adb-1a4ff07974eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:30.047248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31145-0513-4add-9adb-1a4ff07974eb None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:30.047726 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31145-0513-4add-9adb-1a4ff07974eb None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:30.048206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31145-0513-4add-9adb-1a4ff07974eb None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:30.049599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d31145-0513-4add-9adb-1a4ff07974eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:30.050210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d31145-0513-4add-9adb-1a4ff07974eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:30.053217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d31145-0513-4add-9adb-1a4ff07974eb None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:30.086173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 329/654] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:30.087966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d31145-0513-4add-9adb-1a4ff07974eb None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:30.094436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826789c-c2d6-465f-a96d-eda2b2a9ce97 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:30.137982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a8866-5a08-43c8-8087-64358d56a6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:30.138637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8866-5a08-43c8-8087-64358d56a6e0 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:30.138918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8866-5a08-43c8-8087-64358d56a6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:30.139329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8866-5a08-43c8-8087-64358d56a6e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:30.240148 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d31145-0513-4add-9adb-1a4ff07974eb None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:30.255129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a8866-5a08-43c8-8087-64358d56a6e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:30.258073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a8866-5a08-43c8-8087-64358d56a6e0 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:30.259446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:30.262292 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:30.290097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba7298-78c8-464c-bcb2-740cb4db0a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:30.290893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba7298-78c8-464c-bcb2-740cb4db0a81 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:30.291295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba7298-78c8-464c-bcb2-740cb4db0a81 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:30.291591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba7298-78c8-464c-bcb2-740cb4db0a81 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:30.302432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba7298-78c8-464c-bcb2-740cb4db0a81 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:30.304009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba7298-78c8-464c-bcb2-740cb4db0a81 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-beba7298-78c8-464c-bcb2-740cb4db0a81 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:30.317426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:30.318498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:30.319514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:30.319514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:30.319514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:30.319514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:30.319514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:30.319514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:30.319514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:30.319514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:30.319514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:39:30.319514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:30.319514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 330/655] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:30.320154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba7298-78c8-464c-bcb2-740cb4db0a81 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:30.418988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 326/656] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:30.419719 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb96d9-378e-45a4-8210-2d69b0afbeca None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:30.420217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb96d9-378e-45a4-8210-2d69b0afbeca None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:30.420708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb96d9-378e-45a4-8210-2d69b0afbeca None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:30.423899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 327/657] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:30 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:30.426213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb96d9-378e-45a4-8210-2d69b0afbeca None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:30.466485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba7298-78c8-464c-bcb2-740cb4db0a81 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:30.518508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529c057-00fc-4fdc-9d5b-8d06f2cfa914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:30.519642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529c057-00fc-4fdc-9d5b-8d06f2cfa914 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:30.520416 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529c057-00fc-4fdc-9d5b-8d06f2cfa914 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:30.520838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529c057-00fc-4fdc-9d5b-8d06f2cfa914 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:30.530331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529c057-00fc-4fdc-9d5b-8d06f2cfa914 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:30.531894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529c057-00fc-4fdc-9d5b-8d06f2cfa914 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-c529c057-00fc-4fdc-9d5b-8d06f2cfa914 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:30.545371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:30.546405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:30.547409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:30.547409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:30.547409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:30.547409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:30.547409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:30.547409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:30.547409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:30.547409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:30.547409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:39:30.547409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:30.547409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 331/658] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:30.548020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529c057-00fc-4fdc-9d5b-8d06f2cfa914 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:30.594538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:30.603891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb96d9-378e-45a4-8210-2d69b0afbeca None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:30.606078 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:30.660432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e9887-17cb-4115-a639-758f011ed96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:30.661078 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e9887-17cb-4115-a639-758f011ed96d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:30.661389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e9887-17cb-4115-a639-758f011ed96d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:30.661645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e9887-17cb-4115-a639-758f011ed96d None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:30.663378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e9887-17cb-4115-a639-758f011ed96d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:30.663378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e9887-17cb-4115-a639-758f011ed96d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:30.664360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e9887-17cb-4115-a639-758f011ed96d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:30.686196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 328/659] 10.222.0.124 () {56 vars in 1142 bytes} [Mon Aug 1 16:39:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:30.687723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad607f-d894-460c-9abe-d65c4d2c763e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:30.688021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad607f-d894-460c-9abe-d65c4d2c763e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:30.688473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad607f-d894-460c-9abe-d65c4d2c763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:30.711860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1cad607f-d894-460c-9abe-d65c4d2c763e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:30.713121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1cad607f-d894-460c-9abe-d65c4d2c763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:30.713953 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529c057-00fc-4fdc-9d5b-8d06f2cfa914 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:30.759396 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c20b3a-f156-4ffc-ac94-b1bba3af5294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:30.760305 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20b3a-f156-4ffc-ac94-b1bba3af5294 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:30.760636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20b3a-f156-4ffc-ac94-b1bba3af5294 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:30.761010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20b3a-f156-4ffc-ac94-b1bba3af5294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:30.774400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c20b3a-f156-4ffc-ac94-b1bba3af5294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:30.776147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c20b3a-f156-4ffc-ac94-b1bba3af5294 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-99c20b3a-f156-4ffc-ac94-b1bba3af5294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:30.794634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:30.796704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:30.798728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:30.798728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:30.798728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:30.798728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:30.798728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 332/660] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:30.800892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c20b3a-f156-4ffc-ac94-b1bba3af5294 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:30.815452 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 329/661] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:30.817645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad607f-d894-460c-9abe-d65c4d2c763e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:30.932264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:30.955495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c20b3a-f156-4ffc-ac94-b1bba3af5294 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:30.983328 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:30.998800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad607f-d894-460c-9abe-d65c4d2c763e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:31.002170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5cf80-3eb3-411e-b657-bd26bd7fb058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:31.004008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cf80-3eb3-411e-b657-bd26bd7fb058 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:31.004407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cf80-3eb3-411e-b657-bd26bd7fb058 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:31.004564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cf80-3eb3-411e-b657-bd26bd7fb058 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:31.005422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5cf80-3eb3-411e-b657-bd26bd7fb058 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:31.005779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5cf80-3eb3-411e-b657-bd26bd7fb058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:31.007294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5cf80-3eb3-411e-b657-bd26bd7fb058 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:31.039971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 333/662] 10.222.0.124 () {56 vars in 1144 bytes} [Mon Aug 1 16:39:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:31.040914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5cf80-3eb3-411e-b657-bd26bd7fb058 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:31.083549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c345b-9a24-4a5b-8cef-8ef0a6a7176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:31.086680 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c345b-9a24-4a5b-8cef-8ef0a6a7176f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:31.087936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c345b-9a24-4a5b-8cef-8ef0a6a7176f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:31.089091 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c345b-9a24-4a5b-8cef-8ef0a6a7176f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:31.194017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5cf80-3eb3-411e-b657-bd26bd7fb058 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:31.238926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af26e0-78c2-4447-8c6b-31cdf78216ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:31.239612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af26e0-78c2-4447-8c6b-31cdf78216ab None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:31.239892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af26e0-78c2-4447-8c6b-31cdf78216ab None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:31.240170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af26e0-78c2-4447-8c6b-31cdf78216ab None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:31.241061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af26e0-78c2-4447-8c6b-31cdf78216ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:31.241315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af26e0-78c2-4447-8c6b-31cdf78216ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:31.242851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af26e0-78c2-4447-8c6b-31cdf78216ab None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:31.263421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 334/663] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:31.263832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af26e0-78c2-4447-8c6b-31cdf78216ab None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:31.266837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:31.269625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c345b-9a24-4a5b-8cef-8ef0a6a7176f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:31.272552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c345b-9a24-4a5b-8cef-8ef0a6a7176f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:31.416929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af26e0-78c2-4447-8c6b-31cdf78216ab None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:31.470330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:31.477742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636a845-b273-424f-b954-14daf8a8f738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:31.478574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636a845-b273-424f-b954-14daf8a8f738 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:31.478721 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636a845-b273-424f-b954-14daf8a8f738 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:31.479271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636a845-b273-424f-b954-14daf8a8f738 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:31.494985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 330/664] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:31.494985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c345b-9a24-4a5b-8cef-8ef0a6a7176f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:31.512761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636a845-b273-424f-b954-14daf8a8f738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d636a845-b273-424f-b954-14daf8a8f738 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:31.519029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:31.520886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 335/665] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:31.522472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636a845-b273-424f-b954-14daf8a8f738 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:31.638252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:31.685986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c345b-9a24-4a5b-8cef-8ef0a6a7176f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:31.714982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636a845-b273-424f-b954-14daf8a8f738 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:31.750458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009841d4-32dc-4390-a337-57ae2a7e0272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:31.751473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009841d4-32dc-4390-a337-57ae2a7e0272 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:31.751908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009841d4-32dc-4390-a337-57ae2a7e0272 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:31.752386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009841d4-32dc-4390-a337-57ae2a7e0272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:31.789251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56fc10-dbeb-4370-84e8-9ddb7b08a300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:31.791007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56fc10-dbeb-4370-84e8-9ddb7b08a300 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:31.791748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56fc10-dbeb-4370-84e8-9ddb7b08a300 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:31.792191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56fc10-dbeb-4370-84e8-9ddb7b08a300 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:31.806458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56fc10-dbeb-4370-84e8-9ddb7b08a300 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:31.808509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56fc10-dbeb-4370-84e8-9ddb7b08a300 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-fc56fc10-dbeb-4370-84e8-9ddb7b08a300 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:31.841358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:31.843377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:31.845344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:31.845344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:31.845344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:31.845344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:31.845344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:31.845344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:31.845344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:31.845344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:31.848684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 336/666] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:31.850364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56fc10-dbeb-4370-84e8-9ddb7b08a300 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:31.872150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:31.890390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009841d4-32dc-4390-a337-57ae2a7e0272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:31.895987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009841d4-32dc-4390-a337-57ae2a7e0272 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:32.028480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56fc10-dbeb-4370-84e8-9ddb7b08a300 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:32.059414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:32.080044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 331/667] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:32.080044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009841d4-32dc-4390-a337-57ae2a7e0272 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:32.084735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcc77f-55d0-49f0-8a5d-15330566221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:32.086391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc77f-55d0-49f0-8a5d-15330566221b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:32.087426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc77f-55d0-49f0-8a5d-15330566221b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:32.087915 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc77f-55d0-49f0-8a5d-15330566221b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:32.109737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcc77f-55d0-49f0-8a5d-15330566221b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:32.112796 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcc77f-55d0-49f0-8a5d-15330566221b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-0dbcc77f-55d0-49f0-8a5d-15330566221b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:32.147524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:32.148689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:32.155041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:32.155041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:32.155041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:32.155041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:32.155041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 337/668] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:32.155041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcc77f-55d0-49f0-8a5d-15330566221b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:32.193929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:32.207130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009841d4-32dc-4390-a337-57ae2a7e0272 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:32.248725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b1d47-51aa-482a-aba7-5515b5f3a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:32.249377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b1d47-51aa-482a-aba7-5515b5f3a50d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:32.249898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b1d47-51aa-482a-aba7-5515b5f3a50d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:32.250045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b1d47-51aa-482a-aba7-5515b5f3a50d None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:32.250673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b1d47-51aa-482a-aba7-5515b5f3a50d None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:32.251017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b1d47-51aa-482a-aba7-5515b5f3a50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:32.252724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b1d47-51aa-482a-aba7-5515b5f3a50d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:32.267895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 332/669] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:32 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:32.269564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b1d47-51aa-482a-aba7-5515b5f3a50d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:32.325841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcc77f-55d0-49f0-8a5d-15330566221b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:32.370149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea81bb1-625c-456a-8543-b3dac182865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:32.370810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea81bb1-625c-456a-8543-b3dac182865a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:32.371164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea81bb1-625c-456a-8543-b3dac182865a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:32.371480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea81bb1-625c-456a-8543-b3dac182865a None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:32.373463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea81bb1-625c-456a-8543-b3dac182865a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:32.373803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea81bb1-625c-456a-8543-b3dac182865a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:32.376792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea81bb1-625c-456a-8543-b3dac182865a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:32.403173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 338/670] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:32.403173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea81bb1-625c-456a-8543-b3dac182865a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:32.448097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:32.456218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b1d47-51aa-482a-aba7-5515b5f3a50d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:32.516668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d5558-2c46-4191-aace-a7df68235ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:32.517357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d5558-2c46-4191-aace-a7df68235ab3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:32.517631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d5558-2c46-4191-aace-a7df68235ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:32.518040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d5558-2c46-4191-aace-a7df68235ab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:32.531518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d5558-2c46-4191-aace-a7df68235ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:32.533035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d5558-2c46-4191-aace-a7df68235ab3 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:32.545751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea81bb1-625c-456a-8543-b3dac182865a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-9a7d5558-2c46-4191-aace-a7df68235ab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:32.551146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:32.552873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:32.554698 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:32.554698 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:32.554698 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:32.554698 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:32.557486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 333/671] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:32.558511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d5558-2c46-4191-aace-a7df68235ab3 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:32.563919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:32.592393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588aa62-89ff-4ba3-a01c-8b0826a195d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:32.593309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588aa62-89ff-4ba3-a01c-8b0826a195d3 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:32.593599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588aa62-89ff-4ba3-a01c-8b0826a195d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:32.593876 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588aa62-89ff-4ba3-a01c-8b0826a195d3 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:32.594684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588aa62-89ff-4ba3-a01c-8b0826a195d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:32.595037 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588aa62-89ff-4ba3-a01c-8b0826a195d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:32.597428 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588aa62-89ff-4ba3-a01c-8b0826a195d3 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:32.618175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 339/672] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:32.618175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588aa62-89ff-4ba3-a01c-8b0826a195d3 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:32.721369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d5558-2c46-4191-aace-a7df68235ab3 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:32.768953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492065c3-c4cd-4c27-a1c5-8b7ff49a1343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:32.770113 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492065c3-c4cd-4c27-a1c5-8b7ff49a1343 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:32.770402 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492065c3-c4cd-4c27-a1c5-8b7ff49a1343 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:32.770675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492065c3-c4cd-4c27-a1c5-8b7ff49a1343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:32.774682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:32.784236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492065c3-c4cd-4c27-a1c5-8b7ff49a1343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:32.785818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492065c3-c4cd-4c27-a1c5-8b7ff49a1343 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:32.791369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588aa62-89ff-4ba3-a01c-8b0826a195d3 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-492065c3-c4cd-4c27-a1c5-8b7ff49a1343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:32.803992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:32.815169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:32.817002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:32.817002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:32.817002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:32.817002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:32.817002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 334/673] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:32.817002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492065c3-c4cd-4c27-a1c5-8b7ff49a1343 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:32.861171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41879520-5db3-48d7-946f-4a349df521c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:32.862373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879520-5db3-48d7-946f-4a349df521c1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:32.863024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879520-5db3-48d7-946f-4a349df521c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:32.863357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879520-5db3-48d7-946f-4a349df521c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:32.864536 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41879520-5db3-48d7-946f-4a349df521c1 None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=b1cabb41d38a40acb7d41c169cc90cb7) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:32.864857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41879520-5db3-48d7-946f-4a349df521c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:32.866366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41879520-5db3-48d7-946f-4a349df521c1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:32.883006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 340/674] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:32 2022] GET /identity/v3/role_assignments?user.id=b1cabb41d38a40acb7d41c169cc90cb7&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 610 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:32.883006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41879520-5db3-48d7-946f-4a349df521c1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:32.915575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:33.001880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492065c3-c4cd-4c27-a1c5-8b7ff49a1343 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:33.028342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41879520-5db3-48d7-946f-4a349df521c1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:33.076166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528f19d-601c-42b4-8522-87a9f01c36c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:33.076973 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528f19d-601c-42b4-8522-87a9f01c36c9 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:33.077322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528f19d-601c-42b4-8522-87a9f01c36c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:33.077672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528f19d-601c-42b4-8522-87a9f01c36c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:33.079255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834253ab-e617-46de-853a-6ecd62de3700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:33.080961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834253ab-e617-46de-853a-6ecd62de3700 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:33.082768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834253ab-e617-46de-853a-6ecd62de3700 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:33.083512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834253ab-e617-46de-853a-6ecd62de3700 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:33.085421 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834253ab-e617-46de-853a-6ecd62de3700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:33.086143 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834253ab-e617-46de-853a-6ecd62de3700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:33.088014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528f19d-601c-42b4-8522-87a9f01c36c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:33.089217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834253ab-e617-46de-853a-6ecd62de3700 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:33.089803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528f19d-601c-42b4-8522-87a9f01c36c9 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-a528f19d-601c-42b4-8522-87a9f01c36c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:33.105180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:33.107235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:33.109266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:33.109266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:33.109266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:33.109266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:33.109266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:33.109266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:33.109266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:33.109266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:33.111664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 341/675] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:33.113443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528f19d-601c-42b4-8522-87a9f01c36c9 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:33.121706 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 335/676] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:33.124633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834253ab-e617-46de-853a-6ecd62de3700 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:33.146727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:33.300987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834253ab-e617-46de-853a-6ecd62de3700 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:33.322777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528f19d-601c-42b4-8522-87a9f01c36c9 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:33.331999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:33.368808 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96733a83-0597-466f-a349-5d3343a1c685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:33.369840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733a83-0597-466f-a349-5d3343a1c685 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:33.370286 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733a83-0597-466f-a349-5d3343a1c685 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:33.370753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733a83-0597-466f-a349-5d3343a1c685 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:33.372279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96733a83-0597-466f-a349-5d3343a1c685 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:33.372837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96733a83-0597-466f-a349-5d3343a1c685 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:33.375675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96733a83-0597-466f-a349-5d3343a1c685 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:33.376732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397345f8-f7e6-42ea-a273-a05d6730e954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:33.377711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397345f8-f7e6-42ea-a273-a05d6730e954 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:33.378302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397345f8-f7e6-42ea-a273-a05d6730e954 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:33.378644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397345f8-f7e6-42ea-a273-a05d6730e954 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:33.379592 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397345f8-f7e6-42ea-a273-a05d6730e954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:33.379952 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397345f8-f7e6-42ea-a273-a05d6730e954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:33.381553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397345f8-f7e6-42ea-a273-a05d6730e954 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:33.404296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 342/677] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:33.404296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397345f8-f7e6-42ea-a273-a05d6730e954 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:33.405493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 336/678] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:33.405493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99ace-ab43-4d96-b772-7b0e14f45b0b None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:33.405493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99ace-ab43-4d96-b772-7b0e14f45b0b None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:33.405493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99ace-ab43-4d96-b772-7b0e14f45b0b None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:33.406455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 337/679] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:33 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:33.408805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc99ace-ab43-4d96-b772-7b0e14f45b0b None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:33.555543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:33.586348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397345f8-f7e6-42ea-a273-a05d6730e954 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:33.640794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc99ace-ab43-4d96-b772-7b0e14f45b0b None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:33.641073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481f4ba-4098-483d-a17a-48f0c19c9596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:33.641793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481f4ba-4098-483d-a17a-48f0c19c9596 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:33.642113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481f4ba-4098-483d-a17a-48f0c19c9596 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:33.642382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481f4ba-4098-483d-a17a-48f0c19c9596 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:33.657121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481f4ba-4098-483d-a17a-48f0c19c9596 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:33.660382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481f4ba-4098-483d-a17a-48f0c19c9596 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-4481f4ba-4098-483d-a17a-48f0c19c9596 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:33.682982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:33.684524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:33.685704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:33.685704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:33.685704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:33.685704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:33.685704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:33.685704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:33.685704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:33.685704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:33.685704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 343/680] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:33.686636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481f4ba-4098-483d-a17a-48f0c19c9596 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:33.702774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a77dd9-1ba0-4372-8f37-ed8479c0810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:33.703771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a77dd9-1ba0-4372-8f37-ed8479c0810a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:33.704209 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a77dd9-1ba0-4372-8f37-ed8479c0810a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:33.704655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a77dd9-1ba0-4372-8f37-ed8479c0810a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:33.705732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a77dd9-1ba0-4372-8f37-ed8479c0810a None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=8d0c157c2bd44a0089f5efb058be372b) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:33.706278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a77dd9-1ba0-4372-8f37-ed8479c0810a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:33.708033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a77dd9-1ba0-4372-8f37-ed8479c0810a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:33.716575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 338/681] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:33 2022] GET /identity/v3/role_assignments?user.id=8d0c157c2bd44a0089f5efb058be372b&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 610 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:33.718137 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15def721-dcce-45eb-b894-0fb6ff4447a8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:33.718536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15def721-dcce-45eb-b894-0fb6ff4447a8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:33.718914 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15def721-dcce-45eb-b894-0fb6ff4447a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:33.748475 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-15def721-dcce-45eb-b894-0fb6ff4447a8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:33.750552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-15def721-dcce-45eb-b894-0fb6ff4447a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:33.820860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:33.897957 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 339/682] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:33.900723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15def721-dcce-45eb-b894-0fb6ff4447a8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:33.965736 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481f4ba-4098-483d-a17a-48f0c19c9596 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:34.059806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e15279-b7fb-4914-9a9c-6d6964c09a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:34.060614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e15279-b7fb-4914-9a9c-6d6964c09a73 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:34.060968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e15279-b7fb-4914-9a9c-6d6964c09a73 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:34.061319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e15279-b7fb-4914-9a9c-6d6964c09a73 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:34.076345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e15279-b7fb-4914-9a9c-6d6964c09a73 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:34.079299 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e15279-b7fb-4914-9a9c-6d6964c09a73 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:34.086372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d2e15279-b7fb-4914-9a9c-6d6964c09a73 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:34.111440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:34.113036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:34.114092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:34.114092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:34.114092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:34.114092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:34.114092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:34.114092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:34.114092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:34.114092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:34.114092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:39:34.114092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:34.117790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 344/683] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:34.118612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15def721-dcce-45eb-b894-0fb6ff4447a8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:34.120237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e15279-b7fb-4914-9a9c-6d6964c09a73 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:34.194156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44e5c0-1574-4119-a6f9-96abee5dafbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:34.195438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44e5c0-1574-4119-a6f9-96abee5dafbd None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:34.196057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44e5c0-1574-4119-a6f9-96abee5dafbd None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:34.196648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44e5c0-1574-4119-a6f9-96abee5dafbd None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:34.198355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44e5c0-1574-4119-a6f9-96abee5dafbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:34.199091 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44e5c0-1574-4119-a6f9-96abee5dafbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:34.202008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44e5c0-1574-4119-a6f9-96abee5dafbd None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:34.235124 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 340/684] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:34.237223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44e5c0-1574-4119-a6f9-96abee5dafbd None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:34.305270 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:34.350464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e15279-b7fb-4914-9a9c-6d6964c09a73 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:34.432922 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f7d4a-d0af-4c5e-832b-5bb04db85608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:34.434819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f7d4a-d0af-4c5e-832b-5bb04db85608 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:34.435068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f7d4a-d0af-4c5e-832b-5bb04db85608 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:34.435677 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f7d4a-d0af-4c5e-832b-5bb04db85608 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:34.452965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44e5c0-1574-4119-a6f9-96abee5dafbd None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:34.459946 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f7d4a-d0af-4c5e-832b-5bb04db85608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d94f7d4a-d0af-4c5e-832b-5bb04db85608 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:34.472339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:34.474268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:34.475820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:34.479354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 345/685] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:34.480740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f7d4a-d0af-4c5e-832b-5bb04db85608 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:34.531743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a5db-09ff-4ae1-b477-5a7acfe34c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:34.533756 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a5db-09ff-4ae1-b477-5a7acfe34c09 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:34.534794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a5db-09ff-4ae1-b477-5a7acfe34c09 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:34.535555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a5db-09ff-4ae1-b477-5a7acfe34c09 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:34.537369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72a5db-09ff-4ae1-b477-5a7acfe34c09 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:34.538210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72a5db-09ff-4ae1-b477-5a7acfe34c09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:34.541261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72a5db-09ff-4ae1-b477-5a7acfe34c09 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:34.578258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 341/686] 10.222.0.124 () {56 vars in 1140 bytes} [Mon Aug 1 16:39:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:34.580314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a5db-09ff-4ae1-b477-5a7acfe34c09 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:34.631369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:34.725637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f7d4a-d0af-4c5e-832b-5bb04db85608 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:34.757814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:34.782092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a5db-09ff-4ae1-b477-5a7acfe34c09 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:34.804841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60a16b-97da-4420-8a0a-ad80bff1fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:34.806524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60a16b-97da-4420-8a0a-ad80bff1fd55 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:34.807279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60a16b-97da-4420-8a0a-ad80bff1fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:34.807958 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60a16b-97da-4420-8a0a-ad80bff1fd55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:34.809777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60a16b-97da-4420-8a0a-ad80bff1fd55 None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=dcfe4d6c32064d79835c415d9fc02cfb) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:34.810601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60a16b-97da-4420-8a0a-ad80bff1fd55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:34.813935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60a16b-97da-4420-8a0a-ad80bff1fd55 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:34.834257 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 346/687] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:34 2022] GET /identity/v3/role_assignments?user.id=dcfe4d6c32064d79835c415d9fc02cfb&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 610 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:34.836773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60a16b-97da-4420-8a0a-ad80bff1fd55 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:34.854311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c314dbb-a6c3-48ef-8e09-a1997e806174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:34.855710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c314dbb-a6c3-48ef-8e09-a1997e806174 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:34.856329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c314dbb-a6c3-48ef-8e09-a1997e806174 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:34.856949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c314dbb-a6c3-48ef-8e09-a1997e806174 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:34.858463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c314dbb-a6c3-48ef-8e09-a1997e806174 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:34.859179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c314dbb-a6c3-48ef-8e09-a1997e806174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:34.862355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c314dbb-a6c3-48ef-8e09-a1997e806174 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:34.880160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 342/688] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:34.890258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c314dbb-a6c3-48ef-8e09-a1997e806174 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:35.125722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c314dbb-a6c3-48ef-8e09-a1997e806174 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:35.203424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2515bd-d251-4604-ac60-0b9a5cb35b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:35.204609 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2515bd-d251-4604-ac60-0b9a5cb35b0d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:35.205142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2515bd-d251-4604-ac60-0b9a5cb35b0d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:35.205619 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2515bd-d251-4604-ac60-0b9a5cb35b0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:35.229451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60a16b-97da-4420-8a0a-ad80bff1fd55 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:35.231952 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2515bd-d251-4604-ac60-0b9a5cb35b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:35.235357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2515bd-d251-4604-ac60-0b9a5cb35b0d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-0e2515bd-d251-4604-ac60-0b9a5cb35b0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:35.272057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:35.273663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:35.275236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:35.275236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:35.275236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:35.275236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:35.279023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 343/689] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:35.290506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2515bd-d251-4604-ac60-0b9a5cb35b0d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:35.292481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:35.296491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:35.317353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d3d2f-3d50-4b51-a3f2-2ce84d79af9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:35.318852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3d2f-3d50-4b51-a3f2-2ce84d79af9d None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:35.319404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3d2f-3d50-4b51-a3f2-2ce84d79af9d None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:35.319907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d3d2f-3d50-4b51-a3f2-2ce84d79af9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:35.478602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d3d2f-3d50-4b51-a3f2-2ce84d79af9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:35.480866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d3d2f-3d50-4b51-a3f2-2ce84d79af9d None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:35.529625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2515bd-d251-4604-ac60-0b9a5cb35b0d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:35.621374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a3b53-51f9-4653-a5db-d4f0e519da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:35.622731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a3b53-51f9-4653-a5db-d4f0e519da19 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:35.623561 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a3b53-51f9-4653-a5db-d4f0e519da19 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:35.624474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a3b53-51f9-4653-a5db-d4f0e519da19 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:35.626891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a3b53-51f9-4653-a5db-d4f0e519da19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:35.627840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a3b53-51f9-4653-a5db-d4f0e519da19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:35.631106 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a3b53-51f9-4653-a5db-d4f0e519da19 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:35.670766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 344/690] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:35.673308 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f12c1f-d628-48a4-91a9-7f9083f432b1 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:35.673883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f12c1f-d628-48a4-91a9-7f9083f432b1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:35.674399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f12c1f-d628-48a4-91a9-7f9083f432b1 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:35.681283 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 345/691] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:35 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:35.682372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f12c1f-d628-48a4-91a9-7f9083f432b1 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:35.704602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 347/692] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 869 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:35.707933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399d72-8e30-49f5-a577-2d783d6b05c3 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:35.708685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399d72-8e30-49f5-a577-2d783d6b05c3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:35.709922 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399d72-8e30-49f5-a577-2d783d6b05c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:35.742647 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-9f399d72-8e30-49f5-a577-2d783d6b05c3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:35.744885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9f399d72-8e30-49f5-a577-2d783d6b05c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:35.780198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:35.825549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:35.885106 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f12c1f-d628-48a4-91a9-7f9083f432b1 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:35.886400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 348/693] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:35.888215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399d72-8e30-49f5-a577-2d783d6b05c3 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:35.930302 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c63fbb-7b0e-41c1-99e4-4c95cc1fae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:35.931039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c63fbb-7b0e-41c1-99e4-4c95cc1fae0d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:35.931325 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c63fbb-7b0e-41c1-99e4-4c95cc1fae0d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:35.931609 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c63fbb-7b0e-41c1-99e4-4c95cc1fae0d None admin] PATH_INFO: `/v3/users/nova` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:35.941078 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c63fbb-7b0e-41c1-99e4-4c95cc1fae0d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:35.942736 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c63fbb-7b0e-41c1-99e4-4c95cc1fae0d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-f3c63fbb-7b0e-41c1-99e4-4c95cc1fae0d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:35.957922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:35.960047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:35.962139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:35.962139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:35.962139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:35.962139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:35.962139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:35.962139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:35.962139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:35.962139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:35.962139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:35.962139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:35.963821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 346/694] 10.222.0.124 () {56 vars in 1098 bytes} [Mon Aug 1 16:39:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:35.969109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c63fbb-7b0e-41c1-99e4-4c95cc1fae0d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:36.083325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399d72-8e30-49f5-a577-2d783d6b05c3 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:36.137611 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c63fbb-7b0e-41c1-99e4-4c95cc1fae0d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:36.155991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9616d9-fedc-44e2-88e8-f99488d68284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:36.156541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9616d9-fedc-44e2-88e8-f99488d68284 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:36.157038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9616d9-fedc-44e2-88e8-f99488d68284 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:36.157551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9616d9-fedc-44e2-88e8-f99488d68284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:36.180971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9616d9-fedc-44e2-88e8-f99488d68284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:36.184246 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9616d9-fedc-44e2-88e8-f99488d68284 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:36.192433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-ea9616d9-fedc-44e2-88e8-f99488d68284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:36.221572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:36.223563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:36.225617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:36.225617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:36.225617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:36.225617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:36.230136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68252c0c-9ebe-406e-92ba-ecb4f0335f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:36.231674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68252c0c-9ebe-406e-92ba-ecb4f0335f65 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:36.232422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68252c0c-9ebe-406e-92ba-ecb4f0335f65 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:36.233134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68252c0c-9ebe-406e-92ba-ecb4f0335f65 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:36.234995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68252c0c-9ebe-406e-92ba-ecb4f0335f65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:36.235171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 349/695] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:36.236042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68252c0c-9ebe-406e-92ba-ecb4f0335f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:36.237260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9616d9-fedc-44e2-88e8-f99488d68284 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:36.239949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68252c0c-9ebe-406e-92ba-ecb4f0335f65 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:36.244902 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:36.284342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 347/696] 10.222.0.124 () {56 vars in 1138 bytes} [Mon Aug 1 16:39:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:36.285948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68252c0c-9ebe-406e-92ba-ecb4f0335f65 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:36.473962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9616d9-fedc-44e2-88e8-f99488d68284 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:36.540408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68252c0c-9ebe-406e-92ba-ecb4f0335f65 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:36.559886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc9b06-fd80-4b99-bc07-9df965f34d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:36.561126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc9b06-fd80-4b99-bc07-9df965f34d41 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:36.561724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc9b06-fd80-4b99-bc07-9df965f34d41 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:36.562283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc9b06-fd80-4b99-bc07-9df965f34d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:36.585260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc9b06-fd80-4b99-bc07-9df965f34d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:36.588075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc9b06-fd80-4b99-bc07-9df965f34d41 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:36.616992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a143-522e-43dc-99a2-f6c9e8695ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:36.618563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a143-522e-43dc-99a2-f6c9e8695ab7 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:36.619372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a143-522e-43dc-99a2-f6c9e8695ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-bcdc9b06-fd80-4b99-bc07-9df965f34d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:36.619832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:36.621317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:36.623634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:36.623634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:36.623634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:36.623634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:36.625196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a143-522e-43dc-99a2-f6c9e8695ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:36.629364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3a143-522e-43dc-99a2-f6c9e8695ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:36.630487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3a143-522e-43dc-99a2-f6c9e8695ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:36.630653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 350/697] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:36.632253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc9b06-fd80-4b99-bc07-9df965f34d41 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:36.634313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3a143-522e-43dc-99a2-f6c9e8695ab7 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:36.660816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 348/698] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:36.662799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a143-522e-43dc-99a2-f6c9e8695ab7 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:36.753646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:36.756619 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:36.853305 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc9b06-fd80-4b99-bc07-9df965f34d41 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:36.853747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a143-522e-43dc-99a2-f6c9e8695ab7 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:36.913271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b4fb9-0673-4d0f-acf0-295561ce9bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:36.914441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4fb9-0673-4d0f-acf0-295561ce9bdd None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:36.915232 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4fb9-0673-4d0f-acf0-295561ce9bdd None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:36.915759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4fb9-0673-4d0f-acf0-295561ce9bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:36.926604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303f48c-c34e-46f6-859e-88994a89dadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:36.927879 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f48c-c34e-46f6-859e-88994a89dadc None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:36.928369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f48c-c34e-46f6-859e-88994a89dadc None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:36.928864 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f48c-c34e-46f6-859e-88994a89dadc None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:36.930493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303f48c-c34e-46f6-859e-88994a89dadc None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:36.931065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303f48c-c34e-46f6-859e-88994a89dadc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:36.933816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303f48c-c34e-46f6-859e-88994a89dadc None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:36.968901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 349/699] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:36.968901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303f48c-c34e-46f6-859e-88994a89dadc None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:37.054988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b4fb9-0673-4d0f-acf0-295561ce9bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:37.056930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b4fb9-0673-4d0f-acf0-295561ce9bdd None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:37.152638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:37.156952 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:37.162825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303f48c-c34e-46f6-859e-88994a89dadc None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:37.225106 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079cb06-8fb8-4fde-83ca-c706249f06f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:37.225918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cb06-8fb8-4fde-83ca-c706249f06f9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:37.226201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cb06-8fb8-4fde-83ca-c706249f06f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:37.226479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cb06-8fb8-4fde-83ca-c706249f06f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:37.236110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079cb06-8fb8-4fde-83ca-c706249f06f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:37.238587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079cb06-8fb8-4fde-83ca-c706249f06f9 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:37.239667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 351/700] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:37.242399 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dfaff-0c30-4e2c-8cba-4898b6bdb98a None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:37.242941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dfaff-0c30-4e2c-8cba-4898b6bdb98a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:37.243493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dfaff-0c30-4e2c-8cba-4898b6bdb98a None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:37.246297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 352/701] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:37 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:37.248601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0dfaff-0c30-4e2c-8cba-4898b6bdb98a None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-e079cb06-8fb8-4fde-83ca-c706249f06f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:37.263576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:37.265318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:37.276743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:37.276743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:37.276743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:37.276743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:37.276743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:37.276743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:37.276743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:37.276743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:37.276743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 350/702] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:37.276743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079cb06-8fb8-4fde-83ca-c706249f06f9 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:37.468930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0dfaff-0c30-4e2c-8cba-4898b6bdb98a None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:37.488002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079cb06-8fb8-4fde-83ca-c706249f06f9 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:37.532993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd318d-c74b-41b5-acb2-58cbf1bf2e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:37.534003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd318d-c74b-41b5-acb2-58cbf1bf2e59 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:37.534628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd318d-c74b-41b5-acb2-58cbf1bf2e59 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:37.535152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd318d-c74b-41b5-acb2-58cbf1bf2e59 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:37.536314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd318d-c74b-41b5-acb2-58cbf1bf2e59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:37.538896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd318d-c74b-41b5-acb2-58cbf1bf2e59 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:37.558296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7e903-684f-418f-a63e-e325909f0595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:37.559483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7e903-684f-418f-a63e-e325909f0595 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:37.559959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7e903-684f-418f-a63e-e325909f0595 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:37.560446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7e903-684f-418f-a63e-e325909f0595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:37.576551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 353/703] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:39:37 2022] POST /identity/v3/users => generated 255 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:39:37.579296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09ff36-fc4e-4e9a-908f-a19729c35e76 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:37.580057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09ff36-fc4e-4e9a-908f-a19729c35e76 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:37.580905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09ff36-fc4e-4e9a-908f-a19729c35e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:37.583171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7e903-684f-418f-a63e-e325909f0595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:37.586217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7e903-684f-418f-a63e-e325909f0595 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:37.612769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-3a09ff36-fc4e-4e9a-908f-a19729c35e76 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:37.615547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3a09ff36-fc4e-4e9a-908f-a19729c35e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-40f7e903-684f-418f-a63e-e325909f0595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:37.617904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:37.619772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:37.628515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:37.628515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:37.628515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:37.628515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:37.628515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 351/704] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:37.628515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7e903-684f-418f-a63e-e325909f0595 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:37.641953 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:37.654082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:37.755626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 354/705] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:37.757246 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09ff36-fc4e-4e9a-908f-a19729c35e76 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:37.778839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7e903-684f-418f-a63e-e325909f0595 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:37.825618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a5f4-9188-48a5-a192-35140a10f2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:37.826722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a5f4-9188-48a5-a192-35140a10f2c6 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:37.827388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a5f4-9188-48a5-a192-35140a10f2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:37.828074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a5f4-9188-48a5-a192-35140a10f2c6 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:37.829253 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974a5f4-9188-48a5-a192-35140a10f2c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:37.829890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974a5f4-9188-48a5-a192-35140a10f2c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:37.832215 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974a5f4-9188-48a5-a192-35140a10f2c6 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:37.851830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 352/706] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:37.853180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a5f4-9188-48a5-a192-35140a10f2c6 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:37.921504 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09ff36-fc4e-4e9a-908f-a19729c35e76 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:37.969751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:37.992512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fb5a0-7bfa-4b6a-9006-594b27726ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:37.993187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fb5a0-7bfa-4b6a-9006-594b27726ebd None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:37.993490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fb5a0-7bfa-4b6a-9006-594b27726ebd None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:37.993879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fb5a0-7bfa-4b6a-9006-594b27726ebd None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:37.994684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fb5a0-7bfa-4b6a-9006-594b27726ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:37.995015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fb5a0-7bfa-4b6a-9006-594b27726ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:37.996561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fb5a0-7bfa-4b6a-9006-594b27726ebd None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:38.011708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 355/707] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:38.012561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fb5a0-7bfa-4b6a-9006-594b27726ebd None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:38.018178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:38.046835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a5f4-9188-48a5-a192-35140a10f2c6 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:38.120817 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fd8be-105a-4ba3-b9e1-e0bec8386a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:38.121940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fd8be-105a-4ba3-b9e1-e0bec8386a8a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:38.122431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fd8be-105a-4ba3-b9e1-e0bec8386a8a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:38.122922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fd8be-105a-4ba3-b9e1-e0bec8386a8a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:38.124140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fd8be-105a-4ba3-b9e1-e0bec8386a8a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:38.126917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fd8be-105a-4ba3-b9e1-e0bec8386a8a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:38.144225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fb5a0-7bfa-4b6a-9006-594b27726ebd None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-582fd8be-105a-4ba3-b9e1-e0bec8386a8a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:38.148028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:38.149696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:39:38.150930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:38.155156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 353/708] 10.222.0.124 () {56 vars in 1134 bytes} [Mon Aug 1 16:39:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:38.156866 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fd8be-105a-4ba3-b9e1-e0bec8386a8a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:38.195804 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3f0d9-6c96-440d-ad41-51d05a769fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:38.196573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3f0d9-6c96-440d-ad41-51d05a769fa5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:38.196975 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3f0d9-6c96-440d-ad41-51d05a769fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:38.197356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3f0d9-6c96-440d-ad41-51d05a769fa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:38.198389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3f0d9-6c96-440d-ad41-51d05a769fa5 None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=7b46aa077b4147c9836b646cf42cff50) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:38.198820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3f0d9-6c96-440d-ad41-51d05a769fa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:38.200559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3f0d9-6c96-440d-ad41-51d05a769fa5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:38.208557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 356/709] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:38 2022] GET /identity/v3/role_assignments?user.id=7b46aa077b4147c9836b646cf42cff50&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 610 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:38.214877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3f0d9-6c96-440d-ad41-51d05a769fa5 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:38.342425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fd8be-105a-4ba3-b9e1-e0bec8386a8a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:38.370661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:38.394501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ce4f2-45f6-4bf9-9744-0cb5567747a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:38.395222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce4f2-45f6-4bf9-9744-0cb5567747a8 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:38.395504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce4f2-45f6-4bf9-9744-0cb5567747a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:38.395781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce4f2-45f6-4bf9-9744-0cb5567747a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:38.399601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:38.406613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ce4f2-45f6-4bf9-9744-0cb5567747a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:38.409046 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ce4f2-45f6-4bf9-9744-0cb5567747a8 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-2a2ce4f2-45f6-4bf9-9744-0cb5567747a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:38.423890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:38.425187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:38.426217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:38.426217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:38.426217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:38.426217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:38.426217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:38.426217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:38.426217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:38.426217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:38.428648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 354/710] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:38.430317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f0da-e1d2-40bf-90fa-98cfb869a8af None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:38.430774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f0da-e1d2-40bf-90fa-98cfb869a8af None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:38.431211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f0da-e1d2-40bf-90fa-98cfb869a8af None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:38.432986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 355/711] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:38.439983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9082b-3cae-4694-9240-805a5fca7262 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:38.440729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9082b-3cae-4694-9240-805a5fca7262 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:38.441249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9082b-3cae-4694-9240-805a5fca7262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:38.456710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3f0d9-6c96-440d-ad41-51d05a769fa5 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:38.465523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-10c9082b-3cae-4694-9240-805a5fca7262 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:38.467139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-10c9082b-3cae-4694-9240-805a5fca7262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:38.540961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47c6b0-f0db-48d1-b865-cbb35be534df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:38.541971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47c6b0-f0db-48d1-b865-cbb35be534df None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:38.542420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47c6b0-f0db-48d1-b865-cbb35be534df None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:38.542864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47c6b0-f0db-48d1-b865-cbb35be534df None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:38.544239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47c6b0-f0db-48d1-b865-cbb35be534df None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:38.544873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47c6b0-f0db-48d1-b865-cbb35be534df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:38.547356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47c6b0-f0db-48d1-b865-cbb35be534df None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:38.558428 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 357/712] 10.222.0.124 () {56 vars in 1129 bytes} [Mon Aug 1 16:39:38 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:38.564766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47c6b0-f0db-48d1-b865-cbb35be534df None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:38.605702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 356/713] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:38.607219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9082b-3cae-4694-9240-805a5fca7262 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:38.742384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47c6b0-f0db-48d1-b865-cbb35be534df None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:38.787667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:38.805229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c50ace-bbeb-4b17-b75c-f88d448e8edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:38.806696 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50ace-bbeb-4b17-b75c-f88d448e8edf None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:38.807446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50ace-bbeb-4b17-b75c-f88d448e8edf None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:38.808134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50ace-bbeb-4b17-b75c-f88d448e8edf None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:38.809812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c50ace-bbeb-4b17-b75c-f88d448e8edf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:38.810596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c50ace-bbeb-4b17-b75c-f88d448e8edf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:38.813189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c50ace-bbeb-4b17-b75c-f88d448e8edf None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:38.838599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 358/714] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:38.840169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c50ace-bbeb-4b17-b75c-f88d448e8edf None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:38.840358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9082b-3cae-4694-9240-805a5fca7262 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:38.897073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:38.915447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f862f-c0e7-4b3f-9b67-a19d9727be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:38.916429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f862f-c0e7-4b3f-9b67-a19d9727be65 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:38.916973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f862f-c0e7-4b3f-9b67-a19d9727be65 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:38.917400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f862f-c0e7-4b3f-9b67-a19d9727be65 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:38.918570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f862f-c0e7-4b3f-9b67-a19d9727be65 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:38.919181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f862f-c0e7-4b3f-9b67-a19d9727be65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:38.922179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f862f-c0e7-4b3f-9b67-a19d9727be65 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:38.934917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 357/715] 10.222.0.124 () {56 vars in 1129 bytes} [Mon Aug 1 16:39:38 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:38.936675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f862f-c0e7-4b3f-9b67-a19d9727be65 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:39.095304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c50ace-bbeb-4b17-b75c-f88d448e8edf None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:39.188317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f862f-c0e7-4b3f-9b67-a19d9727be65 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:39.198647 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df10b-a890-443a-a11c-ccfb3d5ec364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:39.199380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df10b-a890-443a-a11c-ccfb3d5ec364 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:39.199664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df10b-a890-443a-a11c-ccfb3d5ec364 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:39.199949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df10b-a890-443a-a11c-ccfb3d5ec364 None admin] PATH_INFO: `/v3/services/network` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:39.200617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32df10b-a890-443a-a11c-ccfb3d5ec364 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:39.202083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32df10b-a890-443a-a11c-ccfb3d5ec364 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-b32df10b-a890-443a-a11c-ccfb3d5ec364 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:39.227032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:39.228080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:39:39.228945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:39.234881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 359/716] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:38 2022] GET /identity/v3/services/network => generated 88 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:39.242537 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df10b-a890-443a-a11c-ccfb3d5ec364 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:39.267001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844af4d7-01ea-494a-ab26-f9d25f38d3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:39.268140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844af4d7-01ea-494a-ab26-f9d25f38d3fc None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:39.268678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844af4d7-01ea-494a-ab26-f9d25f38d3fc None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:39.269202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844af4d7-01ea-494a-ab26-f9d25f38d3fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:39.270655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844af4d7-01ea-494a-ab26-f9d25f38d3fc None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=9728f2fe7b5a40cd9f8ead5cf99af581) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:39.271226 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844af4d7-01ea-494a-ab26-f9d25f38d3fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:39.274122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844af4d7-01ea-494a-ab26-f9d25f38d3fc None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:39.296547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 358/717] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:38 2022] GET /identity/v3/role_assignments?user.id=9728f2fe7b5a40cd9f8ead5cf99af581&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=390e487a45f74246ba84773e8760bc7c => generated 260 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:39.343884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:39.447831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df10b-a890-443a-a11c-ccfb3d5ec364 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:39.505115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a659903-aaf8-4f88-b800-d14d14c35fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:39.506332 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a659903-aaf8-4f88-b800-d14d14c35fce None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:39.506332 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a659903-aaf8-4f88-b800-d14d14c35fce None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:39.506332 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a659903-aaf8-4f88-b800-d14d14c35fce None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:39.507274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a659903-aaf8-4f88-b800-d14d14c35fce None admin] RBAC: Adding query filter params (name=network) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:39.507634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a659903-aaf8-4f88-b800-d14d14c35fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:39.509129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a659903-aaf8-4f88-b800-d14d14c35fce None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:39.520545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 360/718] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:39:39 2022] GET /identity/v3/services?name=network => generated 125 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:39.526245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844af4d7-01ea-494a-ab26-f9d25f38d3fc None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:39.641193 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:39.851802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844af4d7-01ea-494a-ab26-f9d25f38d3fc None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:39.910664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e276bb-f8e2-4e47-911f-6e3eda3a2d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:39.911410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e276bb-f8e2-4e47-911f-6e3eda3a2d08 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:39.911689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e276bb-f8e2-4e47-911f-6e3eda3a2d08 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:39.911964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e276bb-f8e2-4e47-911f-6e3eda3a2d08 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:39.912762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e276bb-f8e2-4e47-911f-6e3eda3a2d08 None admin] RBAC: Adding query filter params (type=network) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:39.913219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e276bb-f8e2-4e47-911f-6e3eda3a2d08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:39.915248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e276bb-f8e2-4e47-911f-6e3eda3a2d08 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:39.921806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 359/719] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:39:39 2022] GET /identity/v3/services?type=network => generated 125 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:40.562666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8c190-e955-4f43-bfa9-2f75f1fcbeca None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:40.563243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8c190-e955-4f43-bfa9-2f75f1fcbeca None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:40.563243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8c190-e955-4f43-bfa9-2f75f1fcbeca None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:40.565802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 361/720] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:40.571926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530378e-b893-4826-98b9-5edaa57ad993 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:40.572511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530378e-b893-4826-98b9-5edaa57ad993 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:40.572511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530378e-b893-4826-98b9-5edaa57ad993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:40.593453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6530378e-b893-4826-98b9-5edaa57ad993 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:40.594763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6530378e-b893-4826-98b9-5edaa57ad993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:40.725361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 360/721] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:40.772939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8c190-e955-4f43-bfa9-2f75f1fcbeca None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:40.974303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8c190-e955-4f43-bfa9-2f75f1fcbeca None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:41.024558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:41.070847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb669e-1345-4726-9935-bc66d619ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:41.072631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb669e-1345-4726-9935-bc66d619ee9c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:41.073487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb669e-1345-4726-9935-bc66d619ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:41.074320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb669e-1345-4726-9935-bc66d619ee9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:41.112758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb669e-1345-4726-9935-bc66d619ee9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-a0cb669e-1345-4726-9935-bc66d619ee9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:41.123840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:41.125680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:41.132567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:41.137504 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 362/722] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:39:41.145967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530378e-b893-4826-98b9-5edaa57ad993 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:41.268692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:41.315235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989f17b-d716-44a4-a677-b7d4d573867c None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:41.315495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989f17b-d716-44a4-a677-b7d4d573867c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:41.315829 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989f17b-d716-44a4-a677-b7d4d573867c None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:41.317707 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 363/723] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:41.326573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff1c1e-d15e-44df-9588-7b1975d79bf7 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:41.327069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff1c1e-d15e-44df-9588-7b1975d79bf7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:41.327500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff1c1e-d15e-44df-9588-7b1975d79bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:41.372952 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530378e-b893-4826-98b9-5edaa57ad993 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:41.381945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-e2ff1c1e-d15e-44df-9588-7b1975d79bf7 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:41.383342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e2ff1c1e-d15e-44df-9588-7b1975d79bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:41.445763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599a1f9-670d-462a-b44b-0b2a703b8aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:41.446788 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599a1f9-670d-462a-b44b-0b2a703b8aeb None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:41.447288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599a1f9-670d-462a-b44b-0b2a703b8aeb None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:41.447739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599a1f9-670d-462a-b44b-0b2a703b8aeb None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:41.448983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599a1f9-670d-462a-b44b-0b2a703b8aeb None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:41.449517 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599a1f9-670d-462a-b44b-0b2a703b8aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:41.452210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599a1f9-670d-462a-b44b-0b2a703b8aeb None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:41.469369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 361/724] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:41 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:41.478886 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599a1f9-670d-462a-b44b-0b2a703b8aeb None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:41.743800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 364/725] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:41.787406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff1c1e-d15e-44df-9588-7b1975d79bf7 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:41.804424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599a1f9-670d-462a-b44b-0b2a703b8aeb None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:41.838223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:41.927784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193b5af-6a56-4c26-b58e-3df3bc9732ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:41.929515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b5af-6a56-4c26-b58e-3df3bc9732ae None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:41.930350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b5af-6a56-4c26-b58e-3df3bc9732ae None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:41.931166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b5af-6a56-4c26-b58e-3df3bc9732ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:41.978442 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193b5af-6a56-4c26-b58e-3df3bc9732ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:41.983977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193b5af-6a56-4c26-b58e-3df3bc9732ae None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-d193b5af-6a56-4c26-b58e-3df3bc9732ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:42.014322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:42.016024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:42.018278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:42.018278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:42.018278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:42.018278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:42.021690 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 362/726] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 544 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:42.028549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193b5af-6a56-4c26-b58e-3df3bc9732ae None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:42.066879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff1c1e-d15e-44df-9588-7b1975d79bf7 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:42.099366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:42.166028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4533ebb-13cb-4ff7-adf7-594c61546c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:42.167521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4533ebb-13cb-4ff7-adf7-594c61546c57 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:42.168825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4533ebb-13cb-4ff7-adf7-594c61546c57 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:42.171443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4533ebb-13cb-4ff7-adf7-594c61546c57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:42.199375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4533ebb-13cb-4ff7-adf7-594c61546c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-e4533ebb-13cb-4ff7-adf7-594c61546c57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:42.213970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:42.216094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:42.217710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:42.223671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 365/727] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:39:42.232470 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4533ebb-13cb-4ff7-adf7-594c61546c57 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:42.269754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193b5af-6a56-4c26-b58e-3df3bc9732ae None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:42.365333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef6ff4-6497-43ca-a0b5-304042299995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:42.367607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6ff4-6497-43ca-a0b5-304042299995 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:42.368468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6ff4-6497-43ca-a0b5-304042299995 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:42.369167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6ff4-6497-43ca-a0b5-304042299995 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:42.371049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef6ff4-6497-43ca-a0b5-304042299995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:42.372386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef6ff4-6497-43ca-a0b5-304042299995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:42.376000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef6ff4-6497-43ca-a0b5-304042299995 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:42.412481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 363/728] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:42.416885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7940-6df3-4f2e-8de4-006615a1bff5 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:42.417733 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7940-6df3-4f2e-8de4-006615a1bff5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:42.418457 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7940-6df3-4f2e-8de4-006615a1bff5 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:42.427035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 364/729] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:42 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:42.428294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf7940-6df3-4f2e-8de4-006615a1bff5 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:42.443101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4533ebb-13cb-4ff7-adf7-594c61546c57 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:42.460691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:42.515456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34144d-ca9b-4e8d-a938-3a2fd38478d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:42.516855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34144d-ca9b-4e8d-a938-3a2fd38478d5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:42.517722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34144d-ca9b-4e8d-a938-3a2fd38478d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:42.518303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34144d-ca9b-4e8d-a938-3a2fd38478d5 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:42.519822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34144d-ca9b-4e8d-a938-3a2fd38478d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:42.520461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34144d-ca9b-4e8d-a938-3a2fd38478d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:42.523595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34144d-ca9b-4e8d-a938-3a2fd38478d5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:42.545106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 366/730] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:42.545106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341d2be-5ea4-4b00-bade-e659fad4e36e None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:42.545106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341d2be-5ea4-4b00-bade-e659fad4e36e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:42.545106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341d2be-5ea4-4b00-bade-e659fad4e36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:42.565110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf7940-6df3-4f2e-8de4-006615a1bff5 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:42.577358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-b341d2be-5ea4-4b00-bade-e659fad4e36e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:42.579491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b341d2be-5ea4-4b00-bade-e659fad4e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:42.607246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354163-7ed4-48a5-9abe-012e74e605f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:42.608256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354163-7ed4-48a5-9abe-012e74e605f3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:42.608776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354163-7ed4-48a5-9abe-012e74e605f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:42.609255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354163-7ed4-48a5-9abe-012e74e605f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:42.619520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a354163-7ed4-48a5-9abe-012e74e605f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:42.621573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a354163-7ed4-48a5-9abe-012e74e605f3 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:42.632617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-6a354163-7ed4-48a5-9abe-012e74e605f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:42.637919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:42.639170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:42.640144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:42.640144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:42.640144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:42.640144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:42.640144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:42.640144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:42.640144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:42.640144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:42.640144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:39:42.640144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:42.642942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 365/731] 10.222.0.124 () {56 vars in 1122 bytes} [Mon Aug 1 16:39:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:42.644181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354163-7ed4-48a5-9abe-012e74e605f3 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:42.719155 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 367/732] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:42.720649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341d2be-5ea4-4b00-bade-e659fad4e36e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:42.748357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:42.772087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354163-7ed4-48a5-9abe-012e74e605f3 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:42.816158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d39ed-f28c-4cc8-a0f6-6bb1e24dc2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:42.817259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d39ed-f28c-4cc8-a0f6-6bb1e24dc2c5 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:42.817550 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d39ed-f28c-4cc8-a0f6-6bb1e24dc2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:42.817827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d39ed-f28c-4cc8-a0f6-6bb1e24dc2c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:42.831579 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d39ed-f28c-4cc8-a0f6-6bb1e24dc2c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:42.833105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d39ed-f28c-4cc8-a0f6-6bb1e24dc2c5 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-cd7d39ed-f28c-4cc8-a0f6-6bb1e24dc2c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:42.849935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:42.851537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:42.852417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:42.852417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:42.852417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:42.852417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:42.852417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 366/733] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:42.853059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c259a-bd58-4f87-b847-60d848a73bf6 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:42.853253 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c259a-bd58-4f87-b847-60d848a73bf6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:42.853531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c259a-bd58-4f87-b847-60d848a73bf6 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:42.859112 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 367/734] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:42.859112 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c259a-bd58-4f87-b847-60d848a73bf6 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:42.859486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341d2be-5ea4-4b00-bade-e659fad4e36e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:42.930155 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d5192-fc81-4ba6-8bc7-2396b3e13392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:42.931264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d5192-fc81-4ba6-8bc7-2396b3e13392 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:42.931752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d5192-fc81-4ba6-8bc7-2396b3e13392 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:42.932235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d5192-fc81-4ba6-8bc7-2396b3e13392 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:42.933948 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d5192-fc81-4ba6-8bc7-2396b3e13392 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:42.934651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d5192-fc81-4ba6-8bc7-2396b3e13392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:42.937464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d5192-fc81-4ba6-8bc7-2396b3e13392 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:42.974195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c259a-bd58-4f87-b847-60d848a73bf6 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:42.981851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 368/735] 10.222.0.124 () {56 vars in 1154 bytes} [Mon Aug 1 16:39:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:42.983406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d5192-fc81-4ba6-8bc7-2396b3e13392 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:43.016438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:43.028661 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8065e-a51b-48ed-bb30-459e69f3e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:43.029566 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8065e-a51b-48ed-bb30-459e69f3e80c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:43.030035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8065e-a51b-48ed-bb30-459e69f3e80c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:43.030490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8065e-a51b-48ed-bb30-459e69f3e80c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:43.033882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:43.047691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8065e-a51b-48ed-bb30-459e69f3e80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-20f8065e-a51b-48ed-bb30-459e69f3e80c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:43.054260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:43.056436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:43.058433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 368/736] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:43.059949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa62c39-c832-495c-9320-6b5af218a1ed None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:43.059949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa62c39-c832-495c-9320-6b5af218a1ed None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:43.060201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa62c39-c832-495c-9320-6b5af218a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:43.085664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-efa62c39-c832-495c-9320-6b5af218a1ed None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:43.087471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-efa62c39-c832-495c-9320-6b5af218a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:43.161666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d5192-fc81-4ba6-8bc7-2396b3e13392 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:43.169588 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 369/737] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:43.170477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa62c39-c832-495c-9320-6b5af218a1ed None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:43.203406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c6218-e666-408c-8dc1-5acfeac2d811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:43.204049 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6218-e666-408c-8dc1-5acfeac2d811 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:43.204520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6218-e666-408c-8dc1-5acfeac2d811 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:43.204917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6218-e666-408c-8dc1-5acfeac2d811 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:43.205657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c6218-e666-408c-8dc1-5acfeac2d811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:43.205960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c6218-e666-408c-8dc1-5acfeac2d811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:43.207415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c6218-e666-408c-8dc1-5acfeac2d811 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:43.223048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 369/738] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:43.225475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c6218-e666-408c-8dc1-5acfeac2d811 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:43.327736 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa62c39-c832-495c-9320-6b5af218a1ed None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:43.338840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:43.357862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:43.371946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474590-78c3-4816-b53c-335a26422508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:43.372584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474590-78c3-4816-b53c-335a26422508 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:43.372866 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474590-78c3-4816-b53c-335a26422508 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:43.373143 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474590-78c3-4816-b53c-335a26422508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:43.373724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c6218-e666-408c-8dc1-5acfeac2d811 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:43.430618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a2396-91b3-4a5e-93af-386bcb237622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:43.431646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2396-91b3-4a5e-93af-386bcb237622 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:43.431996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2396-91b3-4a5e-93af-386bcb237622 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:43.432381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2396-91b3-4a5e-93af-386bcb237622 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:43.433631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a2396-91b3-4a5e-93af-386bcb237622 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:43.434129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a2396-91b3-4a5e-93af-386bcb237622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:43.436540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a2396-91b3-4a5e-93af-386bcb237622 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:43.456912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 370/739] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:43.456912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a3ce0-4123-4cb7-a186-6017c39b17a0 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:43.456912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a3ce0-4123-4cb7-a186-6017c39b17a0 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:43.456912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a3ce0-4123-4cb7-a186-6017c39b17a0 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:43.456912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 371/740] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:43 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:43.457722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a3ce0-4123-4cb7-a186-6017c39b17a0 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:43.489490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84474590-78c3-4816-b53c-335a26422508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:43.491154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84474590-78c3-4816-b53c-335a26422508 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:43.612560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 370/741] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:43.613336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474590-78c3-4816-b53c-335a26422508 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:43.632776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a3ce0-4123-4cb7-a186-6017c39b17a0 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:43.643334 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:43.696597 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579b4e0-a2b3-4767-a0f8-182c2d0362d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:43.697655 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579b4e0-a2b3-4767-a0f8-182c2d0362d1 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:43.698131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579b4e0-a2b3-4767-a0f8-182c2d0362d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:43.698634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579b4e0-a2b3-4767-a0f8-182c2d0362d1 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:43.700062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579b4e0-a2b3-4767-a0f8-182c2d0362d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:43.702746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579b4e0-a2b3-4767-a0f8-182c2d0362d1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:43.723093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:43.731029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 372/742] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:39:43 2022] POST /identity/v3/services => generated 252 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:39:43.737508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579b4e0-a2b3-4767-a0f8-182c2d0362d1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:43.777218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474590-78c3-4816-b53c-335a26422508 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:43.869169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7c519-2dff-4c9d-99cd-e1651f5e9323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:43.869169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7c519-2dff-4c9d-99cd-e1651f5e9323 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:43.869169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7c519-2dff-4c9d-99cd-e1651f5e9323 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:43.869169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7c519-2dff-4c9d-99cd-e1651f5e9323 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:43.883759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7c519-2dff-4c9d-99cd-e1651f5e9323 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:43.886050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7c519-2dff-4c9d-99cd-e1651f5e9323 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-19b7c519-2dff-4c9d-99cd-e1651f5e9323 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:43.903829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:43.905735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:43.908547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:43.908547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:43.908547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:43.908547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:43.908547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:43.908547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:43.908547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:43.908547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:43.908547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:39:43.908547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:43.908547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 371/743] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:43.911000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620ec2e-7d9c-4e52-8644-58f5d0d9e7fc None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:43.911000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620ec2e-7d9c-4e52-8644-58f5d0d9e7fc None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:43.911000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620ec2e-7d9c-4e52-8644-58f5d0d9e7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:43.937218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d620ec2e-7d9c-4e52-8644-58f5d0d9e7fc None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:43.938042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579b4e0-a2b3-4767-a0f8-182c2d0362d1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:43.939159 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d620ec2e-7d9c-4e52-8644-58f5d0d9e7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:43.997784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7d7c6-ed00-4097-995c-0a6dcc625f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:43.998594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d7c6-ed00-4097-995c-0a6dcc625f0c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:43.999093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d7c6-ed00-4097-995c-0a6dcc625f0c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:43.999543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d7c6-ed00-4097-995c-0a6dcc625f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:44.020712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7d7c6-ed00-4097-995c-0a6dcc625f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:44.022753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7d7c6-ed00-4097-995c-0a6dcc625f0c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-e2a7d7c6-ed00-4097-995c-0a6dcc625f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:44.047488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:44.048974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:44.050462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:44.050462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:44.050462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:44.050462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:44.050462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 373/744] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:44.051113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7d7c6-ed00-4097-995c-0a6dcc625f0c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:44.074596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 372/745] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:43 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:39:44.074596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620ec2e-7d9c-4e52-8644-58f5d0d9e7fc None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:44.101614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:44.140060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:44.213058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7d7c6-ed00-4097-995c-0a6dcc625f0c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:44.254897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620ec2e-7d9c-4e52-8644-58f5d0d9e7fc None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:44.275927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f76852-076a-48f4-9dfa-38d8a11c01d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:44.276833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f76852-076a-48f4-9dfa-38d8a11c01d1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:44.277385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f76852-076a-48f4-9dfa-38d8a11c01d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:44.277918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f76852-076a-48f4-9dfa-38d8a11c01d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:44.296140 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f76852-076a-48f4-9dfa-38d8a11c01d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:44.299042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f76852-076a-48f4-9dfa-38d8a11c01d1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:44.316916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee236df-8d75-4cb1-8d0c-25a7fbd571e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:44.317781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee236df-8d75-4cb1-8d0c-25a7fbd571e6 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:44.318351 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee236df-8d75-4cb1-8d0c-25a7fbd571e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:44.318830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee236df-8d75-4cb1-8d0c-25a7fbd571e6 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:44.319878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee236df-8d75-4cb1-8d0c-25a7fbd571e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:44.320355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee236df-8d75-4cb1-8d0c-25a7fbd571e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-41f76852-076a-48f4-9dfa-38d8a11c01d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:44.321072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:44.322991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:44.325086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:44.325086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:44.325086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:44.325086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:44.325614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee236df-8d75-4cb1-8d0c-25a7fbd571e6 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:44.327459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 374/746] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:44.328602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f76852-076a-48f4-9dfa-38d8a11c01d1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:44.357458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 373/747] 10.222.0.124 () {56 vars in 1140 bytes} [Mon Aug 1 16:39:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:44.357458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee236df-8d75-4cb1-8d0c-25a7fbd571e6 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:44.484569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:44.521684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f76852-076a-48f4-9dfa-38d8a11c01d1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:44.525136 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:44.544403 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee236df-8d75-4cb1-8d0c-25a7fbd571e6 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:44.568234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e9c40-9e5f-4be0-a533-3839d2b14797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:44.569739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e9c40-9e5f-4be0-a533-3839d2b14797 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:44.570735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e9c40-9e5f-4be0-a533-3839d2b14797 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:44.571171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e9c40-9e5f-4be0-a533-3839d2b14797 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:44.572385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e9c40-9e5f-4be0-a533-3839d2b14797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:44.572921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e9c40-9e5f-4be0-a533-3839d2b14797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:44.576418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e9c40-9e5f-4be0-a533-3839d2b14797 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:44.593473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d90670-6d22-4fef-9045-db2824ae013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:44.594149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d90670-6d22-4fef-9045-db2824ae013a None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:44.594518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d90670-6d22-4fef-9045-db2824ae013a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:44.595213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d90670-6d22-4fef-9045-db2824ae013a None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:44.596095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d90670-6d22-4fef-9045-db2824ae013a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:44.597699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d90670-6d22-4fef-9045-db2824ae013a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:44.603838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 375/748] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:44.603838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e9c40-9e5f-4be0-a533-3839d2b14797 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:44.622614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 374/749] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:39:44 2022] POST /identity/v3/services => generated 241 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:39:44.624355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d90670-6d22-4fef-9045-db2824ae013a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:44.763675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e9c40-9e5f-4be0-a533-3839d2b14797 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:44.796744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d90670-6d22-4fef-9045-db2824ae013a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:44.820654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040aac69-e64b-490c-b8f5-8d662bec0841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:44.821835 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040aac69-e64b-490c-b8f5-8d662bec0841 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:44.822251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040aac69-e64b-490c-b8f5-8d662bec0841 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:44.822630 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040aac69-e64b-490c-b8f5-8d662bec0841 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:44.824127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040aac69-e64b-490c-b8f5-8d662bec0841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:44.824566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040aac69-e64b-490c-b8f5-8d662bec0841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:44.826228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040aac69-e64b-490c-b8f5-8d662bec0841 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:44.837294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:44.844123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 376/750] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:44.845710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040aac69-e64b-490c-b8f5-8d662bec0841 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:44.862199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad695b1-6ec1-4780-b659-a8ef72e04694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:44.864363 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad695b1-6ec1-4780-b659-a8ef72e04694 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:44.864848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad695b1-6ec1-4780-b659-a8ef72e04694 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:44.865321 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad695b1-6ec1-4780-b659-a8ef72e04694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:44.893045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:44.961876 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad695b1-6ec1-4780-b659-a8ef72e04694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:44.966098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad695b1-6ec1-4780-b659-a8ef72e04694 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:44.986129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040aac69-e64b-490c-b8f5-8d662bec0841 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:45.034976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aebbc2-2ef2-4437-ab4b-da6568aab513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:45.036587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aebbc2-2ef2-4437-ab4b-da6568aab513 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:45.037082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aebbc2-2ef2-4437-ab4b-da6568aab513 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:45.037586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aebbc2-2ef2-4437-ab4b-da6568aab513 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:45.048928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aebbc2-2ef2-4437-ab4b-da6568aab513 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:45.051537 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aebbc2-2ef2-4437-ab4b-da6568aab513 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-29aebbc2-2ef2-4437-ab4b-da6568aab513 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:45.066377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:45.067441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:45.068392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:45.068392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:45.068392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:45.068392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:45.068392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:45.068392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:45.068392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:45.068392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:45.068392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:45.068392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:45.068392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 377/751] 10.222.0.124 () {56 vars in 1098 bytes} [Mon Aug 1 16:39:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:45.069072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aebbc2-2ef2-4437-ab4b-da6568aab513 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:45.130998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 375/752] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:44 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:39:45.130998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad695b1-6ec1-4780-b659-a8ef72e04694 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:45.164928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:45.264220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:45.279847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad695b1-6ec1-4780-b659-a8ef72e04694 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:45.300166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aebbc2-2ef2-4437-ab4b-da6568aab513 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:45.324138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6f29-6f86-4456-962e-5e912d4f1dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:45.325086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6f29-6f86-4456-962e-5e912d4f1dba None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:45.325534 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6f29-6f86-4456-962e-5e912d4f1dba None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:45.325964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6f29-6f86-4456-962e-5e912d4f1dba None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:45.327006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6f29-6f86-4456-962e-5e912d4f1dba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:45.327600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6f29-6f86-4456-962e-5e912d4f1dba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:45.330451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6f29-6f86-4456-962e-5e912d4f1dba None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:45.349077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fa78c-47d7-42b2-b7cc-9b4def087ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:45.349757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa78c-47d7-42b2-b7cc-9b4def087ed7 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:45.350039 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa78c-47d7-42b2-b7cc-9b4def087ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:45.350312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa78c-47d7-42b2-b7cc-9b4def087ed7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:45.357673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 376/753] 10.222.0.124 () {56 vars in 1138 bytes} [Mon Aug 1 16:39:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:45.358698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fa78c-47d7-42b2-b7cc-9b4def087ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:45.359178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6f29-6f86-4456-962e-5e912d4f1dba None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:45.360459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fa78c-47d7-42b2-b7cc-9b4def087ed7 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-450fa78c-47d7-42b2-b7cc-9b4def087ed7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:45.374149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:45.375486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:45.377737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:45.377737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:45.377737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:45.377737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:45.377737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:45.377737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:45.377737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:45.377737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:45.380918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 378/754] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:45.381976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fa78c-47d7-42b2-b7cc-9b4def087ed7 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:45.487595 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:45.518436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6f29-6f86-4456-962e-5e912d4f1dba None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:45.559886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fa78c-47d7-42b2-b7cc-9b4def087ed7 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:45.560803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd4f98-28c9-4f06-a6ca-129c3d4d1059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:45.561664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd4f98-28c9-4f06-a6ca-129c3d4d1059 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:45.562117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd4f98-28c9-4f06-a6ca-129c3d4d1059 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:45.562549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd4f98-28c9-4f06-a6ca-129c3d4d1059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:45.575812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd4f98-28c9-4f06-a6ca-129c3d4d1059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:45.577636 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd4f98-28c9-4f06-a6ca-129c3d4d1059 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-fafd4f98-28c9-4f06-a6ca-129c3d4d1059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:45.597419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:45.598667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:45.599702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:45.599702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:45.599702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:45.599702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:45.601652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 377/755] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:45.602824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd4f98-28c9-4f06-a6ca-129c3d4d1059 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:45.637493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc1a26-3e8b-45a0-b8fa-c73e55cecf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:45.638509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc1a26-3e8b-45a0-b8fa-c73e55cecf80 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:45.638977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc1a26-3e8b-45a0-b8fa-c73e55cecf80 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:45.639468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc1a26-3e8b-45a0-b8fa-c73e55cecf80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:45.660907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc1a26-3e8b-45a0-b8fa-c73e55cecf80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:45.663844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc1a26-3e8b-45a0-b8fa-c73e55cecf80 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:45.668943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-0fcc1a26-3e8b-45a0-b8fa-c73e55cecf80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:45.694629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:45.696163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:45.697079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:45.697079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:45.697079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:45.697079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:45.699555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 379/756] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:45.700825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc1a26-3e8b-45a0-b8fa-c73e55cecf80 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:45.762996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd4f98-28c9-4f06-a6ca-129c3d4d1059 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:45.819758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960dd09-3744-48dc-bc14-22145d2771eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:45.821117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960dd09-3744-48dc-bc14-22145d2771eb None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:45.821117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960dd09-3744-48dc-bc14-22145d2771eb None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:45.821117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960dd09-3744-48dc-bc14-22145d2771eb None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:45.821951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960dd09-3744-48dc-bc14-22145d2771eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:45.822456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960dd09-3744-48dc-bc14-22145d2771eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:45.823998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960dd09-3744-48dc-bc14-22145d2771eb None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:45.825969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:45.841886 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 378/757] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:45.844637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960dd09-3744-48dc-bc14-22145d2771eb None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:45.874300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc1a26-3e8b-45a0-b8fa-c73e55cecf80 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:45.939187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23744d2-dbc8-4386-9801-f6f227d77490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:45.940740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23744d2-dbc8-4386-9801-f6f227d77490 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:45.941499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23744d2-dbc8-4386-9801-f6f227d77490 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:45.942243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23744d2-dbc8-4386-9801-f6f227d77490 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:45.943866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23744d2-dbc8-4386-9801-f6f227d77490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:45.944770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23744d2-dbc8-4386-9801-f6f227d77490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:45.947509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23744d2-dbc8-4386-9801-f6f227d77490 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:45.971893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 380/758] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:45.974208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23744d2-dbc8-4386-9801-f6f227d77490 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:45.975322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960dd09-3744-48dc-bc14-22145d2771eb None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:46.016530 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576fcb6-a9dd-4788-a0c5-84266677e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:46.017516 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576fcb6-a9dd-4788-a0c5-84266677e758 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:46.017943 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576fcb6-a9dd-4788-a0c5-84266677e758 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:46.018229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576fcb6-a9dd-4788-a0c5-84266677e758 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:46.019091 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576fcb6-a9dd-4788-a0c5-84266677e758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:46.019410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576fcb6-a9dd-4788-a0c5-84266677e758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:46.020975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576fcb6-a9dd-4788-a0c5-84266677e758 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:46.041009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 379/759] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:46.042078 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576fcb6-a9dd-4788-a0c5-84266677e758 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:46.078125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:46.112124 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:46.134966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23744d2-dbc8-4386-9801-f6f227d77490 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:46.171198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576fcb6-a9dd-4788-a0c5-84266677e758 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:46.176457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e91e9-678b-4544-98e3-a3a03ce56460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:46.177195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e91e9-678b-4544-98e3-a3a03ce56460 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:46.177541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e91e9-678b-4544-98e3-a3a03ce56460 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:46.177886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e91e9-678b-4544-98e3-a3a03ce56460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:46.178785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e91e9-678b-4544-98e3-a3a03ce56460 None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=c5e98d3e170a4e95bc03daf2a950e5f6) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:46.179188 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e91e9-678b-4544-98e3-a3a03ce56460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:46.184873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e91e9-678b-4544-98e3-a3a03ce56460 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:46.199570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 381/760] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:45 2022] GET /identity/v3/role_assignments?user.id=c5e98d3e170a4e95bc03daf2a950e5f6&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:46.200252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e91e9-678b-4544-98e3-a3a03ce56460 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:46.225723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27a80-4c5f-444b-bab3-fa228f0fdf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:46.226971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27a80-4c5f-444b-bab3-fa228f0fdf16 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:46.227548 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27a80-4c5f-444b-bab3-fa228f0fdf16 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:46.228064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27a80-4c5f-444b-bab3-fa228f0fdf16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:46.241404 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa27a80-4c5f-444b-bab3-fa228f0fdf16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:46.243453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa27a80-4c5f-444b-bab3-fa228f0fdf16 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-eaa27a80-4c5f-444b-bab3-fa228f0fdf16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:46.258118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:46.259133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:46.260009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:46.260009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:46.260009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:46.260009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:46.260009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:46.260009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:46.260009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:46.260009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:46.262832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 380/761] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:46.269906 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27a80-4c5f-444b-bab3-fa228f0fdf16 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:46.404801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27a80-4c5f-444b-bab3-fa228f0fdf16 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:46.422747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:46.453721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551d42a-33ee-4109-a7ed-bd2a127025b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:46.455375 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551d42a-33ee-4109-a7ed-bd2a127025b2 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:46.455917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551d42a-33ee-4109-a7ed-bd2a127025b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:46.456398 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551d42a-33ee-4109-a7ed-bd2a127025b2 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:46.457670 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551d42a-33ee-4109-a7ed-bd2a127025b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:46.458302 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551d42a-33ee-4109-a7ed-bd2a127025b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:46.460446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551d42a-33ee-4109-a7ed-bd2a127025b2 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:46.477347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 381/762] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:46.484650 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551d42a-33ee-4109-a7ed-bd2a127025b2 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:46.508238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e91e9-678b-4544-98e3-a3a03ce56460 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:46.538376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:46.569960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4be44-4e27-4255-af3d-bf85419e454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:46.570638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4be44-4e27-4255-af3d-bf85419e454c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:46.570972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4be44-4e27-4255-af3d-bf85419e454c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:46.571256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4be44-4e27-4255-af3d-bf85419e454c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:46.588400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4be44-4e27-4255-af3d-bf85419e454c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:46.590282 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4be44-4e27-4255-af3d-bf85419e454c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-edc4be44-4e27-4255-af3d-bf85419e454c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:46.615147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:46.616128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:46.617014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:46.617014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:46.617014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:46.617014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:46.617014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:46.617014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:46.617014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:46.617014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:46.619698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 382/763] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:46.627143 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4be44-4e27-4255-af3d-bf85419e454c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:46.680451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551d42a-33ee-4109-a7ed-bd2a127025b2 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:46.764961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38b944-d54b-438c-9d97-1296252cdebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:46.766048 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38b944-d54b-438c-9d97-1296252cdebc None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:46.766632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38b944-d54b-438c-9d97-1296252cdebc None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:46.767677 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38b944-d54b-438c-9d97-1296252cdebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:46.768921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38b944-d54b-438c-9d97-1296252cdebc None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=7b46aa077b4147c9836b646cf42cff50) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:46.769605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38b944-d54b-438c-9d97-1296252cdebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:46.773591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38b944-d54b-438c-9d97-1296252cdebc None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:46.785097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 382/764] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:46 2022] GET /identity/v3/role_assignments?user.id=7b46aa077b4147c9836b646cf42cff50&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=390e487a45f74246ba84773e8760bc7c => generated 260 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:46.837458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4be44-4e27-4255-af3d-bf85419e454c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:46.902361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c319d9-78e5-4de4-a26c-3694c80be662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:46.903482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c319d9-78e5-4de4-a26c-3694c80be662 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:46.903957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c319d9-78e5-4de4-a26c-3694c80be662 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:46.904418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c319d9-78e5-4de4-a26c-3694c80be662 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:46.905336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c319d9-78e5-4de4-a26c-3694c80be662 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:46.905660 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c319d9-78e5-4de4-a26c-3694c80be662 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:46.907755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c319d9-78e5-4de4-a26c-3694c80be662 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:46.933772 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 383/765] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:46.940452 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38b944-d54b-438c-9d97-1296252cdebc None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:47.036742 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:47.095642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14116a36-362b-4a92-8b65-26c4f8b8749f None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:47.096477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14116a36-362b-4a92-8b65-26c4f8b8749f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:47.096615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14116a36-362b-4a92-8b65-26c4f8b8749f None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:47.099561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 384/766] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:47 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:47.105517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e0e35-beb5-43df-b6f4-ee699475b4c9 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:47.105885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e0e35-beb5-43df-b6f4-ee699475b4c9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:47.106071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e0e35-beb5-43df-b6f4-ee699475b4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:47.143000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-8a8e0e35-beb5-43df-b6f4-ee699475b4c9 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:47.144297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8a8e0e35-beb5-43df-b6f4-ee699475b4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:47.169382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38b944-d54b-438c-9d97-1296252cdebc None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:47.213086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0d547-e25b-43b6-af2f-3d09e6ed8d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:47.213711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0d547-e25b-43b6-af2f-3d09e6ed8d6e None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:47.213996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0d547-e25b-43b6-af2f-3d09e6ed8d6e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:47.214472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0d547-e25b-43b6-af2f-3d09e6ed8d6e None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/9728f2fe7b5a40cd9f8ead5cf99af581/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:47.216724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0d547-e25b-43b6-af2f-3d09e6ed8d6e None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=9728f2fe7b5a40cd9f8ead5cf99af581, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:47.218259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0d547-e25b-43b6-af2f-3d09e6ed8d6e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:47.240892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:47.251094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 383/767] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:39:46 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/9728f2fe7b5a40cd9f8ead5cf99af581/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:39:47.311836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 385/768] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:47 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:39:47.360231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0d547-e25b-43b6-af2f-3d09e6ed8d6e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:47.547474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:47.553291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950dd3f-cb4b-46d6-9043-313d33589cec None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:47.554093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950dd3f-cb4b-46d6-9043-313d33589cec None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:47.554329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0d547-e25b-43b6-af2f-3d09e6ed8d6e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:47.554799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950dd3f-cb4b-46d6-9043-313d33589cec None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:47.558866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 386/769] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:47 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:47.564517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc59ab-dd03-40cb-a1aa-e20cdf18e545 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:47.565153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc59ab-dd03-40cb-a1aa-e20cdf18e545 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:47.565632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc59ab-dd03-40cb-a1aa-e20cdf18e545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:47.594172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-68dc59ab-dd03-40cb-a1aa-e20cdf18e545 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:47.596153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-68dc59ab-dd03-40cb-a1aa-e20cdf18e545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:47.615902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4512f-7184-467a-b7fd-f682254c226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:47.616992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4512f-7184-467a-b7fd-f682254c226b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:47.617474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4512f-7184-467a-b7fd-f682254c226b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:47.617948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4512f-7184-467a-b7fd-f682254c226b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:47.618812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4512f-7184-467a-b7fd-f682254c226b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:47.620490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4512f-7184-467a-b7fd-f682254c226b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-51f4512f-7184-467a-b7fd-f682254c226b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:47.636262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:47.638146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:39:47.639847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:47.651061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 384/770] 10.222.0.124 () {56 vars in 1134 bytes} [Mon Aug 1 16:39:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:47.655185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4512f-7184-467a-b7fd-f682254c226b None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:47.732959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 387/771] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:47 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:39:47.776650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc59ab-dd03-40cb-a1aa-e20cdf18e545 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:47.924912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:47.929268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc59ab-dd03-40cb-a1aa-e20cdf18e545 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:47.962309 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4512f-7184-467a-b7fd-f682254c226b None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:47.972704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9afbc0-07f4-425c-b4a9-6d0f07acdac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:47.973794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afbc0-07f4-425c-b4a9-6d0f07acdac0 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:47.974319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afbc0-07f4-425c-b4a9-6d0f07acdac0 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:47.974976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afbc0-07f4-425c-b4a9-6d0f07acdac0 None admin] PATH_INFO: `/v3/services/network` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:47.975869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9afbc0-07f4-425c-b4a9-6d0f07acdac0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:47.977517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9afbc0-07f4-425c-b4a9-6d0f07acdac0 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-6a9afbc0-07f4-425c-b4a9-6d0f07acdac0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:48.002857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:48.003980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:48.005104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 388/772] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:47 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:48.012722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9afbc0-07f4-425c-b4a9-6d0f07acdac0 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:48.029614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ed4d9-ed68-407a-acd7-bff0d812348c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:48.030274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ed4d9-ed68-407a-acd7-bff0d812348c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:48.030564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ed4d9-ed68-407a-acd7-bff0d812348c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:48.030840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ed4d9-ed68-407a-acd7-bff0d812348c None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:48.031593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ed4d9-ed68-407a-acd7-bff0d812348c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:48.031965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ed4d9-ed68-407a-acd7-bff0d812348c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:48.033441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ed4d9-ed68-407a-acd7-bff0d812348c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:48.039879 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 385/773] 10.222.0.124 () {56 vars in 1129 bytes} [Mon Aug 1 16:39:47 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:39:48.047100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ed4d9-ed68-407a-acd7-bff0d812348c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:48.115352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:48.238239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9afbc0-07f4-425c-b4a9-6d0f07acdac0 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:48.313940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64388c-9cdd-4f05-a872-b6bb8acc605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:48.314881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64388c-9cdd-4f05-a872-b6bb8acc605c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:48.315393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64388c-9cdd-4f05-a872-b6bb8acc605c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:48.315898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64388c-9cdd-4f05-a872-b6bb8acc605c None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:48.317929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64388c-9cdd-4f05-a872-b6bb8acc605c None admin] RBAC: Adding query filter params (name=network) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:48.318445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64388c-9cdd-4f05-a872-b6bb8acc605c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:48.321268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64388c-9cdd-4f05-a872-b6bb8acc605c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:48.331283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 389/774] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:39:48 2022] GET /identity/v3/services?name=network => generated 125 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:48.342052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ed4d9-ed68-407a-acd7-bff0d812348c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:48.348418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64388c-9cdd-4f05-a872-b6bb8acc605c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:48.425757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:48.431954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ef1d1-8b14-49be-a94f-873f77270709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:48.433222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ef1d1-8b14-49be-a94f-873f77270709 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:48.434414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ef1d1-8b14-49be-a94f-873f77270709 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:48.436727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ef1d1-8b14-49be-a94f-873f77270709 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:48.437749 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ef1d1-8b14-49be-a94f-873f77270709 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:48.439891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ef1d1-8b14-49be-a94f-873f77270709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:48.446497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ef1d1-8b14-49be-a94f-873f77270709 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:48.460441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 386/775] 10.222.0.124 () {56 vars in 1129 bytes} [Mon Aug 1 16:39:48 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:39:48.466093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ef1d1-8b14-49be-a94f-873f77270709 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:48.583685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64388c-9cdd-4f05-a872-b6bb8acc605c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:48.659249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfd568-6518-4b48-97c3-94f2bbf2941f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:48.659910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd568-6518-4b48-97c3-94f2bbf2941f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:48.660194 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd568-6518-4b48-97c3-94f2bbf2941f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:48.660473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd568-6518-4b48-97c3-94f2bbf2941f None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:48.661206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfd568-6518-4b48-97c3-94f2bbf2941f None admin] RBAC: Adding query filter params (type=network) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:48.661588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfd568-6518-4b48-97c3-94f2bbf2941f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:48.663109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfd568-6518-4b48-97c3-94f2bbf2941f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:48.679883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 390/776] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:39:48 2022] GET /identity/v3/services?type=network => generated 352 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:39:48.687402 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:48.689518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfd568-6518-4b48-97c3-94f2bbf2941f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:48.703698 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ef1d1-8b14-49be-a94f-873f77270709 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:48.749702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf98b76-84ce-48fa-aa54-5fe3fd08aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:48.751052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf98b76-84ce-48fa-aa54-5fe3fd08aa09 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:48.751603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf98b76-84ce-48fa-aa54-5fe3fd08aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:48.752779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf98b76-84ce-48fa-aa54-5fe3fd08aa09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:48.753924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf98b76-84ce-48fa-aa54-5fe3fd08aa09 None admin] RBAC: Adding query filter params (interface=public, service_id=2b48c3c972584da891d6897be397ca8f, region_id=RegionOne) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:48.754454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf98b76-84ce-48fa-aa54-5fe3fd08aa09 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:48.756178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf98b76-84ce-48fa-aa54-5fe3fd08aa09 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:48.770983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 387/777] 10.222.0.124 () {56 vars in 1256 bytes} [Mon Aug 1 16:39:48 2022] GET /identity/v3/endpoints?service_id=2b48c3c972584da891d6897be397ca8f&interface=public®ion_id=RegionOne => generated 195 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:48.772885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf98b76-84ce-48fa-aa54-5fe3fd08aa09 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:48.918623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf98b76-84ce-48fa-aa54-5fe3fd08aa09 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:48.960278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad280b69-5429-4d59-ba08-821093f92e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:48.961465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280b69-5429-4d59-ba08-821093f92e8b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:48.961974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280b69-5429-4d59-ba08-821093f92e8b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:48.962522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280b69-5429-4d59-ba08-821093f92e8b None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:48.963502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad280b69-5429-4d59-ba08-821093f92e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:48.966114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad280b69-5429-4d59-ba08-821093f92e8b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:48.979152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 388/778] 10.222.0.124 () {56 vars in 1092 bytes} [Mon Aug 1 16:39:48 2022] GET /identity/v3/services => generated 776 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:39:49.039709 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:49.055296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfd568-6518-4b48-97c3-94f2bbf2941f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:49.061036 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccc453-2d65-44c0-90cf-60fb4800e843 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:49.061603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccc453-2d65-44c0-90cf-60fb4800e843 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:49.061603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccc453-2d65-44c0-90cf-60fb4800e843 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:49.063367 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 389/779] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:39:49.068910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb2c67-0c82-46bd-b60e-93445a6c6b6e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:49.069211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb2c67-0c82-46bd-b60e-93445a6c6b6e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:49.069465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb2c67-0c82-46bd-b60e-93445a6c6b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:49.090268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ebbb2c67-0c82-46bd-b60e-93445a6c6b6e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:49.091535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ebbb2c67-0c82-46bd-b60e-93445a6c6b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:49.117939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:49.137507 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd534a8f-49e3-44e2-b103-c7141c19fc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:49.138157 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd534a8f-49e3-44e2-b103-c7141c19fc68 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:49.138434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd534a8f-49e3-44e2-b103-c7141c19fc68 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:49.139581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd534a8f-49e3-44e2-b103-c7141c19fc68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:49.140392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd534a8f-49e3-44e2-b103-c7141c19fc68 None admin] RBAC: Adding query filter params (interface=public, service_id=76caadc7163a4eda95135f50229ee5c7, region_id=RegionOne) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:49.140704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd534a8f-49e3-44e2-b103-c7141c19fc68 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:49.142264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd534a8f-49e3-44e2-b103-c7141c19fc68 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:49.162873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 391/780] 10.222.0.124 () {56 vars in 1256 bytes} [Mon Aug 1 16:39:48 2022] GET /identity/v3/endpoints?service_id=76caadc7163a4eda95135f50229ee5c7&interface=public®ion_id=RegionOne => generated 195 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:49.166567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd534a8f-49e3-44e2-b103-c7141c19fc68 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:49.213689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 390/781] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:49 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:39:49.238657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb2c67-0c82-46bd-b60e-93445a6c6b6e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:49.300307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd534a8f-49e3-44e2-b103-c7141c19fc68 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:49.352808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feb020-a508-48ba-879d-c4042ae102f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:49.354193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb020-a508-48ba-879d-c4042ae102f1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:49.354885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb020-a508-48ba-879d-c4042ae102f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:49.355328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feb020-a508-48ba-879d-c4042ae102f1 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:49.356362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feb020-a508-48ba-879d-c4042ae102f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:49.358611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feb020-a508-48ba-879d-c4042ae102f1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:49.371032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb2c67-0c82-46bd-b60e-93445a6c6b6e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:49.371258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 392/782] 10.222.0.124 () {56 vars in 1092 bytes} [Mon Aug 1 16:39:49 2022] GET /identity/v3/services => generated 776 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:49.414939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690215d-d607-4a68-9f0f-7fa1be80f434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:49.416103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690215d-d607-4a68-9f0f-7fa1be80f434 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:49.416493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690215d-d607-4a68-9f0f-7fa1be80f434 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:49.416867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690215d-d607-4a68-9f0f-7fa1be80f434 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:49.432408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690215d-d607-4a68-9f0f-7fa1be80f434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-4690215d-d607-4a68-9f0f-7fa1be80f434 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:49.439396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:49.440465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:49.441645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 391/783] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:49.448321 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feb020-a508-48ba-879d-c4042ae102f1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:49.488279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:49.645729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feb020-a508-48ba-879d-c4042ae102f1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:49.688147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9429132-ceca-42bb-8a04-985ec483ff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:49.688779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9429132-ceca-42bb-8a04-985ec483ff69 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:49.689059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9429132-ceca-42bb-8a04-985ec483ff69 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:49.689334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9429132-ceca-42bb-8a04-985ec483ff69 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:49.690069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9429132-ceca-42bb-8a04-985ec483ff69 None admin] RBAC: Adding query filter params (name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:49.690375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9429132-ceca-42bb-8a04-985ec483ff69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:49.691794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9429132-ceca-42bb-8a04-985ec483ff69 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:49.701002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 393/784] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:49 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:49.706752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690215d-d607-4a68-9f0f-7fa1be80f434 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:49.718966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:49.754591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4096c1-6740-45e3-b9f5-c0bb0b58af62 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:49.754987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4096c1-6740-45e3-b9f5-c0bb0b58af62 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:49.755219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4096c1-6740-45e3-b9f5-c0bb0b58af62 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:49.756731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 394/785] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:39:49.762333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53030-dab7-45ad-8119-5fff4debb52b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:49.762914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53030-dab7-45ad-8119-5fff4debb52b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:49.763430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53030-dab7-45ad-8119-5fff4debb52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:49.783405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-66d53030-dab7-45ad-8119-5fff4debb52b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:49.784811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-66d53030-dab7-45ad-8119-5fff4debb52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:49.835994 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690215d-d607-4a68-9f0f-7fa1be80f434 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:49.868389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 395/786] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:49 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:39:49.886235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf3c24-0f24-4938-a0fa-668eb7553103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:49.887185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf3c24-0f24-4938-a0fa-668eb7553103 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:49.887619 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf3c24-0f24-4938-a0fa-668eb7553103 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:49.887997 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf3c24-0f24-4938-a0fa-668eb7553103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:49.910842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf3c24-0f24-4938-a0fa-668eb7553103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:49.913741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf3c24-0f24-4938-a0fa-668eb7553103 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:49.916492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf034c8-f482-43a7-adbc-83f555524827 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:49.916803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf034c8-f482-43a7-adbc-83f555524827 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:49.917080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf034c8-f482-43a7-adbc-83f555524827 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:49.918711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 396/787] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:39:49.923928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf034c8-f482-43a7-adbc-83f555524827 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-1bbf3c24-0f24-4938-a0fa-668eb7553103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:49.939819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:49.940781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:49.941691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:49.941691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:49.941691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:49.941691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:49.941691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 392/788] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:49.943068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:49.943396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e325b-9419-4232-86b2-ca465478d843 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:49.943788 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e325b-9419-4232-86b2-ca465478d843 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:49.944090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e325b-9419-4232-86b2-ca465478d843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:49.964355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d77e325b-9419-4232-86b2-ca465478d843 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:49.965605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d77e325b-9419-4232-86b2-ca465478d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:50.040911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:50.054593 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf034c8-f482-43a7-adbc-83f555524827 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:50.064158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 393/789] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:49 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:39:50.065449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e325b-9419-4232-86b2-ca465478d843 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:50.094335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2998f-20c8-45e5-8bb4-7b7fcac88f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:50.095058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2998f-20c8-45e5-8bb4-7b7fcac88f51 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:50.095554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2998f-20c8-45e5-8bb4-7b7fcac88f51 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:50.095841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2998f-20c8-45e5-8bb4-7b7fcac88f51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:50.109030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2998f-20c8-45e5-8bb4-7b7fcac88f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-36b2998f-20c8-45e5-8bb4-7b7fcac88f51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:50.114650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:50.115727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:50.116565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 397/790] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:50.117351 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2998f-20c8-45e5-8bb4-7b7fcac88f51 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:50.204407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:50.218405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e325b-9419-4232-86b2-ca465478d843 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:50.241596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2998f-20c8-45e5-8bb4-7b7fcac88f51 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:50.263169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d15211-9b78-4531-bace-181094e0e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:50.263890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15211-9b78-4531-bace-181094e0e82c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:50.264170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15211-9b78-4531-bace-181094e0e82c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:50.264446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15211-9b78-4531-bace-181094e0e82c None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:50.265190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d15211-9b78-4531-bace-181094e0e82c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:50.265493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d15211-9b78-4531-bace-181094e0e82c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:50.267243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d15211-9b78-4531-bace-181094e0e82c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:50.281751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 394/791] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:50.282649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d15211-9b78-4531-bace-181094e0e82c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:50.283113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdec6c-b85f-490f-92f3-08f43874a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:50.283544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdec6c-b85f-490f-92f3-08f43874a15b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:50.283835 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdec6c-b85f-490f-92f3-08f43874a15b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:50.284110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdec6c-b85f-490f-92f3-08f43874a15b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:50.297045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdec6c-b85f-490f-92f3-08f43874a15b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-eafdec6c-b85f-490f-92f3-08f43874a15b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:50.303184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:50.305883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 398/792] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:50.307961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdec6c-b85f-490f-92f3-08f43874a15b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:50.369850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:50.444350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d15211-9b78-4531-bace-181094e0e82c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:50.453297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdec6c-b85f-490f-92f3-08f43874a15b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:50.482272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c53f56-1296-4429-9a4b-2107d1ae1a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:50.483034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c53f56-1296-4429-9a4b-2107d1ae1a5a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:50.483381 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c53f56-1296-4429-9a4b-2107d1ae1a5a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:50.483717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c53f56-1296-4429-9a4b-2107d1ae1a5a None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:50.484754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c53f56-1296-4429-9a4b-2107d1ae1a5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:50.485305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c53f56-1296-4429-9a4b-2107d1ae1a5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:50.486922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c53f56-1296-4429-9a4b-2107d1ae1a5a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:50.496743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 395/793] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:50.497714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c53f56-1296-4429-9a4b-2107d1ae1a5a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:50.506014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:50.515375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff11fb-48b1-4625-baec-cec4da21e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:50.516612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff11fb-48b1-4625-baec-cec4da21e623 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:50.517059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff11fb-48b1-4625-baec-cec4da21e623 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:50.517743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff11fb-48b1-4625-baec-cec4da21e623 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:50.532330 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff11fb-48b1-4625-baec-cec4da21e623 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:50.534525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff11fb-48b1-4625-baec-cec4da21e623 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-5eff11fb-48b1-4625-baec-cec4da21e623 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:50.550905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:50.551964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:50.552928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:50.552928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:50.552928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:50.552928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:50.552928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:50.552928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:50.552928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:50.552928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:50.552928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:39:50.552928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:50.554653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 399/794] 10.222.0.124 () {56 vars in 1122 bytes} [Mon Aug 1 16:39:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:50.557221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff11fb-48b1-4625-baec-cec4da21e623 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:50.632992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c53f56-1296-4429-9a4b-2107d1ae1a5a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:50.651956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:50.676120 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff11fb-48b1-4625-baec-cec4da21e623 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:50.688583 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12e799-e863-4917-be3d-da2ce9d540cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:50.689986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e799-e863-4917-be3d-da2ce9d540cb None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:50.690537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e799-e863-4917-be3d-da2ce9d540cb None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:50.691309 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e799-e863-4917-be3d-da2ce9d540cb None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:50.692824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12e799-e863-4917-be3d-da2ce9d540cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:50.693604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12e799-e863-4917-be3d-da2ce9d540cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:50.695668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12e799-e863-4917-be3d-da2ce9d540cb None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:50.711353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 396/795] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:50.712982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12e799-e863-4917-be3d-da2ce9d540cb None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:50.725466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba65cd-de10-4611-b9b4-b41122b5bcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:50.726146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba65cd-de10-4611-b9b4-b41122b5bcba None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:50.726437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba65cd-de10-4611-b9b4-b41122b5bcba None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:50.726717 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba65cd-de10-4611-b9b4-b41122b5bcba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:50.741537 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba65cd-de10-4611-b9b4-b41122b5bcba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:50.743547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba65cd-de10-4611-b9b4-b41122b5bcba None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-adba65cd-de10-4611-b9b4-b41122b5bcba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:50.774680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:50.776867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:50.779715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:50.779715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:50.779715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:50.779715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:50.782243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 400/796] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:50.783601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba65cd-de10-4611-b9b4-b41122b5bcba None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:50.872903 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:50.940835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12e799-e863-4917-be3d-da2ce9d540cb None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:50.956154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba65cd-de10-4611-b9b4-b41122b5bcba None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:51.012360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d85e8-6995-4221-abf1-048b35bb0e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:51.013418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d85e8-6995-4221-abf1-048b35bb0e67 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:51.014184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d85e8-6995-4221-abf1-048b35bb0e67 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:51.014909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d85e8-6995-4221-abf1-048b35bb0e67 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:51.015301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a7e55-e21f-4c70-b4d4-218129df97f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:51.016643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a7e55-e21f-4c70-b4d4-218129df97f9 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:51.017266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a7e55-e21f-4c70-b4d4-218129df97f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:51.017745 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d85e8-6995-4221-abf1-048b35bb0e67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:51.017983 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a7e55-e21f-4c70-b4d4-218129df97f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:51.018734 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d85e8-6995-4221-abf1-048b35bb0e67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:51.021969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d85e8-6995-4221-abf1-048b35bb0e67 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:51.044109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a7e55-e21f-4c70-b4d4-218129df97f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:51.047164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a7e55-e21f-4c70-b4d4-218129df97f9 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:51.058866 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 397/797] 10.222.0.124 () {56 vars in 1154 bytes} [Mon Aug 1 16:39:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:51.060964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d85e8-6995-4221-abf1-048b35bb0e67 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-2f9a7e55-e21f-4c70-b4d4-218129df97f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:51.083775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:51.085607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:51.087452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:51.087452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:51.087452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:51.087452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:51.087452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 401/798] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:51.087452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a7e55-e21f-4c70-b4d4-218129df97f9 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:51.142458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:51.297437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d85e8-6995-4221-abf1-048b35bb0e67 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:51.316367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:51.332630 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a7e55-e21f-4c70-b4d4-218129df97f9 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:51.381081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33be1e-dedb-4056-9cc4-b39959a1b349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:51.382795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33be1e-dedb-4056-9cc4-b39959a1b349 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:51.383946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33be1e-dedb-4056-9cc4-b39959a1b349 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:51.384757 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33be1e-dedb-4056-9cc4-b39959a1b349 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:51.386491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33be1e-dedb-4056-9cc4-b39959a1b349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:51.387424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33be1e-dedb-4056-9cc4-b39959a1b349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:51.390464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33be1e-dedb-4056-9cc4-b39959a1b349 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:51.408512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35ab6c-dc03-44c0-ba21-800ae3e9d8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:51.410646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ab6c-dc03-44c0-ba21-800ae3e9d8f3 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:51.411474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ab6c-dc03-44c0-ba21-800ae3e9d8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:51.411957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ab6c-dc03-44c0-ba21-800ae3e9d8f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:51.423408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 398/799] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:51.425696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33be1e-dedb-4056-9cc4-b39959a1b349 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:51.440026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35ab6c-dc03-44c0-ba21-800ae3e9d8f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:51.442805 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35ab6c-dc03-44c0-ba21-800ae3e9d8f3 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-7b35ab6c-dc03-44c0-ba21-800ae3e9d8f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:51.479659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:51.481449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:51.483300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:51.483300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:51.483300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:51.483300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:51.483300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 402/800] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:51.484696 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35ab6c-dc03-44c0-ba21-800ae3e9d8f3 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:51.653522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:51.671883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33be1e-dedb-4056-9cc4-b39959a1b349 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:51.699885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35ab6c-dc03-44c0-ba21-800ae3e9d8f3 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:51.737373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29654f3a-3348-4f7e-97db-f7f57fa80a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:51.738470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29654f3a-3348-4f7e-97db-f7f57fa80a3e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:51.738979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29654f3a-3348-4f7e-97db-f7f57fa80a3e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:51.739484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29654f3a-3348-4f7e-97db-f7f57fa80a3e None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:51.740839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29654f3a-3348-4f7e-97db-f7f57fa80a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:51.741369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29654f3a-3348-4f7e-97db-f7f57fa80a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:51.743916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29654f3a-3348-4f7e-97db-f7f57fa80a3e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:51.754375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f5878-1180-4fd2-acf2-9fde1f2d6098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:51.755517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5878-1180-4fd2-acf2-9fde1f2d6098 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:51.756011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5878-1180-4fd2-acf2-9fde1f2d6098 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:51.756510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5878-1180-4fd2-acf2-9fde1f2d6098 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:51.770570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 399/801] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:51.770570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29654f3a-3348-4f7e-97db-f7f57fa80a3e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:51.772978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5878-1180-4fd2-acf2-9fde1f2d6098 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:51.775512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5878-1180-4fd2-acf2-9fde1f2d6098 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-5f4f5878-1180-4fd2-acf2-9fde1f2d6098 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:51.797423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:51.799338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 403/802] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b1bd6-e60f-4a14-932d-18309baaa505 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:51.801153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b1bd6-e60f-4a14-932d-18309baaa505 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:51.802516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b1bd6-e60f-4a14-932d-18309baaa505 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:51.808336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 404/803] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:51.808336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b1bd6-e60f-4a14-932d-18309baaa505 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:51.824608 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:51.915977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29654f3a-3348-4f7e-97db-f7f57fa80a3e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:51.964516 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf82a-a474-4276-b7d9-f4c8ca9020a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:51.965251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf82a-a474-4276-b7d9-f4c8ca9020a9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:51.965622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf82a-a474-4276-b7d9-f4c8ca9020a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:51.965986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf82a-a474-4276-b7d9-f4c8ca9020a9 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:51.966835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf82a-a474-4276-b7d9-f4c8ca9020a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:51.967294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf82a-a474-4276-b7d9-f4c8ca9020a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:51.968853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf82a-a474-4276-b7d9-f4c8ca9020a9 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:51.972366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b1bd6-e60f-4a14-932d-18309baaa505 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:51.984307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 400/804] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:51.985648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf82a-a474-4276-b7d9-f4c8ca9020a9 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:52.005042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:52.026974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed6c57-89ac-47f3-9800-7447ef4ff0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:52.028010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed6c57-89ac-47f3-9800-7447ef4ff0d6 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:52.028424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed6c57-89ac-47f3-9800-7447ef4ff0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:52.028856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed6c57-89ac-47f3-9800-7447ef4ff0d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:52.042445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed6c57-89ac-47f3-9800-7447ef4ff0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:52.045301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed6c57-89ac-47f3-9800-7447ef4ff0d6 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d4ed6c57-89ac-47f3-9800-7447ef4ff0d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:52.074285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:52.076070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 405/805] 10.222.0.124 () {56 vars in 1098 bytes} [Mon Aug 1 16:39:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205e71c-f860-448d-bb06-546f6c6ea00c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:52.079125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205e71c-f860-448d-bb06-546f6c6ea00c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:52.080548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205e71c-f860-448d-bb06-546f6c6ea00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:52.103399 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-b205e71c-f860-448d-bb06-546f6c6ea00c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:52.105206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b205e71c-f860-448d-bb06-546f6c6ea00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:52.145021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf82a-a474-4276-b7d9-f4c8ca9020a9 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:52.202308 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8675771-10e3-4f08-bad0-a59ccb3985ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:52.203476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8675771-10e3-4f08-bad0-a59ccb3985ca None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:52.203963 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8675771-10e3-4f08-bad0-a59ccb3985ca None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:52.204379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8675771-10e3-4f08-bad0-a59ccb3985ca None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:52.205765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8675771-10e3-4f08-bad0-a59ccb3985ca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:52.206261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8675771-10e3-4f08-bad0-a59ccb3985ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:52.208896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8675771-10e3-4f08-bad0-a59ccb3985ca None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:52.210981 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:52.222471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 406/806] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:52 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:39:52.224784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b8dab-3f66-4a5f-b21b-aa94e9b165c0 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:52.225431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b8dab-3f66-4a5f-b21b-aa94e9b165c0 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:52.225765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b8dab-3f66-4a5f-b21b-aa94e9b165c0 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:52.228637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 407/807] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:52 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:52.229836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b8dab-3f66-4a5f-b21b-aa94e9b165c0 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:52.240077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 401/808] 10.222.0.124 () {56 vars in 1140 bytes} [Mon Aug 1 16:39:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:52.241272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8675771-10e3-4f08-bad0-a59ccb3985ca None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:52.368496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b8dab-3f66-4a5f-b21b-aa94e9b165c0 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:52.373826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:52.415642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896cc5b-3a22-408c-8b90-2078cff37274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:52.416064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8675771-10e3-4f08-bad0-a59ccb3985ca None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:52.416568 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896cc5b-3a22-408c-8b90-2078cff37274 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:52.417085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896cc5b-3a22-408c-8b90-2078cff37274 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:52.417458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896cc5b-3a22-408c-8b90-2078cff37274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:52.428437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896cc5b-3a22-408c-8b90-2078cff37274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:52.430305 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896cc5b-3a22-408c-8b90-2078cff37274 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-2896cc5b-3a22-408c-8b90-2078cff37274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:52.448604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:52.450753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:52.452938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:52.452938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:52.452938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:52.452938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:52.452938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:52.452938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:52.452938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:52.452938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:52.452938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 408/809] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:52.454052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3dce1-e88f-44f2-817e-2f01476ca3e8 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:52.454052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3dce1-e88f-44f2-817e-2f01476ca3e8 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:52.454454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3dce1-e88f-44f2-817e-2f01476ca3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:52.464988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc28a8-42b1-4acd-9480-1db84bcc0d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:52.465973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc28a8-42b1-4acd-9480-1db84bcc0d6e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:52.466384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc28a8-42b1-4acd-9480-1db84bcc0d6e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:52.466806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc28a8-42b1-4acd-9480-1db84bcc0d6e None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:52.467991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc28a8-42b1-4acd-9480-1db84bcc0d6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:52.468494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc28a8-42b1-4acd-9480-1db84bcc0d6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:52.471240 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc28a8-42b1-4acd-9480-1db84bcc0d6e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:52.484028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-81c3dce1-e88f-44f2-817e-2f01476ca3e8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:52.486227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-81c3dce1-e88f-44f2-817e-2f01476ca3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:52.502783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 402/810] 10.222.0.124 () {56 vars in 1138 bytes} [Mon Aug 1 16:39:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:52.504652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc28a8-42b1-4acd-9480-1db84bcc0d6e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:52.576828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:52.599401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 409/811] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:52 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:39:52.600900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3dce1-e88f-44f2-817e-2f01476ca3e8 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:52.655115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc28a8-42b1-4acd-9480-1db84bcc0d6e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:52.686841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:52.696371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5ebc7-5316-41f9-9322-e354911d6da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:52.697044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5ebc7-5316-41f9-9322-e354911d6da4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:52.697325 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5ebc7-5316-41f9-9322-e354911d6da4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:52.697602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5ebc7-5316-41f9-9322-e354911d6da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:52.710172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5ebc7-5316-41f9-9322-e354911d6da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:52.712119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5ebc7-5316-41f9-9322-e354911d6da4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-43d5ebc7-5316-41f9-9322-e354911d6da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:52.730737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:52.732682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:52.735057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:52.735057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:52.735057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:52.735057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:52.735057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 403/812] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:52.735057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5ebc7-5316-41f9-9322-e354911d6da4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:52.736707 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3dce1-e88f-44f2-817e-2f01476ca3e8 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:52.777308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe4f38-17a1-410c-9e55-81ee0157a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:52.777978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe4f38-17a1-410c-9e55-81ee0157a95d None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:52.778257 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe4f38-17a1-410c-9e55-81ee0157a95d None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:52.778535 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe4f38-17a1-410c-9e55-81ee0157a95d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:52.779231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe4f38-17a1-410c-9e55-81ee0157a95d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:52.780688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe4f38-17a1-410c-9e55-81ee0157a95d None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-fbfe4f38-17a1-410c-9e55-81ee0157a95d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:52.790731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:52.791943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:52.793521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 410/813] 10.222.0.124 () {56 vars in 1134 bytes} [Mon Aug 1 16:39:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:52.796187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe4f38-17a1-410c-9e55-81ee0157a95d None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:52.854581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5ebc7-5316-41f9-9322-e354911d6da4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:52.859762 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:52.904926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdfd75-019a-4c71-a6bb-02d797ad78ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:52.905565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdfd75-019a-4c71-a6bb-02d797ad78ad None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:52.905850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdfd75-019a-4c71-a6bb-02d797ad78ad None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:52.906121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdfd75-019a-4c71-a6bb-02d797ad78ad None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:52.907008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdfd75-019a-4c71-a6bb-02d797ad78ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:52.907319 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdfd75-019a-4c71-a6bb-02d797ad78ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:52.908823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdfd75-019a-4c71-a6bb-02d797ad78ad None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:52.923528 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 404/814] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:52.929389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdfd75-019a-4c71-a6bb-02d797ad78ad None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:52.932856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe4f38-17a1-410c-9e55-81ee0157a95d None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:52.978827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f31ebf-3fcc-4b93-9b6c-fe06641e864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:52.979631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f31ebf-3fcc-4b93-9b6c-fe06641e864b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:52.979977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f31ebf-3fcc-4b93-9b6c-fe06641e864b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:52.980328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f31ebf-3fcc-4b93-9b6c-fe06641e864b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:52.991716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:53.072511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f31ebf-3fcc-4b93-9b6c-fe06641e864b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:53.074769 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdfd75-019a-4c71-a6bb-02d797ad78ad None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:53.075405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f31ebf-3fcc-4b93-9b6c-fe06641e864b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:53.116622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b5b82-04c6-4e00-b3d3-32900e5167bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:53.117288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b5b82-04c6-4e00-b3d3-32900e5167bc None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:53.117597 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b5b82-04c6-4e00-b3d3-32900e5167bc None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:53.117874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b5b82-04c6-4e00-b3d3-32900e5167bc None admin] PATH_INFO: `/v3/services/network` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:53.118519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b5b82-04c6-4e00-b3d3-32900e5167bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:53.119976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b5b82-04c6-4e00-b3d3-32900e5167bc None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-6e7b5b82-04c6-4e00-b3d3-32900e5167bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:53.132411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:53.134065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:53.135001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 405/815] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:52 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:53.135993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b5b82-04c6-4e00-b3d3-32900e5167bc None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:53.161801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:53.221247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 411/816] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:52 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:39:53.222511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f31ebf-3fcc-4b93-9b6c-fe06641e864b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:53.265395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b5b82-04c6-4e00-b3d3-32900e5167bc None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:53.268992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:53.308749 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b65d2-ae08-4571-9d04-a4c30ece5235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:53.309583 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b65d2-ae08-4571-9d04-a4c30ece5235 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:53.309975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b65d2-ae08-4571-9d04-a4c30ece5235 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:53.310444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b65d2-ae08-4571-9d04-a4c30ece5235 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:53.311304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b65d2-ae08-4571-9d04-a4c30ece5235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:53.311704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b65d2-ae08-4571-9d04-a4c30ece5235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:53.313920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b65d2-ae08-4571-9d04-a4c30ece5235 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:53.330799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 406/817] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:53.332243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b65d2-ae08-4571-9d04-a4c30ece5235 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:53.374550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f31ebf-3fcc-4b93-9b6c-fe06641e864b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:53.446679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072bd6e-55d4-447b-86e7-b7a89a97bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:53.447823 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072bd6e-55d4-447b-86e7-b7a89a97bcad None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:53.448386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072bd6e-55d4-447b-86e7-b7a89a97bcad None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:53.448720 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072bd6e-55d4-447b-86e7-b7a89a97bcad None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:53.449742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072bd6e-55d4-447b-86e7-b7a89a97bcad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:53.450052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072bd6e-55d4-447b-86e7-b7a89a97bcad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:53.452815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072bd6e-55d4-447b-86e7-b7a89a97bcad None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:53.462602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 412/818] 10.222.0.124 () {56 vars in 1129 bytes} [Mon Aug 1 16:39:53 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:53.464179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072bd6e-55d4-447b-86e7-b7a89a97bcad None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:53.474110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b65d2-ae08-4571-9d04-a4c30ece5235 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:53.494378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:53.519185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a209778-0219-4cc6-b144-d8dd65ac04d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:53.520306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a209778-0219-4cc6-b144-d8dd65ac04d4 None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:53.520797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a209778-0219-4cc6-b144-d8dd65ac04d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:53.521301 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a209778-0219-4cc6-b144-d8dd65ac04d4 None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/c5e98d3e170a4e95bc03daf2a950e5f6/roles/3e4fc6b2b9bb4951bc7eda99c41e5733` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:53.549136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a209778-0219-4cc6-b144-d8dd65ac04d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=c5e98d3e170a4e95bc03daf2a950e5f6, role_id=3e4fc6b2b9bb4951bc7eda99c41e5733)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:53.551917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a209778-0219-4cc6-b144-d8dd65ac04d4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:53.569731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 407/819] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:39:53 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/c5e98d3e170a4e95bc03daf2a950e5f6/roles/3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:39:53.570601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a209778-0219-4cc6-b144-d8dd65ac04d4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:53.608869 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:53.610087 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072bd6e-55d4-447b-86e7-b7a89a97bcad None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:53.659968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0aa19-4e77-4041-936a-9a2d4f457f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:53.660788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0aa19-4e77-4041-936a-9a2d4f457f74 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:53.661524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0aa19-4e77-4041-936a-9a2d4f457f74 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:53.661524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0aa19-4e77-4041-936a-9a2d4f457f74 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:53.662361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0aa19-4e77-4041-936a-9a2d4f457f74 None admin] RBAC: Adding query filter params (name=network) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:53.662771 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0aa19-4e77-4041-936a-9a2d4f457f74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:53.664356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0aa19-4e77-4041-936a-9a2d4f457f74 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:53.676132 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 413/820] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:39:53 2022] GET /identity/v3/services?name=network => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:53.676132 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0aa19-4e77-4041-936a-9a2d4f457f74 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:53.771884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a209778-0219-4cc6-b144-d8dd65ac04d4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:53.795561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:53.821743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0aa19-4e77-4041-936a-9a2d4f457f74 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:53.839759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9ac62-89f9-480f-b7df-94461acdfb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:53.841009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ac62-89f9-480f-b7df-94461acdfb6b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:53.841975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ac62-89f9-480f-b7df-94461acdfb6b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:53.842417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ac62-89f9-480f-b7df-94461acdfb6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:53.856806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9ac62-89f9-480f-b7df-94461acdfb6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:53.858564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9ac62-89f9-480f-b7df-94461acdfb6b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:53.870202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de856ef0-52c1-49d2-a665-13c257fbe83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:53.870878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856ef0-52c1-49d2-a665-13c257fbe83a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:53.871222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856ef0-52c1-49d2-a665-13c257fbe83a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:53.871502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856ef0-52c1-49d2-a665-13c257fbe83a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-61c9ac62-89f9-480f-b7df-94461acdfb6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:53.877199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:53.878992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:53.880753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:53.880753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:53.880753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:53.880753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:53.880753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 408/821] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:53.887169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9ac62-89f9-480f-b7df-94461acdfb6b None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:53.887523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de856ef0-52c1-49d2-a665-13c257fbe83a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:53.887523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de856ef0-52c1-49d2-a665-13c257fbe83a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-de856ef0-52c1-49d2-a665-13c257fbe83a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:53.899976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:53.902220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:53.906085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:53.906085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:53.906085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:53.906085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:53.906085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:53.906085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:53.906085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:53.906085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:53.906085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 414/822] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:53.906085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de856ef0-52c1-49d2-a665-13c257fbe83a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:53.989661 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:54.042904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9ac62-89f9-480f-b7df-94461acdfb6b None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:54.068699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de856ef0-52c1-49d2-a665-13c257fbe83a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:54.088792 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e435a1-1fb1-4e06-8721-f1878d539416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:54.089722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e435a1-1fb1-4e06-8721-f1878d539416 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:54.090158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e435a1-1fb1-4e06-8721-f1878d539416 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:54.090628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e435a1-1fb1-4e06-8721-f1878d539416 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:54.091683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e435a1-1fb1-4e06-8721-f1878d539416 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:54.092169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e435a1-1fb1-4e06-8721-f1878d539416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:54.094235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e435a1-1fb1-4e06-8721-f1878d539416 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:54.101810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 409/823] 10.222.0.124 () {56 vars in 1129 bytes} [Mon Aug 1 16:39:53 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:54.103002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e435a1-1fb1-4e06-8721-f1878d539416 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:54.120667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449663a-30b6-4570-ba84-0f246122fc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:54.121654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449663a-30b6-4570-ba84-0f246122fc4b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:54.122082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449663a-30b6-4570-ba84-0f246122fc4b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:54.122538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449663a-30b6-4570-ba84-0f246122fc4b None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:54.123607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449663a-30b6-4570-ba84-0f246122fc4b None admin] RBAC: Adding query filter params (type=network) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:54.124134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449663a-30b6-4570-ba84-0f246122fc4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:54.131940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449663a-30b6-4570-ba84-0f246122fc4b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:54.139855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 415/824] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:39:53 2022] GET /identity/v3/services?type=network => generated 352 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:54.144845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449663a-30b6-4570-ba84-0f246122fc4b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:54.149595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:54.247906 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e435a1-1fb1-4e06-8721-f1878d539416 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:54.280407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449663a-30b6-4570-ba84-0f246122fc4b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:54.284236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:54.292473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee00ac4-8f1f-4b19-9ca7-8842c2750eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:54.293185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00ac4-8f1f-4b19-9ca7-8842c2750eca None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:54.293448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00ac4-8f1f-4b19-9ca7-8842c2750eca None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:54.293735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00ac4-8f1f-4b19-9ca7-8842c2750eca None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:54.294488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee00ac4-8f1f-4b19-9ca7-8842c2750eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:54.294797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee00ac4-8f1f-4b19-9ca7-8842c2750eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:54.296295 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee00ac4-8f1f-4b19-9ca7-8842c2750eca None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:54.311272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 410/825] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:54.312157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee00ac4-8f1f-4b19-9ca7-8842c2750eca None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:54.329799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688b2be-d4fa-4d24-ae81-9304611b51c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:54.330417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688b2be-d4fa-4d24-ae81-9304611b51c2 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:54.330763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688b2be-d4fa-4d24-ae81-9304611b51c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:54.330994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688b2be-d4fa-4d24-ae81-9304611b51c2 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:54.331789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688b2be-d4fa-4d24-ae81-9304611b51c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:54.332090 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688b2be-d4fa-4d24-ae81-9304611b51c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:54.334004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688b2be-d4fa-4d24-ae81-9304611b51c2 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:54.351927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 416/826] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:54.352834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688b2be-d4fa-4d24-ae81-9304611b51c2 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:54.434750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:54.476390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee00ac4-8f1f-4b19-9ca7-8842c2750eca None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:54.504440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688b2be-d4fa-4d24-ae81-9304611b51c2 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:54.539422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca6acb-298c-48ff-a5ca-a0db7754babe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:54.540400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca6acb-298c-48ff-a5ca-a0db7754babe None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:54.540838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca6acb-298c-48ff-a5ca-a0db7754babe None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:54.541280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca6acb-298c-48ff-a5ca-a0db7754babe None admin] PATH_INFO: `/v3/endpoints` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:54.542685 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca6acb-298c-48ff-a5ca-a0db7754babe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:54.544498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca6acb-298c-48ff-a5ca-a0db7754babe None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:54.565820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a424c0-b2f4-47c0-a8a0-cba33bf3fef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:54.566752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a424c0-b2f4-47c0-a8a0-cba33bf3fef4 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:54.567126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a424c0-b2f4-47c0-a8a0-cba33bf3fef4 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:54.567556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a424c0-b2f4-47c0-a8a0-cba33bf3fef4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:54.568740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a424c0-b2f4-47c0-a8a0-cba33bf3fef4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:54.570732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a424c0-b2f4-47c0-a8a0-cba33bf3fef4 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:54.578068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 411/827] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:39:54 2022] POST /identity/v3/endpoints => generated 348 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:39:54.580132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca6acb-298c-48ff-a5ca-a0db7754babe None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:54.609676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 417/828] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:39:54 2022] POST /identity/v3/endpoints => generated 329 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:39:54.611113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a424c0-b2f4-47c0-a8a0-cba33bf3fef4 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:54.675512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:54.766735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a424c0-b2f4-47c0-a8a0-cba33bf3fef4 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:54.795440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:54.854883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e0392-f02f-4106-8356-d1023741f7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:54.856871 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e0392-f02f-4106-8356-d1023741f7ac None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:54.857687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e0392-f02f-4106-8356-d1023741f7ac None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:54.858370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e0392-f02f-4106-8356-d1023741f7ac None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/7b46aa077b4147c9836b646cf42cff50/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:54.865218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca6acb-298c-48ff-a5ca-a0db7754babe None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:54.867543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e0392-f02f-4106-8356-d1023741f7ac None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=7b46aa077b4147c9836b646cf42cff50, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:54.873924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e0392-f02f-4106-8356-d1023741f7ac None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:54.914602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 418/829] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:39:54 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/7b46aa077b4147c9836b646cf42cff50/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:39:54.929591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e9888-e03b-48e5-bfde-361d4384006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:54.930364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e9888-e03b-48e5-bfde-361d4384006c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:54.930654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e9888-e03b-48e5-bfde-361d4384006c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:54.930933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e9888-e03b-48e5-bfde-361d4384006c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:54.940379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e9888-e03b-48e5-bfde-361d4384006c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:54.942191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e9888-e03b-48e5-bfde-361d4384006c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-da6e9888-e03b-48e5-bfde-361d4384006c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:54.957350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:54.959705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:54.961510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:54.961510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:54.961510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:54.961510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:54.961510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:54.961510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:54.961510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:54.961510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:54.961510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 412/830] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:54.966871 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e0392-f02f-4106-8356-d1023741f7ac None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:55.108392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e0392-f02f-4106-8356-d1023741f7ac None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:55.156635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1d8bd-5e09-4500-92ba-44b9faa5aef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:55.157331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1d8bd-5e09-4500-92ba-44b9faa5aef2 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:55.157597 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1d8bd-5e09-4500-92ba-44b9faa5aef2 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:55.157877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1d8bd-5e09-4500-92ba-44b9faa5aef2 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:55.158686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1d8bd-5e09-4500-92ba-44b9faa5aef2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:55.159026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1d8bd-5e09-4500-92ba-44b9faa5aef2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:55.160564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1d8bd-5e09-4500-92ba-44b9faa5aef2 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:55.183347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 419/831] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:39:55.190941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e9888-e03b-48e5-bfde-361d4384006c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:55.401418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e9888-e03b-48e5-bfde-361d4384006c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:55.403174 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:55.442819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce5216-e8f4-426a-83fc-6683f663fb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:55.443520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce5216-e8f4-426a-83fc-6683f663fb49 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:55.443922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce5216-e8f4-426a-83fc-6683f663fb49 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:55.444279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce5216-e8f4-426a-83fc-6683f663fb49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:55.445034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce5216-e8f4-426a-83fc-6683f663fb49 None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=9728f2fe7b5a40cd9f8ead5cf99af581) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:55.445351 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce5216-e8f4-426a-83fc-6683f663fb49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:55.446847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce5216-e8f4-426a-83fc-6683f663fb49 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:55.454281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 413/832] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:55 2022] GET /identity/v3/role_assignments?user.id=9728f2fe7b5a40cd9f8ead5cf99af581&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=390e487a45f74246ba84773e8760bc7c => generated 610 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:55.995355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2dd90-2ec8-420a-b07c-63eb1c084cb0 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:55.996385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2dd90-2ec8-420a-b07c-63eb1c084cb0 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:55.996385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2dd90-2ec8-420a-b07c-63eb1c084cb0 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:55.997652 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 420/833] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:56.006375 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244811e-adfe-4a63-8f67-192c889cf95a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:56.007797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244811e-adfe-4a63-8f67-192c889cf95a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:56.008100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244811e-adfe-4a63-8f67-192c889cf95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:56.030482 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b244811e-adfe-4a63-8f67-192c889cf95a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:56.032696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b244811e-adfe-4a63-8f67-192c889cf95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:56.112361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 414/834] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:56 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:39:56.136979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2dd90-2ec8-420a-b07c-63eb1c084cb0 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:56.181965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:56.266634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2dd90-2ec8-420a-b07c-63eb1c084cb0 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:56.306824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aecca-ea85-4321-94fc-caa9e26c7beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:56.307578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aecca-ea85-4321-94fc-caa9e26c7beb None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:56.307903 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aecca-ea85-4321-94fc-caa9e26c7beb None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:56.308189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aecca-ea85-4321-94fc-caa9e26c7beb None admin] PATH_INFO: `/v3/roles/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:56.321832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190aecca-ea85-4321-94fc-caa9e26c7beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-190aecca-ea85-4321-94fc-caa9e26c7beb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:56.327013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:56.330553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:56.334089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 421/835] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:39:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:56.336722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244811e-adfe-4a63-8f67-192c889cf95a None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:56.443479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:56.454266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244811e-adfe-4a63-8f67-192c889cf95a None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:56.496285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ba0b0-c6c8-43a6-861a-bf18a8560600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:56.497256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ba0b0-c6c8-43a6-861a-bf18a8560600 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:56.497690 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ba0b0-c6c8-43a6-861a-bf18a8560600 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:56.498125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ba0b0-c6c8-43a6-861a-bf18a8560600 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:56.499077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ba0b0-c6c8-43a6-861a-bf18a8560600 None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:56.499547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ba0b0-c6c8-43a6-861a-bf18a8560600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:56.501570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ba0b0-c6c8-43a6-861a-bf18a8560600 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:56.512257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 415/836] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:39:56 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:56.518785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aecca-ea85-4321-94fc-caa9e26c7beb None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:56.631719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:56.638783 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aecca-ea85-4321-94fc-caa9e26c7beb None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:56.680822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fd936-f1ce-4c1c-8613-3e67af9aa90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:56.681548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fd936-f1ce-4c1c-8613-3e67af9aa90a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:56.681833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fd936-f1ce-4c1c-8613-3e67af9aa90a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:56.682104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fd936-f1ce-4c1c-8613-3e67af9aa90a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:56.695488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fd936-f1ce-4c1c-8613-3e67af9aa90a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:56.697003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fd936-f1ce-4c1c-8613-3e67af9aa90a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-e71fd936-f1ce-4c1c-8613-3e67af9aa90a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:56.714375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:56.715417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:56.716518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:56.716518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:56.716518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:56.716518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:56.716518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 422/837] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:56.722498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ba0b0-c6c8-43a6-861a-bf18a8560600 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:56.850438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ba0b0-c6c8-43a6-861a-bf18a8560600 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:56.891662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed101b-92d4-499d-8512-2b0aefb367a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:56.892298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed101b-92d4-499d-8512-2b0aefb367a9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:56.892578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed101b-92d4-499d-8512-2b0aefb367a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:56.892852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed101b-92d4-499d-8512-2b0aefb367a9 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:56.893584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed101b-92d4-499d-8512-2b0aefb367a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:56.893888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed101b-92d4-499d-8512-2b0aefb367a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:56.895352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed101b-92d4-499d-8512-2b0aefb367a9 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:56.910327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 416/838] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:56.915934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fd936-f1ce-4c1c-8613-3e67af9aa90a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:57.037850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fd936-f1ce-4c1c-8613-3e67af9aa90a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:57.083538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009d2b6-da70-45e2-bc8f-39974158a76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:57.084215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009d2b6-da70-45e2-bc8f-39974158a76d None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:57.084497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009d2b6-da70-45e2-bc8f-39974158a76d None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:57.084773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009d2b6-da70-45e2-bc8f-39974158a76d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:57.094979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009d2b6-da70-45e2-bc8f-39974158a76d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:57.096421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009d2b6-da70-45e2-bc8f-39974158a76d None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-2009d2b6-da70-45e2-bc8f-39974158a76d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:39:57.111185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:57.113395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:57.115994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:57.115994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:57.115994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:39:57.115994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:39:57.115994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:39:57.115994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:39:57.115994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:39:57.115994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:39:57.115994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:39:57.115994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:57.115994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 423/839] 10.222.0.124 () {56 vars in 1122 bytes} [Mon Aug 1 16:39:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:57.122079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed101b-92d4-499d-8512-2b0aefb367a9 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:57.135028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edf002-d6cb-4ec5-8511-d1feef1497b5 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:57.135393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edf002-d6cb-4ec5-8511-d1feef1497b5 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:57.135611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edf002-d6cb-4ec5-8511-d1feef1497b5 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:57.137931 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 424/840] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:57 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:39:57.142174 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:57.144268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4284-49cc-458c-98cf-23c53b741b7f None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:57.145757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4284-49cc-458c-98cf-23c53b741b7f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:57.145757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4284-49cc-458c-98cf-23c53b741b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:57.164881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-327b4284-49cc-458c-98cf-23c53b741b7f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:57.166255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-327b4284-49cc-458c-98cf-23c53b741b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:57.168583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:57.253529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 425/841] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:57 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:39:57.258848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed101b-92d4-499d-8512-2b0aefb367a9 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:57.271300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b4284-49cc-458c-98cf-23c53b741b7f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:57.306439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cae94a-e842-461f-a56a-460c826613ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:57.307146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cae94a-e842-461f-a56a-460c826613ae None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:57.307453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cae94a-e842-461f-a56a-460c826613ae None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:57.307806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cae94a-e842-461f-a56a-460c826613ae None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:57.308651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cae94a-e842-461f-a56a-460c826613ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:57.308951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cae94a-e842-461f-a56a-460c826613ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:57.310543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cae94a-e842-461f-a56a-460c826613ae None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:57.351108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 417/842] 10.222.0.124 () {56 vars in 1154 bytes} [Mon Aug 1 16:39:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:57.354395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cae94a-e842-461f-a56a-460c826613ae None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:57.460956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:57.476818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b4284-49cc-458c-98cf-23c53b741b7f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:57.502446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cae94a-e842-461f-a56a-460c826613ae None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:57.549163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913bdd5-ee4a-4f17-a3f8-2ffa06109251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:57.549812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913bdd5-ee4a-4f17-a3f8-2ffa06109251 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:57.550099 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913bdd5-ee4a-4f17-a3f8-2ffa06109251 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:57.550377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913bdd5-ee4a-4f17-a3f8-2ffa06109251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:57.564569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcec45f-c545-4655-9dc9-7a56f98768b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:57.565251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcec45f-c545-4655-9dc9-7a56f98768b3 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:57.565533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcec45f-c545-4655-9dc9-7a56f98768b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:57.565809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcec45f-c545-4655-9dc9-7a56f98768b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:57.566607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcec45f-c545-4655-9dc9-7a56f98768b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:57.568884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcec45f-c545-4655-9dc9-7a56f98768b3 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-cfcec45f-c545-4655-9dc9-7a56f98768b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:57.579770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:57.582023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:39:57.584153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:57.587813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 426/843] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:39:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:39:57.590309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcec45f-c545-4655-9dc9-7a56f98768b3 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:57.593824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:57.689522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913bdd5-ee4a-4f17-a3f8-2ffa06109251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:57.691289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913bdd5-ee4a-4f17-a3f8-2ffa06109251 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:57.779816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcec45f-c545-4655-9dc9-7a56f98768b3 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:57.838284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7afe7-268f-4d87-98dc-013d9f03784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:57.838705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7afe7-268f-4d87-98dc-013d9f03784f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:57.839307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7afe7-268f-4d87-98dc-013d9f03784f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:57.839962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7afe7-268f-4d87-98dc-013d9f03784f None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:57.841364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7afe7-268f-4d87-98dc-013d9f03784f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:57.842038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7afe7-268f-4d87-98dc-013d9f03784f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:57.845902 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7afe7-268f-4d87-98dc-013d9f03784f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:57.855554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:57.860779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 427/844] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:39:57 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:57.866481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7afe7-268f-4d87-98dc-013d9f03784f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:57.912087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 418/845] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:39:57 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 16:39:57.914927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575784-5906-4b6a-9878-1aa7fc4db68d None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:57.915757 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575784-5906-4b6a-9878-1aa7fc4db68d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:57.916648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575784-5906-4b6a-9878-1aa7fc4db68d None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:57.919674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 419/846] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:57 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:57.921775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20575784-5906-4b6a-9878-1aa7fc4db68d None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:58.015374 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:58.091717 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7afe7-268f-4d87-98dc-013d9f03784f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:58.124357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20575784-5906-4b6a-9878-1aa7fc4db68d None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:58.157439 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bc555-9689-4fff-8175-ea375423e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:58.158451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bc555-9689-4fff-8175-ea375423e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:58.158930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bc555-9689-4fff-8175-ea375423e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:58.159424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bc555-9689-4fff-8175-ea375423e8f2 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:58.160493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bc555-9689-4fff-8175-ea375423e8f2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:58.160957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bc555-9689-4fff-8175-ea375423e8f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:58.163440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bc555-9689-4fff-8175-ea375423e8f2 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:58.171879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 428/847] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:39:57 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:58.173055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0b726-1f40-40a7-9318-89015fb6a6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:58.174119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeedfa3-760a-4215-b201-ea49d9ea7131 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:58.174394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0b726-1f40-40a7-9318-89015fb6a6df None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:58.174618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeedfa3-760a-4215-b201-ea49d9ea7131 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:58.174721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0b726-1f40-40a7-9318-89015fb6a6df None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:58.174895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0b726-1f40-40a7-9318-89015fb6a6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:58.175101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeedfa3-760a-4215-b201-ea49d9ea7131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:58.191989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0b726-1f40-40a7-9318-89015fb6a6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:58.193577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0b726-1f40-40a7-9318-89015fb6a6df None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:58.208728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-9eeedfa3-760a-4215-b201-ea49d9ea7131 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:58.210814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9eeedfa3-760a-4215-b201-ea49d9ea7131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-9bb0b726-1f40-40a7-9318-89015fb6a6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:58.215238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:58.216245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:58.217132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:58.217132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:58.217132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:58.217132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:58.219210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 420/848] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:58.221615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede02c-943e-4735-8469-253bab435add None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:58.222091 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede02c-943e-4735-8469-253bab435add None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:58.222558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede02c-943e-4735-8469-253bab435add None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:58.227554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 421/849] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:39:58 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:39:58.227554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede02c-943e-4735-8469-253bab435add None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:58.268202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:58.343183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 429/850] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:58 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:39:58.343183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379b3d7-fc28-4086-bcd2-d3302d03288b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:58.343183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379b3d7-fc28-4086-bcd2-d3302d03288b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:58.343183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379b3d7-fc28-4086-bcd2-d3302d03288b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:58.374625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-2379b3d7-fc28-4086-bcd2-d3302d03288b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:39:58.377678 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2379b3d7-fc28-4086-bcd2-d3302d03288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:39:58.381514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede02c-943e-4735-8469-253bab435add None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:58.449790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966930d6-803a-42ba-9719-6515b4972794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:58.450862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966930d6-803a-42ba-9719-6515b4972794 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:58.451323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966930d6-803a-42ba-9719-6515b4972794 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:58.451726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966930d6-803a-42ba-9719-6515b4972794 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:58.452824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966930d6-803a-42ba-9719-6515b4972794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:58.453372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966930d6-803a-42ba-9719-6515b4972794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:58.456066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966930d6-803a-42ba-9719-6515b4972794 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:58.456785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:58.471690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 430/851] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:39:58 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:39:58.472581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379b3d7-fc28-4086-bcd2-d3302d03288b None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:58.488096 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 422/852] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:58.496773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966930d6-803a-42ba-9719-6515b4972794 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:58.619556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:58.623956 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379b3d7-fc28-4086-bcd2-d3302d03288b None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:58.638750 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966930d6-803a-42ba-9719-6515b4972794 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:58.672892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86959d-8a94-4b89-8182-901936ce6671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:58.673571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86959d-8a94-4b89-8182-901936ce6671 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:58.673844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86959d-8a94-4b89-8182-901936ce6671 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:58.674118 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86959d-8a94-4b89-8182-901936ce6671 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:58.685167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b8257-ce02-4b91-9598-473f2c6a1550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:58.686048 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8257-ce02-4b91-9598-473f2c6a1550 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:58.686464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8257-ce02-4b91-9598-473f2c6a1550 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:58.687166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8257-ce02-4b91-9598-473f2c6a1550 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:58.688127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86959d-8a94-4b89-8182-901936ce6671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-5c86959d-8a94-4b89-8182-901936ce6671 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:39:58.694210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:58.699839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:58.700683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 431/853] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:58.701372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b8257-ce02-4b91-9598-473f2c6a1550 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:58.701448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86959d-8a94-4b89-8182-901936ce6671 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:58.701515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b8257-ce02-4b91-9598-473f2c6a1550 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-b75b8257-ce02-4b91-9598-473f2c6a1550 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:39:58.725908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:58.726887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:58.727840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:39:58.727840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:39:58.727840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:39:58.727840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:39:58.727840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:39:58.727840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:39:58.727840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:39:58.727840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:39:58.728268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 423/854] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:58.729523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b8257-ce02-4b91-9598-473f2c6a1550 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:58.783192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:58.849896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b8257-ce02-4b91-9598-473f2c6a1550 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:58.877348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86959d-8a94-4b89-8182-901936ce6671 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:58.911557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c951de-e29b-4532-91de-f8b2b544cd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:58.912622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c951de-e29b-4532-91de-f8b2b544cd34 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:58.913102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c951de-e29b-4532-91de-f8b2b544cd34 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:58.913565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c951de-e29b-4532-91de-f8b2b544cd34 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:58.915070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c951de-e29b-4532-91de-f8b2b544cd34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:58.915518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c951de-e29b-4532-91de-f8b2b544cd34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:58.918142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c951de-e29b-4532-91de-f8b2b544cd34 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:58.924609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e607767-3307-493c-ae07-a6d9e8e25063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:58.925283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e607767-3307-493c-ae07-a6d9e8e25063 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:58.925564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e607767-3307-493c-ae07-a6d9e8e25063 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:58.925831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e607767-3307-493c-ae07-a6d9e8e25063 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:58.926490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e607767-3307-493c-ae07-a6d9e8e25063 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:58.928662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e607767-3307-493c-ae07-a6d9e8e25063 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:58.940889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 424/855] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:39:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:58.940889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c951de-e29b-4532-91de-f8b2b544cd34 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-5e607767-3307-493c-ae07-a6d9e8e25063 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:58.941580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:58.943387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:58.948199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 432/856] 10.222.0.124 () {56 vars in 1137 bytes} [Mon Aug 1 16:39:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:58.950155 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e607767-3307-493c-ae07-a6d9e8e25063 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:58.970091 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:59.114257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c951de-e29b-4532-91de-f8b2b544cd34 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:59.142297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e607767-3307-493c-ae07-a6d9e8e25063 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:59.167064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:59.171093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe99964-ab75-4884-92c7-7d1b0f59f133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:59.172188 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe99964-ab75-4884-92c7-7d1b0f59f133 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:59.172873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe99964-ab75-4884-92c7-7d1b0f59f133 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:59.173382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe99964-ab75-4884-92c7-7d1b0f59f133 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:59.174828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe99964-ab75-4884-92c7-7d1b0f59f133 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:59.175394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe99964-ab75-4884-92c7-7d1b0f59f133 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:59.178109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe99964-ab75-4884-92c7-7d1b0f59f133 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:59.196776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220a9c1-8e34-403a-bc17-42e4444ca7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:59.197425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220a9c1-8e34-403a-bc17-42e4444ca7cf None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:59.197701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220a9c1-8e34-403a-bc17-42e4444ca7cf None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:59.197972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220a9c1-8e34-403a-bc17-42e4444ca7cf None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:59.198674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220a9c1-8e34-403a-bc17-42e4444ca7cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:59.199016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220a9c1-8e34-403a-bc17-42e4444ca7cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:59.201491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220a9c1-8e34-403a-bc17-42e4444ca7cf None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:59.214388 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 433/857] 10.222.0.124 () {56 vars in 1131 bytes} [Mon Aug 1 16:39:58 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:59.214668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 425/858] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:59.214821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220a9c1-8e34-403a-bc17-42e4444ca7cf None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:59.215039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe99964-ab75-4884-92c7-7d1b0f59f133 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:59.337604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:59.351367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220a9c1-8e34-403a-bc17-42e4444ca7cf None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:59.386631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe99964-ab75-4884-92c7-7d1b0f59f133 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:59.415810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3510836-b9aa-4c37-a6e8-a471b51145b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:59.416913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510836-b9aa-4c37-a6e8-a471b51145b3 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:59.417458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510836-b9aa-4c37-a6e8-a471b51145b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:59.417925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510836-b9aa-4c37-a6e8-a471b51145b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:59.439163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec639-1d5f-4eb2-b023-04550ccb7d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:59.440157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec639-1d5f-4eb2-b023-04550ccb7d9c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:59.440697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec639-1d5f-4eb2-b023-04550ccb7d9c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:59.441178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec639-1d5f-4eb2-b023-04550ccb7d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:59.442248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec639-1d5f-4eb2-b023-04550ccb7d9c None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=c5e98d3e170a4e95bc03daf2a950e5f6) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:59.442941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec639-1d5f-4eb2-b023-04550ccb7d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:59.444784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec639-1d5f-4eb2-b023-04550ccb7d9c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:59.446857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3510836-b9aa-4c37-a6e8-a471b51145b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:59.449578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3510836-b9aa-4c37-a6e8-a471b51145b3 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:59.452485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 426/859] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:39:59 2022] GET /identity/v3/role_assignments?user.id=c5e98d3e170a4e95bc03daf2a950e5f6&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 610 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:59.453586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec639-1d5f-4eb2-b023-04550ccb7d9c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d3510836-b9aa-4c37-a6e8-a471b51145b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:39:59.487482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:39:59.488651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:39:59.489768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:39:59.489768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:39:59.489768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:39:59.489768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:39:59.507029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 434/860] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:39:59.508445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3510836-b9aa-4c37-a6e8-a471b51145b3 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:59.552389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:59.613097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec639-1d5f-4eb2-b023-04550ccb7d9c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:59.656448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48b99-9754-450d-a5c3-65fde7d54104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:59.657105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48b99-9754-450d-a5c3-65fde7d54104 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:59.657386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48b99-9754-450d-a5c3-65fde7d54104 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:59.657661 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48b99-9754-450d-a5c3-65fde7d54104 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:59.658383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48b99-9754-450d-a5c3-65fde7d54104 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:59.658691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48b99-9754-450d-a5c3-65fde7d54104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:59.660309 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48b99-9754-450d-a5c3-65fde7d54104 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:59.663144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:59.667550 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 427/861] 10.222.0.124 () {56 vars in 1131 bytes} [Mon Aug 1 16:39:59 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:59.676920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3510836-b9aa-4c37-a6e8-a471b51145b3 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:39:59.735471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42ffb2-3f3b-45ce-a875-975934042980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:39:59.736764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42ffb2-3f3b-45ce-a875-975934042980 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:39:59.737088 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42ffb2-3f3b-45ce-a875-975934042980 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:39:59.737574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42ffb2-3f3b-45ce-a875-975934042980 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:39:59.738937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42ffb2-3f3b-45ce-a875-975934042980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:39:59.739686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42ffb2-3f3b-45ce-a875-975934042980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:39:59.742529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42ffb2-3f3b-45ce-a875-975934042980 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:39:59.772981 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 435/862] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:39:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:39:59.780041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48b99-9754-450d-a5c3-65fde7d54104 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:39:59.997178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48b99-9754-450d-a5c3-65fde7d54104 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:00.040997 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db7174-c0fe-4d11-a294-9e0a2c1789f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:00.041669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db7174-c0fe-4d11-a294-9e0a2c1789f9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:00.041951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db7174-c0fe-4d11-a294-9e0a2c1789f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:00.042231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db7174-c0fe-4d11-a294-9e0a2c1789f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:00.051691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db7174-c0fe-4d11-a294-9e0a2c1789f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:00.053203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db7174-c0fe-4d11-a294-9e0a2c1789f9 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-b9db7174-c0fe-4d11-a294-9e0a2c1789f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:40:00.071156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:00.073503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:00.076186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:00.076186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:00.076186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:40:00.076186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:40:00.076186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:40:00.076186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:40:00.076186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:40:00.076186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:40:00.076186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:40:00.076186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:00.076186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 428/863] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:39:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:00.088923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42ffb2-3f3b-45ce-a875-975934042980 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:00.290025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:00.314098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42ffb2-3f3b-45ce-a875-975934042980 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:00.369090 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc234d-5198-4587-9cba-daa680e9e57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:00.369783 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc234d-5198-4587-9cba-daa680e9e57d None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:00.370077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc234d-5198-4587-9cba-daa680e9e57d None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:00.370334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc234d-5198-4587-9cba-daa680e9e57d None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:00.371252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc234d-5198-4587-9cba-daa680e9e57d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:00.371557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc234d-5198-4587-9cba-daa680e9e57d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:00.373063 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc234d-5198-4587-9cba-daa680e9e57d None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:00.398621 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 436/864] 10.222.0.124 () {56 vars in 1140 bytes} [Mon Aug 1 16:40:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:00.408923 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db7174-c0fe-4d11-a294-9e0a2c1789f9 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:00.541559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:00.630151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db7174-c0fe-4d11-a294-9e0a2c1789f9 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:00.682139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6597ef8-370f-4698-ad94-73f6d8819aa9 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:00.682598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6597ef8-370f-4698-ad94-73f6d8819aa9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:00.683097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6597ef8-370f-4698-ad94-73f6d8819aa9 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:00.686010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 437/865] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:00 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:00.691978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98223-b808-42ac-a3e0-10f002d78023 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:00.692642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98223-b808-42ac-a3e0-10f002d78023 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:00.693121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98223-b808-42ac-a3e0-10f002d78023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:00.703428 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ba99e-389f-4b93-83d9-fb0cddac02c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:00.704486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ba99e-389f-4b93-83d9-fb0cddac02c3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:00.704972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ba99e-389f-4b93-83d9-fb0cddac02c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:00.705442 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ba99e-389f-4b93-83d9-fb0cddac02c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:00.715541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-36c98223-b808-42ac-a3e0-10f002d78023 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:00.717167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-36c98223-b808-42ac-a3e0-10f002d78023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:00.811461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 438/866] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:00 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:00.829709 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c98223-b808-42ac-a3e0-10f002d78023 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:00.867987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ba99e-389f-4b93-83d9-fb0cddac02c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:00.871376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ba99e-389f-4b93-83d9-fb0cddac02c3 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:00.928596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:00.956477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c98223-b808-42ac-a3e0-10f002d78023 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:01.000665 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129f689-757d-44db-9b92-3ebaee52fbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:01.001905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129f689-757d-44db-9b92-3ebaee52fbda None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:01.002512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129f689-757d-44db-9b92-3ebaee52fbda None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:01.003075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129f689-757d-44db-9b92-3ebaee52fbda None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:01.004025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129f689-757d-44db-9b92-3ebaee52fbda None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:01.005793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:01.007057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129f689-757d-44db-9b92-3ebaee52fbda None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:01.039730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 439/867] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:40:00 2022] POST /identity/v3/services => generated 252 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:40:01.094903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 429/868] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:40:00 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 16:40:01.100079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129f689-757d-44db-9b92-3ebaee52fbda None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:01.286268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129f689-757d-44db-9b92-3ebaee52fbda None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:01.330640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2e2a3-400c-4d4e-bd76-8fe3c4988408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:01.332810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2e2a3-400c-4d4e-bd76-8fe3c4988408 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:01.333315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2e2a3-400c-4d4e-bd76-8fe3c4988408 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:01.333602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2e2a3-400c-4d4e-bd76-8fe3c4988408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:01.336714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:01.351256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2e2a3-400c-4d4e-bd76-8fe3c4988408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:01.352673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2e2a3-400c-4d4e-bd76-8fe3c4988408 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-bff2e2a3-400c-4d4e-bd76-8fe3c4988408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:01.370666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:01.371706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:01.373112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:01.373112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:01.373112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:01.373112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:01.373112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 440/869] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:01.378414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ba99e-389f-4b93-83d9-fb0cddac02c3 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:01.549384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ba99e-389f-4b93-83d9-fb0cddac02c3 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:01.616825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdca41-e812-4be5-be9d-7f0b876864d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:01.617694 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdca41-e812-4be5-be9d-7f0b876864d0 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:01.618125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdca41-e812-4be5-be9d-7f0b876864d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:01.618546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdca41-e812-4be5-be9d-7f0b876864d0 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:01.619733 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdca41-e812-4be5-be9d-7f0b876864d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:01.620217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdca41-e812-4be5-be9d-7f0b876864d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:01.622617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdca41-e812-4be5-be9d-7f0b876864d0 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:01.645457 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 430/870] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:01.654302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2e2a3-400c-4d4e-bd76-8fe3c4988408 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:01.818474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2e2a3-400c-4d4e-bd76-8fe3c4988408 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:01.857957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac9ca-20ef-4d11-82bc-26f763cd6507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:01.859350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac9ca-20ef-4d11-82bc-26f763cd6507 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:01.859870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac9ca-20ef-4d11-82bc-26f763cd6507 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:01.860347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac9ca-20ef-4d11-82bc-26f763cd6507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:01.868718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac9ca-20ef-4d11-82bc-26f763cd6507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:01.870566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac9ca-20ef-4d11-82bc-26f763cd6507 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-6dbac9ca-20ef-4d11-82bc-26f763cd6507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:40:01.884322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:01.885317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:01.886225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:40:01.886225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:40:01.886225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:40:01.886225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:40:01.886225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:40:01.886225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:40:01.886225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:01.886225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:01.888837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 441/871] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:01.898766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdca41-e812-4be5-be9d-7f0b876864d0 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:01.937391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:02.060506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdca41-e812-4be5-be9d-7f0b876864d0 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:02.112937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24813f21-a2f6-4736-bd8d-5e112dbd1b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:02.114013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813f21-a2f6-4736-bd8d-5e112dbd1b72 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:02.114535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813f21-a2f6-4736-bd8d-5e112dbd1b72 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:02.115117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813f21-a2f6-4736-bd8d-5e112dbd1b72 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:02.116545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24813f21-a2f6-4736-bd8d-5e112dbd1b72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:02.117146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24813f21-a2f6-4736-bd8d-5e112dbd1b72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:02.119165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24813f21-a2f6-4736-bd8d-5e112dbd1b72 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:02.138114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 431/872] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:02.146206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac9ca-20ef-4d11-82bc-26f763cd6507 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:02.210124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:02.272910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac9ca-20ef-4d11-82bc-26f763cd6507 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:02.312080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e2950-2899-4c8c-88e2-e3a75b126aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:02.312731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2950-2899-4c8c-88e2-e3a75b126aeb None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:02.313016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2950-2899-4c8c-88e2-e3a75b126aeb None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:02.313305 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2950-2899-4c8c-88e2-e3a75b126aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:02.314106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2950-2899-4c8c-88e2-e3a75b126aeb None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=7b46aa077b4147c9836b646cf42cff50) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:02.314417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2950-2899-4c8c-88e2-e3a75b126aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:02.315976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2950-2899-4c8c-88e2-e3a75b126aeb None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:02.323381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 442/873] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:40:02 2022] GET /identity/v3/role_assignments?user.id=7b46aa077b4147c9836b646cf42cff50&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=390e487a45f74246ba84773e8760bc7c => generated 610 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:02.597098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0adae-fbe2-4a65-be70-1b3cc4439fee None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:02.597773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0adae-fbe2-4a65-be70-1b3cc4439fee None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:02.598293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0adae-fbe2-4a65-be70-1b3cc4439fee None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:02.600242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 432/874] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:02.609549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21418f8c-f381-427e-b223-a9679a033f0e None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:02.610110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21418f8c-f381-427e-b223-a9679a033f0e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:02.610474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21418f8c-f381-427e-b223-a9679a033f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:02.638859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-21418f8c-f381-427e-b223-a9679a033f0e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:02.641407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-21418f8c-f381-427e-b223-a9679a033f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:02.705395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c2f51-7f58-445d-8da4-b676e1ece7a2 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:02.706496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c2f51-7f58-445d-8da4-b676e1ece7a2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:02.707233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c2f51-7f58-445d-8da4-b676e1ece7a2 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:02.709062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 433/875] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:02.715186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57909-1fcc-4f8b-96b9-56ea7095263a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:02.715482 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57909-1fcc-4f8b-96b9-56ea7095263a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:02.715820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57909-1fcc-4f8b-96b9-56ea7095263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:02.736823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-7da57909-1fcc-4f8b-96b9-56ea7095263a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:02.738217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-7da57909-1fcc-4f8b-96b9-56ea7095263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:02.771454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 443/876] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:02 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:02.815085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21418f8c-f381-427e-b223-a9679a033f0e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:02.818544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 434/877] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:02 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:02.842427 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57909-1fcc-4f8b-96b9-56ea7095263a None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:02.854070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:02.899284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:02.968514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57909-1fcc-4f8b-96b9-56ea7095263a None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:02.971048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21418f8c-f381-427e-b223-a9679a033f0e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:03.013082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2725d-de8f-4902-8411-321bd6f4deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:03.014178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2725d-de8f-4902-8411-321bd6f4deb6 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:03.014803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2725d-de8f-4902-8411-321bd6f4deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:03.015524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2725d-de8f-4902-8411-321bd6f4deb6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:03.028720 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2725d-de8f-4902-8411-321bd6f4deb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-a8d2725d-de8f-4902-8411-321bd6f4deb6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:40:03.034384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:03.035421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:03.036325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:03.039348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 444/878] 10.222.0.124 () {56 vars in 1125 bytes} [Mon Aug 1 16:40:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:03.048205 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15264da5-6090-440d-9b35-06f1897a9004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:03.048786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2725d-de8f-4902-8411-321bd6f4deb6 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:03.049483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15264da5-6090-440d-9b35-06f1897a9004 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:03.049959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15264da5-6090-440d-9b35-06f1897a9004 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:03.050488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15264da5-6090-440d-9b35-06f1897a9004 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:03.051928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15264da5-6090-440d-9b35-06f1897a9004 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:03.055837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15264da5-6090-440d-9b35-06f1897a9004 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:03.088277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 435/879] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:40:02 2022] POST /identity/v3/services => generated 270 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:40:03.190449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:03.196542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2725d-de8f-4902-8411-321bd6f4deb6 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:03.248999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efc30f-e8ec-4643-a327-4a0f7a208657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:03.249938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc30f-e8ec-4643-a327-4a0f7a208657 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:03.250407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc30f-e8ec-4643-a327-4a0f7a208657 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:03.250830 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc30f-e8ec-4643-a327-4a0f7a208657 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:03.251957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efc30f-e8ec-4643-a327-4a0f7a208657 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:03.252424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efc30f-e8ec-4643-a327-4a0f7a208657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:03.254211 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efc30f-e8ec-4643-a327-4a0f7a208657 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:03.266112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 445/880] 10.222.0.124 () {56 vars in 1120 bytes} [Mon Aug 1 16:40:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:03.279217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15264da5-6090-440d-9b35-06f1897a9004 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:03.379178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e127e-d656-446b-8a21-5c07ab2e8175 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:03.379680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e127e-d656-446b-8a21-5c07ab2e8175 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:03.380156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e127e-d656-446b-8a21-5c07ab2e8175 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:03.384552 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 446/881] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:03 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:03.392853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004a291-dbe7-44bb-8d81-357d7b5da75d None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:03.393431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004a291-dbe7-44bb-8d81-357d7b5da75d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:03.394047 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004a291-dbe7-44bb-8d81-357d7b5da75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:03.420652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:03.436108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-e004a291-dbe7-44bb-8d81-357d7b5da75d None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:03.436855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e004a291-dbe7-44bb-8d81-357d7b5da75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:03.487060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15264da5-6090-440d-9b35-06f1897a9004 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:03.543179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17829f4-5203-44ce-8623-02d950613635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:03.543767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17829f4-5203-44ce-8623-02d950613635 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:03.544086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17829f4-5203-44ce-8623-02d950613635 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:03.544564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17829f4-5203-44ce-8623-02d950613635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:03.549286 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 447/882] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:03 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:03.562802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17829f4-5203-44ce-8623-02d950613635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:03.564418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17829f4-5203-44ce-8623-02d950613635 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:03.571900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004a291-dbe7-44bb-8d81-357d7b5da75d None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-b17829f4-5203-44ce-8623-02d950613635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:03.581888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:03.583042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:03.584828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:03.584828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:03.584828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:03.584828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:03.584828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 436/883] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:03.591956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17829f4-5203-44ce-8623-02d950613635 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:03.728210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:03.746595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004a291-dbe7-44bb-8d81-357d7b5da75d None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:03.779276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17829f4-5203-44ce-8623-02d950613635 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:03.808320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3c752-208e-4dcb-ad37-036b50ce2659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:03.809352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3c752-208e-4dcb-ad37-036b50ce2659 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:03.809642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3c752-208e-4dcb-ad37-036b50ce2659 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:03.809920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3c752-208e-4dcb-ad37-036b50ce2659 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:03.810613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3c752-208e-4dcb-ad37-036b50ce2659 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:03.812207 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3c752-208e-4dcb-ad37-036b50ce2659 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-c5f3c752-208e-4dcb-ad37-036b50ce2659 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:03.822586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:03.823862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:40:03.826102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:03.829660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:03.829864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 448/884] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:40:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:03.830679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3c752-208e-4dcb-ad37-036b50ce2659 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:03.851688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549329f-23bd-4d49-bd43-84cec288aa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:03.852734 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549329f-23bd-4d49-bd43-84cec288aa66 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:03.853242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549329f-23bd-4d49-bd43-84cec288aa66 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:03.853753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549329f-23bd-4d49-bd43-84cec288aa66 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:03.855447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549329f-23bd-4d49-bd43-84cec288aa66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:03.856037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549329f-23bd-4d49-bd43-84cec288aa66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:03.858389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549329f-23bd-4d49-bd43-84cec288aa66 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:03.876426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 437/885] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:03.887276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549329f-23bd-4d49-bd43-84cec288aa66 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:04.040355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3c752-208e-4dcb-ad37-036b50ce2659 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:04.089854 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549329f-23bd-4d49-bd43-84cec288aa66 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:04.107373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f6bde-0a5c-46c9-8881-006f0dec778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:04.108679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f6bde-0a5c-46c9-8881-006f0dec778f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:04.109120 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f6bde-0a5c-46c9-8881-006f0dec778f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:04.109606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f6bde-0a5c-46c9-8881-006f0dec778f None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:04.110913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f6bde-0a5c-46c9-8881-006f0dec778f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:04.111642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f6bde-0a5c-46c9-8881-006f0dec778f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:04.114563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f6bde-0a5c-46c9-8881-006f0dec778f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:04.131526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 449/886] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:40:03 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:04.134274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f6bde-0a5c-46c9-8881-006f0dec778f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:04.160589 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6992105-da90-485f-8a17-067cf5911ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:04.161812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6992105-da90-485f-8a17-067cf5911ea3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:04.162193 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6992105-da90-485f-8a17-067cf5911ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:04.162654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6992105-da90-485f-8a17-067cf5911ea3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:04.165134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:04.176511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6992105-da90-485f-8a17-067cf5911ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:04.178364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6992105-da90-485f-8a17-067cf5911ea3 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-e6992105-da90-485f-8a17-067cf5911ea3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:40:04.193058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:04.194307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:04.195513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:04.195513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:04.195513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:40:04.195513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:40:04.195513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:40:04.195513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:40:04.195513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:40:04.195513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:40:04.195513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:40:04.195513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:04.202789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 438/887] 10.222.0.124 () {56 vars in 1122 bytes} [Mon Aug 1 16:40:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:04.204309 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6992105-da90-485f-8a17-067cf5911ea3 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:04.254372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:04.324563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6992105-da90-485f-8a17-067cf5911ea3 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:04.326571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f6bde-0a5c-46c9-8881-006f0dec778f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:04.367878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e7d3-ed06-47a8-986c-65b3ec015209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:04.368113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f34f11-dd83-4dd1-b156-c1f8e8281abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:04.368430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f34f11-dd83-4dd1-b156-c1f8e8281abc None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:04.368709 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f34f11-dd83-4dd1-b156-c1f8e8281abc None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:04.368980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f34f11-dd83-4dd1-b156-c1f8e8281abc None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:04.369353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e7d3-ed06-47a8-986c-65b3ec015209 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:04.369684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f34f11-dd83-4dd1-b156-c1f8e8281abc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:04.369932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e7d3-ed06-47a8-986c-65b3ec015209 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:04.370038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f34f11-dd83-4dd1-b156-c1f8e8281abc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:04.370425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e7d3-ed06-47a8-986c-65b3ec015209 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:04.371421 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e7d3-ed06-47a8-986c-65b3ec015209 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:04.371580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f34f11-dd83-4dd1-b156-c1f8e8281abc None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:04.372017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e7d3-ed06-47a8-986c-65b3ec015209 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:04.373796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e7d3-ed06-47a8-986c-65b3ec015209 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:04.383010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 450/888] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:40:04 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:04.384187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f34f11-dd83-4dd1-b156-c1f8e8281abc None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:04.402707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 439/889] 10.222.0.124 () {56 vars in 1154 bytes} [Mon Aug 1 16:40:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:04.404479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e7d3-ed06-47a8-986c-65b3ec015209 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:04.492568 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:04.518097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f34f11-dd83-4dd1-b156-c1f8e8281abc None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:04.573684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64bf03-5c63-47c1-8053-c0f6d928c43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:04.575560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bf03-5c63-47c1-8053-c0f6d928c43e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:04.576452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bf03-5c63-47c1-8053-c0f6d928c43e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:04.577389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64bf03-5c63-47c1-8053-c0f6d928c43e None admin] PATH_INFO: `/v3/endpoints` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:04.578221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:04.580507 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64bf03-5c63-47c1-8053-c0f6d928c43e None admin] RBAC: Adding query filter params (interface=public, service_id=43333d4b9ac2442780305013e7cb32ff, region_id=RegionOne) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:04.581904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64bf03-5c63-47c1-8053-c0f6d928c43e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:04.583727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64bf03-5c63-47c1-8053-c0f6d928c43e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:04.584809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e7d3-ed06-47a8-986c-65b3ec015209 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:04.592151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 451/890] 10.222.0.124 () {56 vars in 1256 bytes} [Mon Aug 1 16:40:04 2022] GET /identity/v3/endpoints?service_id=43333d4b9ac2442780305013e7cb32ff&interface=public®ion_id=RegionOne => generated 195 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:04.599671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64bf03-5c63-47c1-8053-c0f6d928c43e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:04.637752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8d9e9-5645-4de4-9997-95f00ec5231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:04.639476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8d9e9-5645-4de4-9997-95f00ec5231e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:04.639946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8d9e9-5645-4de4-9997-95f00ec5231e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:04.640390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8d9e9-5645-4de4-9997-95f00ec5231e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:04.730065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8d9e9-5645-4de4-9997-95f00ec5231e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:04.731959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8d9e9-5645-4de4-9997-95f00ec5231e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:04.779397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64bf03-5c63-47c1-8053-c0f6d928c43e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:04.850139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bf988-0d89-4df2-8a2b-1bdf7fd22694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:04.851145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf988-0d89-4df2-8a2b-1bdf7fd22694 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:04.851646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf988-0d89-4df2-8a2b-1bdf7fd22694 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:04.852121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf988-0d89-4df2-8a2b-1bdf7fd22694 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:04.853167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bf988-0d89-4df2-8a2b-1bdf7fd22694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:04.855275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bf988-0d89-4df2-8a2b-1bdf7fd22694 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:04.870984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:04.871555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 452/891] 10.222.0.124 () {56 vars in 1092 bytes} [Mon Aug 1 16:40:04 2022] GET /identity/v3/services => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:40:04.881304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 440/892] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:40:04 2022] GET /identity/v3/auth/tokens => generated 1364 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:40:04.891358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8d9e9-5645-4de4-9997-95f00ec5231e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:04.891544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decb428-a943-4247-a041-f55e7cf4e0e4 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:04.891969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decb428-a943-4247-a041-f55e7cf4e0e4 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:04.892455 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decb428-a943-4247-a041-f55e7cf4e0e4 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:04.895189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 453/893] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:04 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:04.904831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1e061-33b5-49fd-9fa3-64630cc339e9 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:04.905378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1e061-33b5-49fd-9fa3-64630cc339e9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:04.905866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1e061-33b5-49fd-9fa3-64630cc339e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:04.938396 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ced1e061-33b5-49fd-9fa3-64630cc339e9 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:04.940739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ced1e061-33b5-49fd-9fa3-64630cc339e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:04.944912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:05.087074 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 454/894] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:04 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:05.106910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8d9e9-5645-4de4-9997-95f00ec5231e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:05.127293 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1e061-33b5-49fd-9fa3-64630cc339e9 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:05.184125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3d968-2bba-403f-9866-bf358041430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:05.185168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d968-2bba-403f-9866-bf358041430b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:05.185665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d968-2bba-403f-9866-bf358041430b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:05.186145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d968-2bba-403f-9866-bf358041430b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:05.207596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3d968-2bba-403f-9866-bf358041430b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:05.210432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3d968-2bba-403f-9866-bf358041430b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-38a3d968-2bba-403f-9866-bf358041430b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:05.245754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:05.246821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:05.247802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:05.247802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:05.247802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:05.247802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:05.255190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 441/895] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:05.259366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3d968-2bba-403f-9866-bf358041430b None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:05.341565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1e061-33b5-49fd-9fa3-64630cc339e9 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:05.366023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:05.416218 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aa160-3d0c-479b-b8c2-316934e4954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:05.417775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa160-3d0c-479b-b8c2-316934e4954e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:05.418260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa160-3d0c-479b-b8c2-316934e4954e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:05.420384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa160-3d0c-479b-b8c2-316934e4954e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:05.422701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aa160-3d0c-479b-b8c2-316934e4954e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:05.426218 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aa160-3d0c-479b-b8c2-316934e4954e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-076aa160-3d0c-479b-b8c2-316934e4954e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:05.455675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:05.457303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:05.458131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:05.462977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 455/896] 10.222.0.124 () {56 vars in 1131 bytes} [Mon Aug 1 16:40:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:05.463261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3d968-2bba-403f-9866-bf358041430b None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:05.466347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aa160-3d0c-479b-b8c2-316934e4954e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:05.469446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:05.530674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bf188-0f08-4a0e-8000-6645c069974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:05.532696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bf188-0f08-4a0e-8000-6645c069974c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:05.533186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bf188-0f08-4a0e-8000-6645c069974c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:05.534059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bf188-0f08-4a0e-8000-6645c069974c None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:05.535808 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bf188-0f08-4a0e-8000-6645c069974c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:05.536579 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bf188-0f08-4a0e-8000-6645c069974c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:05.539583 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bf188-0f08-4a0e-8000-6645c069974c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:05.574176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 442/897] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:05.582198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bf188-0f08-4a0e-8000-6645c069974c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:05.608799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aa160-3d0c-479b-b8c2-316934e4954e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:05.646968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b2e5f-a336-4c2e-afca-975423756dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:05.647695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b2e5f-a336-4c2e-afca-975423756dc1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:05.647973 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b2e5f-a336-4c2e-afca-975423756dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:05.648248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b2e5f-a336-4c2e-afca-975423756dc1 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:05.648937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b2e5f-a336-4c2e-afca-975423756dc1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:05.649244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b2e5f-a336-4c2e-afca-975423756dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:05.650652 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b2e5f-a336-4c2e-afca-975423756dc1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:05.657018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 456/898] 10.222.0.124 () {56 vars in 1127 bytes} [Mon Aug 1 16:40:05 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:05.661497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbff3e7-63d7-4b3c-86e4-e5a876a1310f None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:05.662283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbff3e7-63d7-4b3c-86e4-e5a876a1310f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:05.662563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbff3e7-63d7-4b3c-86e4-e5a876a1310f None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:05.664228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 457/899] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:05 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:05.668372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbff3e7-63d7-4b3c-86e4-e5a876a1310f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:05.755311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bf188-0f08-4a0e-8000-6645c069974c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:05.768702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:05.769263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:05.814491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861ef7f-7670-4bbd-9ce6-885264ae093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:05.815181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861ef7f-7670-4bbd-9ce6-885264ae093d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:05.815454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861ef7f-7670-4bbd-9ce6-885264ae093d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:05.815728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861ef7f-7670-4bbd-9ce6-885264ae093d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:05.816010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbff3e7-63d7-4b3c-86e4-e5a876a1310f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:05.825121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861ef7f-7670-4bbd-9ce6-885264ae093d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:05.826610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861ef7f-7670-4bbd-9ce6-885264ae093d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-f861ef7f-7670-4bbd-9ce6-885264ae093d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:40:05.845274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:05.846257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:05.847191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:40:05.847191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:40:05.847191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:40:05.847191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:40:05.847191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:40:05.847191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:40:05.847191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:05.847191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:05.850717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 443/900] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:05.852432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f93f-73a8-4823-b05b-6b7e0c2bfd61 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:05.854263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f93f-73a8-4823-b05b-6b7e0c2bfd61 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:05.855386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f93f-73a8-4823-b05b-6b7e0c2bfd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:05.868852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4436541-1d77-40ac-9407-7433811d2864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:05.869492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436541-1d77-40ac-9407-7433811d2864 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:05.869765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436541-1d77-40ac-9407-7433811d2864 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:05.870711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436541-1d77-40ac-9407-7433811d2864 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:05.870711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4436541-1d77-40ac-9407-7433811d2864 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:05.871062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4436541-1d77-40ac-9407-7433811d2864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:05.872545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4436541-1d77-40ac-9407-7433811d2864 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:05.877865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-0810f93f-73a8-4823-b05b-6b7e0c2bfd61 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:05.887789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 458/901] 10.222.0.124 () {56 vars in 1127 bytes} [Mon Aug 1 16:40:05 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:05.887979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0810f93f-73a8-4823-b05b-6b7e0c2bfd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:05.888116 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4436541-1d77-40ac-9407-7433811d2864 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:05.974984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 444/902] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:05 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:05.998525 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810f93f-73a8-4823-b05b-6b7e0c2bfd61 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:06.032580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4436541-1d77-40ac-9407-7433811d2864 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:06.081690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:06.098843 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a525f90-f5aa-4561-8e97-a25eda45b725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:06.099585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525f90-f5aa-4561-8e97-a25eda45b725 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:06.100049 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525f90-f5aa-4561-8e97-a25eda45b725 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:06.100337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525f90-f5aa-4561-8e97-a25eda45b725 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:06.101168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a525f90-f5aa-4561-8e97-a25eda45b725 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:06.101487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a525f90-f5aa-4561-8e97-a25eda45b725 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:06.103245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a525f90-f5aa-4561-8e97-a25eda45b725 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:06.131088 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 459/903] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:06.135460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a525f90-f5aa-4561-8e97-a25eda45b725 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:06.144951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:06.148265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810f93f-73a8-4823-b05b-6b7e0c2bfd61 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:06.200106 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b4590-da29-41f3-971d-530c868d4cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:06.200807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4590-da29-41f3-971d-530c868d4cb7 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:06.201451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4590-da29-41f3-971d-530c868d4cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:06.201786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b4590-da29-41f3-971d-530c868d4cb7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:06.202648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b4590-da29-41f3-971d-530c868d4cb7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:06.205231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b4590-da29-41f3-971d-530c868d4cb7 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-703b4590-da29-41f3-971d-530c868d4cb7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:06.217884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:06.218901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:06.219841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 445/904] 10.222.0.124 () {56 vars in 1137 bytes} [Mon Aug 1 16:40:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:06.228133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b4590-da29-41f3-971d-530c868d4cb7 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:06.335841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a525f90-f5aa-4561-8e97-a25eda45b725 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:06.406732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a972e-80b7-4c29-bc19-bfff912bc1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:06.407864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a972e-80b7-4c29-bc19-bfff912bc1ab None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:06.408466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a972e-80b7-4c29-bc19-bfff912bc1ab None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:06.408945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a972e-80b7-4c29-bc19-bfff912bc1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:06.410613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a972e-80b7-4c29-bc19-bfff912bc1ab None admin] RBAC: Adding query filter params (role.id=e30f4d3046084825ac1b052687c77151, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=c5e98d3e170a4e95bc03daf2a950e5f6) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:06.411222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a972e-80b7-4c29-bc19-bfff912bc1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:06.414123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a972e-80b7-4c29-bc19-bfff912bc1ab None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:06.422548 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b4590-da29-41f3-971d-530c868d4cb7 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:06.431699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 460/905] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:40:06 2022] GET /identity/v3/role_assignments?user.id=c5e98d3e170a4e95bc03daf2a950e5f6&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=e30f4d3046084825ac1b052687c77151 => generated 260 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:06.505015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df286a-c5db-40a1-bb45-bf525ccd8b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:06.506110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df286a-c5db-40a1-bb45-bf525ccd8b3d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:06.506617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df286a-c5db-40a1-bb45-bf525ccd8b3d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:06.507204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df286a-c5db-40a1-bb45-bf525ccd8b3d None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:06.508589 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df286a-c5db-40a1-bb45-bf525ccd8b3d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:06.509592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df286a-c5db-40a1-bb45-bf525ccd8b3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:06.511866 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df286a-c5db-40a1-bb45-bf525ccd8b3d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:06.522644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 446/906] 10.222.0.124 () {56 vars in 1131 bytes} [Mon Aug 1 16:40:06 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:06.533143 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a972e-80b7-4c29-bc19-bfff912bc1ab None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:06.658272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:06.754261 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a972e-80b7-4c29-bc19-bfff912bc1ab None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:06.824981 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdc122-d77c-4a29-9b64-f0b5ee49bcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:06.826070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdc122-d77c-4a29-9b64-f0b5ee49bcc1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:06.826558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdc122-d77c-4a29-9b64-f0b5ee49bcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:06.827110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdc122-d77c-4a29-9b64-f0b5ee49bcc1 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:06.828376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdc122-d77c-4a29-9b64-f0b5ee49bcc1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:06.828918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdc122-d77c-4a29-9b64-f0b5ee49bcc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:06.832030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdc122-d77c-4a29-9b64-f0b5ee49bcc1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:06.842790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 461/907] 10.222.0.124 () {56 vars in 1131 bytes} [Mon Aug 1 16:40:06 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:06.851013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df286a-c5db-40a1-bb45-bf525ccd8b3d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:06.923473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:07.054715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df286a-c5db-40a1-bb45-bf525ccd8b3d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:07.123413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf55796-4585-4510-a0a6-f0725c0ded69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:07.124662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf55796-4585-4510-a0a6-f0725c0ded69 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:07.125162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf55796-4585-4510-a0a6-f0725c0ded69 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:07.125665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf55796-4585-4510-a0a6-f0725c0ded69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:07.127170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf55796-4585-4510-a0a6-f0725c0ded69 None admin] RBAC: Adding query filter params (interface=public, service_id=4d2e1fc531334f589f93db133312db77, region_id=RegionOne) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:07.127723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf55796-4585-4510-a0a6-f0725c0ded69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:07.130447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf55796-4585-4510-a0a6-f0725c0ded69 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:07.140958 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 447/908] 10.222.0.124 () {56 vars in 1256 bytes} [Mon Aug 1 16:40:06 2022] GET /identity/v3/endpoints?service_id=4d2e1fc531334f589f93db133312db77&interface=public®ion_id=RegionOne => generated 195 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:07.150296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdc122-d77c-4a29-9b64-f0b5ee49bcc1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:07.305330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fb078-3a2c-4cc2-9d7a-72e60b509bcb None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:07.305723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fb078-3a2c-4cc2-9d7a-72e60b509bcb None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:07.305884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fb078-3a2c-4cc2-9d7a-72e60b509bcb None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:07.307621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 448/909] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:07.313777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de3a61-8a81-4fe7-9e6e-b1d764f4e9c9 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:07.314246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de3a61-8a81-4fe7-9e6e-b1d764f4e9c9 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:07.314440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de3a61-8a81-4fe7-9e6e-b1d764f4e9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:07.335326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-73de3a61-8a81-4fe7-9e6e-b1d764f4e9c9 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:07.336672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-73de3a61-8a81-4fe7-9e6e-b1d764f4e9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:07.356458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdc122-d77c-4a29-9b64-f0b5ee49bcc1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:07.387176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:07.416189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 449/910] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:07 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:07.423412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3e667-a526-4c43-9799-5e24d5244695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:07.424511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3e667-a526-4c43-9799-5e24d5244695 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:07.425001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3e667-a526-4c43-9799-5e24d5244695 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:07.425462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3e667-a526-4c43-9799-5e24d5244695 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:07.426778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3e667-a526-4c43-9799-5e24d5244695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:07.429307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3e667-a526-4c43-9799-5e24d5244695 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:07.440644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de3a61-8a81-4fe7-9e6e-b1d764f4e9c9 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:07.443225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 462/911] 10.222.0.124 () {56 vars in 1092 bytes} [Mon Aug 1 16:40:07 2022] GET /identity/v3/services => generated 1274 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:40:07.493464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:07.655656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de3a61-8a81-4fe7-9e6e-b1d764f4e9c9 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:07.702701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9021743-67c1-4220-b4ba-427ff40a622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:07.703867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9021743-67c1-4220-b4ba-427ff40a622c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:07.704357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9021743-67c1-4220-b4ba-427ff40a622c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:07.704841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9021743-67c1-4220-b4ba-427ff40a622c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:07.705746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9021743-67c1-4220-b4ba-427ff40a622c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:07.707792 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9021743-67c1-4220-b4ba-427ff40a622c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-d9021743-67c1-4220-b4ba-427ff40a622c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:07.718394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:07.719503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:40:07.720323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:07.723528 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 450/912] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:40:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:07.731361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3e667-a526-4c43-9799-5e24d5244695 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:07.877650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3e667-a526-4c43-9799-5e24d5244695 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:07.917856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbe464-3331-469d-ac56-fb070c4aec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:07.918427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbe464-3331-469d-ac56-fb070c4aec08 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:07.918703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbe464-3331-469d-ac56-fb070c4aec08 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:07.918996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbe464-3331-469d-ac56-fb070c4aec08 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:07.919721 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbe464-3331-469d-ac56-fb070c4aec08 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:07.920025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbe464-3331-469d-ac56-fb070c4aec08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:07.921789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbe464-3331-469d-ac56-fb070c4aec08 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:07.928037 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 463/913] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:40:07 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:07.933796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9021743-67c1-4220-b4ba-427ff40a622c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:08.032924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:08.050601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9021743-67c1-4220-b4ba-427ff40a622c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:08.092689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645fc13-d865-469f-a767-bf49bb32d662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:08.093346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645fc13-d865-469f-a767-bf49bb32d662 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:08.093680 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645fc13-d865-469f-a767-bf49bb32d662 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:08.093900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645fc13-d865-469f-a767-bf49bb32d662 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:08.094628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645fc13-d865-469f-a767-bf49bb32d662 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:08.094934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645fc13-d865-469f-a767-bf49bb32d662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:08.096537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645fc13-d865-469f-a767-bf49bb32d662 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:08.107095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 451/914] 10.222.0.124 () {56 vars in 1119 bytes} [Mon Aug 1 16:40:07 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:08.109609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbe464-3331-469d-ac56-fb070c4aec08 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:08.205877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:08.327043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbe464-3331-469d-ac56-fb070c4aec08 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:08.383649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceb4a2-8744-40a0-92bb-e760a362cdaf None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:08.384020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceb4a2-8744-40a0-92bb-e760a362cdaf None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:08.384206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceb4a2-8744-40a0-92bb-e760a362cdaf None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:08.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 452/915] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:40:08.392532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1abcf-d335-42b1-8fdc-997a3a03f1ef None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:08.392975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1abcf-d335-42b1-8fdc-997a3a03f1ef None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:08.393429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1abcf-d335-42b1-8fdc-997a3a03f1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:08.400467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30920-7203-49be-8d11-d246d7f2e988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:08.401460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30920-7203-49be-8d11-d246d7f2e988 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:08.401954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30920-7203-49be-8d11-d246d7f2e988 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:08.402393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30920-7203-49be-8d11-d246d7f2e988 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:08.403631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30920-7203-49be-8d11-d246d7f2e988 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:08.408457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30920-7203-49be-8d11-d246d7f2e988 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:08.424889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e0c1abcf-d335-42b1-8fdc-997a3a03f1ef None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:08.427035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e0c1abcf-d335-42b1-8fdc-997a3a03f1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:08.455110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 464/916] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:40:08 2022] POST /identity/v3/endpoints => generated 348 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:40:08.587038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 453/917] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:08 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:08.622657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30920-7203-49be-8d11-d246d7f2e988 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:08.661284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b20fa-b23f-46d0-8805-862b20a79702 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:08.661718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b20fa-b23f-46d0-8805-862b20a79702 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:08.662144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b20fa-b23f-46d0-8805-862b20a79702 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:08.665110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 454/918] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:08 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:40:08.674144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907ab03-6662-41a5-9d7a-a5fc1ecaba86 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:08.674910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907ab03-6662-41a5-9d7a-a5fc1ecaba86 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:08.675702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907ab03-6662-41a5-9d7a-a5fc1ecaba86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:08.706905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-5907ab03-6662-41a5-9d7a-a5fc1ecaba86 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:08.708958 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-5907ab03-6662-41a5-9d7a-a5fc1ecaba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:08.785996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30920-7203-49be-8d11-d246d7f2e988 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:08.790119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:08.836878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253de56-134f-4f3e-b03a-3ced4d3a95bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:08.837529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253de56-134f-4f3e-b03a-3ced4d3a95bf None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:08.838256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253de56-134f-4f3e-b03a-3ced4d3a95bf None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:08.838545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253de56-134f-4f3e-b03a-3ced4d3a95bf None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:08.839602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253de56-134f-4f3e-b03a-3ced4d3a95bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:08.841067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253de56-134f-4f3e-b03a-3ced4d3a95bf None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:08.851056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 455/919] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:08 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:08.864052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 465/920] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:40:08 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:40:08.883631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907ab03-6662-41a5-9d7a-a5fc1ecaba86 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:08.897568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:09.015757 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907ab03-6662-41a5-9d7a-a5fc1ecaba86 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:09.067238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd069dd-2559-4d84-8dc3-0e1474035aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:09.067843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd069dd-2559-4d84-8dc3-0e1474035aaa None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:09.068127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd069dd-2559-4d84-8dc3-0e1474035aaa None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:09.068509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd069dd-2559-4d84-8dc3-0e1474035aaa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:09.082257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd069dd-2559-4d84-8dc3-0e1474035aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-cfd069dd-2559-4d84-8dc3-0e1474035aaa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:40:09.087605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:09.088652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:09.089509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 456/921] 10.222.0.124 () {56 vars in 1125 bytes} [Mon Aug 1 16:40:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:09.095779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253de56-134f-4f3e-b03a-3ced4d3a95bf None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:09.239353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253de56-134f-4f3e-b03a-3ced4d3a95bf None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:09.304841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a72b6-0cf7-4e22-bc69-3dc8a6adf2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:09.305927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a72b6-0cf7-4e22-bc69-3dc8a6adf2d8 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:09.306409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a72b6-0cf7-4e22-bc69-3dc8a6adf2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:09.306887 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a72b6-0cf7-4e22-bc69-3dc8a6adf2d8 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:09.308245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a72b6-0cf7-4e22-bc69-3dc8a6adf2d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:09.308778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a72b6-0cf7-4e22-bc69-3dc8a6adf2d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:09.312202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a72b6-0cf7-4e22-bc69-3dc8a6adf2d8 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:09.329604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 466/922] 10.222.0.124 () {56 vars in 1120 bytes} [Mon Aug 1 16:40:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:09.335265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd069dd-2559-4d84-8dc3-0e1474035aaa None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:09.411135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:09.459690 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd069dd-2559-4d84-8dc3-0e1474035aaa None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:09.502708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9d46c-5862-484f-a201-4a570f57eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:09.503424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d46c-5862-484f-a201-4a570f57eaa7 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:09.503707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d46c-5862-484f-a201-4a570f57eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:09.503991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d46c-5862-484f-a201-4a570f57eaa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:09.516633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9d46c-5862-484f-a201-4a570f57eaa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:09.518135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9d46c-5862-484f-a201-4a570f57eaa7 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-e3e9d46c-5862-484f-a201-4a570f57eaa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:09.535623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:09.537304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:09.539010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:09.539010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:09.539010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:09.539010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:09.539010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 457/923] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:09.544421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a72b6-0cf7-4e22-bc69-3dc8a6adf2d8 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:09.596540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:09.748493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a72b6-0cf7-4e22-bc69-3dc8a6adf2d8 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:09.815466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4132265-6e24-4bbd-b563-c389ef5dce27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:09.817017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4132265-6e24-4bbd-b563-c389ef5dce27 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:09.817847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4132265-6e24-4bbd-b563-c389ef5dce27 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:09.818595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4132265-6e24-4bbd-b563-c389ef5dce27 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:09.820257 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4132265-6e24-4bbd-b563-c389ef5dce27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:09.821109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4132265-6e24-4bbd-b563-c389ef5dce27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:09.824076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4132265-6e24-4bbd-b563-c389ef5dce27 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:09.848802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 467/924] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:09.854079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9d46c-5862-484f-a201-4a570f57eaa7 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:09.923152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb531aa-2bd1-4366-9423-19e1b976d38c None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:09.923613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb531aa-2bd1-4366-9423-19e1b976d38c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:09.924110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb531aa-2bd1-4366-9423-19e1b976d38c None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:09.927121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 468/925] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:09 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:09.933186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aaf76-99fe-4cb0-80cf-dac5bf10ae81 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:09.933594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aaf76-99fe-4cb0-80cf-dac5bf10ae81 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:09.933842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aaf76-99fe-4cb0-80cf-dac5bf10ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:09.964263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-f26aaf76-99fe-4cb0-80cf-dac5bf10ae81 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:09.966313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f26aaf76-99fe-4cb0-80cf-dac5bf10ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:09.986734 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9d46c-5862-484f-a201-4a570f57eaa7 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:10.014967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:10.057700 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091b74b-b123-41fe-b662-268450341b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:10.058805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091b74b-b123-41fe-b662-268450341b93 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:10.059344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091b74b-b123-41fe-b662-268450341b93 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:10.059810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091b74b-b123-41fe-b662-268450341b93 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:10.076109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091b74b-b123-41fe-b662-268450341b93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:10.079817 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091b74b-b123-41fe-b662-268450341b93 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:10.095838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 469/926] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:09 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-4091b74b-b123-41fe-b662-268450341b93 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:40:10.102383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:10.103430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:10.104376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:10.104376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:10.104376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:40:10.104376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:40:10.104376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:40:10.104376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:40:10.104376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:40:10.104376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:40:10.104376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:40:10.104376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:10.104908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 458/927] 10.222.0.124 () {56 vars in 1122 bytes} [Mon Aug 1 16:40:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:10.112346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aaf76-99fe-4cb0-80cf-dac5bf10ae81 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:10.133535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091b74b-b123-41fe-b662-268450341b93 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:10.151557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:10.278789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aaf76-99fe-4cb0-80cf-dac5bf10ae81 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:10.316988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091b74b-b123-41fe-b662-268450341b93 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:10.360151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0be358-0745-4677-854e-cb7797adc1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:10.361356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0be358-0745-4677-854e-cb7797adc1fd None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:10.361841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0be358-0745-4677-854e-cb7797adc1fd None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:10.362356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0be358-0745-4677-854e-cb7797adc1fd None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:10.364910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0be358-0745-4677-854e-cb7797adc1fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:10.365173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0be358-0745-4677-854e-cb7797adc1fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:10.368957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0be358-0745-4677-854e-cb7797adc1fd None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:10.379671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105c6a7-4545-4911-8b2e-20bf2dff2c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:10.380800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105c6a7-4545-4911-8b2e-20bf2dff2c5c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:10.381289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105c6a7-4545-4911-8b2e-20bf2dff2c5c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:10.381770 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105c6a7-4545-4911-8b2e-20bf2dff2c5c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:10.383723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105c6a7-4545-4911-8b2e-20bf2dff2c5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:10.385433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105c6a7-4545-4911-8b2e-20bf2dff2c5c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-2105c6a7-4545-4911-8b2e-20bf2dff2c5c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:10.397554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:10.398591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:40:10.399504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:10.402847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 459/928] 10.222.0.124 () {56 vars in 1137 bytes} [Mon Aug 1 16:40:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:10.411117 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 470/929] 10.222.0.124 () {56 vars in 1154 bytes} [Mon Aug 1 16:40:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:10.411404 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105c6a7-4545-4911-8b2e-20bf2dff2c5c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:10.413504 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0be358-0745-4677-854e-cb7797adc1fd None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:10.485094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:10.554483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:10.613441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105c6a7-4545-4911-8b2e-20bf2dff2c5c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:10.622039 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0be358-0745-4677-854e-cb7797adc1fd None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:10.676400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d955ce-c660-4d01-8f6a-c2bca72cb3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:10.677645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d955ce-c660-4d01-8f6a-c2bca72cb3a9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:10.678226 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d955ce-c660-4d01-8f6a-c2bca72cb3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:10.678772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d955ce-c660-4d01-8f6a-c2bca72cb3a9 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:10.680120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d955ce-c660-4d01-8f6a-c2bca72cb3a9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:10.680759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d955ce-c660-4d01-8f6a-c2bca72cb3a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:10.683738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d955ce-c660-4d01-8f6a-c2bca72cb3a9 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:10.693828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 460/930] 10.222.0.124 () {56 vars in 1131 bytes} [Mon Aug 1 16:40:10 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:10.699690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81300-2ca4-4509-b004-0d63d26b59ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:10.700321 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d955ce-c660-4d01-8f6a-c2bca72cb3a9 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:10.701487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81300-2ca4-4509-b004-0d63d26b59ef None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:10.702200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81300-2ca4-4509-b004-0d63d26b59ef None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:10.702904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81300-2ca4-4509-b004-0d63d26b59ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:10.726107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b81300-2ca4-4509-b004-0d63d26b59ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:10.729291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b81300-2ca4-4509-b004-0d63d26b59ef None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-62b81300-2ca4-4509-b004-0d63d26b59ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:10.762497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:10.764493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:10.766390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:10.766390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:10.766390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:10.766390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:10.775789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 471/931] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:10.782297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81300-2ca4-4509-b004-0d63d26b59ef None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:10.906371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d955ce-c660-4d01-8f6a-c2bca72cb3a9 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:10.908954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:10.973599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc206d-48e2-4fc3-bc27-05fded824f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:10.974755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc206d-48e2-4fc3-bc27-05fded824f8d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:10.975726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc206d-48e2-4fc3-bc27-05fded824f8d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:10.975847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc206d-48e2-4fc3-bc27-05fded824f8d None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:10.977087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc206d-48e2-4fc3-bc27-05fded824f8d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:10.977739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc206d-48e2-4fc3-bc27-05fded824f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:10.980776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc206d-48e2-4fc3-bc27-05fded824f8d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:10.990567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 461/932] 10.222.0.124 () {56 vars in 1131 bytes} [Mon Aug 1 16:40:10 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:10.992459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81300-2ca4-4509-b004-0d63d26b59ef None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:10.997025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc206d-48e2-4fc3-bc27-05fded824f8d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:11.030850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:11.051413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc7bce-cb71-4f4a-b699-c3557a431105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:11.052446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7bce-cb71-4f4a-b699-c3557a431105 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:11.052907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7bce-cb71-4f4a-b699-c3557a431105 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:11.053356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7bce-cb71-4f4a-b699-c3557a431105 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:11.054272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc7bce-cb71-4f4a-b699-c3557a431105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:11.054765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc7bce-cb71-4f4a-b699-c3557a431105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:11.056469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc7bce-cb71-4f4a-b699-c3557a431105 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:11.079338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 472/933] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:11.082518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc7bce-cb71-4f4a-b699-c3557a431105 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:11.252347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc206d-48e2-4fc3-bc27-05fded824f8d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:11.293700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc7bce-cb71-4f4a-b699-c3557a431105 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:11.313603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a309364-db96-4705-8af9-ff44ee810f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:11.314700 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a309364-db96-4705-8af9-ff44ee810f59 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:11.314997 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a309364-db96-4705-8af9-ff44ee810f59 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:11.315391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a309364-db96-4705-8af9-ff44ee810f59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:11.317784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a309364-db96-4705-8af9-ff44ee810f59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:11.319370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a309364-db96-4705-8af9-ff44ee810f59 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:11.344749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b7af0-f871-42fd-b5d5-8c0ee893d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:11.345629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b7af0-f871-42fd-b5d5-8c0ee893d948 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:11.345883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b7af0-f871-42fd-b5d5-8c0ee893d948 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:11.346132 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b7af0-f871-42fd-b5d5-8c0ee893d948 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:11.353772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 462/934] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:40:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:40:11.355440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b7af0-f871-42fd-b5d5-8c0ee893d948 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:11.357041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b7af0-f871-42fd-b5d5-8c0ee893d948 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:11.363004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97f04-d86f-43f3-a50a-8dfc9fbbfa41 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:11.364094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97f04-d86f-43f3-a50a-8dfc9fbbfa41 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:11.365409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97f04-d86f-43f3-a50a-8dfc9fbbfa41 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:11.369642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 463/935] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:11 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-c40b7af0-f871-42fd-b5d5-8c0ee893d948 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:40:11.375184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:11.376770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:11.378059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:40:11.378059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:40:11.378059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:40:11.378059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:40:11.378059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:40:11.378059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:40:11.378059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:11.378059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:11.378059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 473/936] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:11.383092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd4941-1c36-41ae-a844-42635e4113c7 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:11.383092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd4941-1c36-41ae-a844-42635e4113c7 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:11.383613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd4941-1c36-41ae-a844-42635e4113c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:11.385977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b7af0-f871-42fd-b5d5-8c0ee893d948 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:11.421598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-24bd4941-1c36-41ae-a844-42635e4113c7 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:11.423373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-24bd4941-1c36-41ae-a844-42635e4113c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:11.450154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:11.503474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:11.550430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 464/937] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:11 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:11.570539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd4941-1c36-41ae-a844-42635e4113c7 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:11.649831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b7af0-f871-42fd-b5d5-8c0ee893d948 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:11.709558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abdda3-57ec-4807-a139-ee95fc673dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:11.710427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdda3-57ec-4807-a139-ee95fc673dc5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:11.710853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdda3-57ec-4807-a139-ee95fc673dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:11.711300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abdda3-57ec-4807-a139-ee95fc673dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:11.712644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abdda3-57ec-4807-a139-ee95fc673dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:11.713154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abdda3-57ec-4807-a139-ee95fc673dc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:11.716109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abdda3-57ec-4807-a139-ee95fc673dc5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:11.740719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 474/938] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:11.753591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abdda3-57ec-4807-a139-ee95fc673dc5 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:11.797043 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd4941-1c36-41ae-a844-42635e4113c7 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:11.851184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d29c8-0c35-498f-838d-06c52ddb8f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:11.852102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d29c8-0c35-498f-838d-06c52ddb8f39 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:11.852556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d29c8-0c35-498f-838d-06c52ddb8f39 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:11.852971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d29c8-0c35-498f-838d-06c52ddb8f39 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:11.854560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d29c8-0c35-498f-838d-06c52ddb8f39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:11.857024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d29c8-0c35-498f-838d-06c52ddb8f39 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:11.861020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: WARNING keystone.server.flask.common [None req-cc8d29c8-0c35-498f-838d-06c52ddb8f39 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 01 16:40:11.893366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.sql.core [None req-cc8d29c8-0c35-498f-838d-06c52ddb8f39 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 16:40:11.893366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 16:40:11.893366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [parameters: {'id': '9c82224e2fdf4b1c96abfa5b8e14ee4a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 16:40:11.893366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92121) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-cc8d29c8-0c35-498f-838d-06c52ddb8f39 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9c82224e2fdf4b1c96abfa5b8e14ee4a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9c82224e2fdf4b1c96abfa5b8e14ee4a. Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:40:11.917198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result.read() Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 01 16:40:11.919003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application yield resource Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise self.value Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application session.commit() Aug 01 16:40:11.920959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.session.flush() Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application compat.raise_( Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 16:40:11.923243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 16:40:11.924621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result.read() Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:40:11.926470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [parameters: {'id': '9c82224e2fdf4b1c96abfa5b8e14ee4a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:11.929890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:11.932420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:11.936034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:11.936034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 01 16:40:11.936034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 01 16:40:11.936034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:11.936034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:11.936034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 01 16:40:11.936034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 01 16:40:11.936034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9c82224e2fdf4b1c96abfa5b8e14ee4a. Aug 01 16:40:11.936034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:11.938082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 465/939] 10.222.0.124 () {60 vars in 1145 bytes} [Mon Aug 1 16:40:11 2022] POST /identity/v3/projects => generated 262 bytes in 368 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:11.944314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d29c8-0c35-498f-838d-06c52ddb8f39 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:11.966797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abdda3-57ec-4807-a139-ee95fc673dc5 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:11.967694 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:11.972805 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:12.049661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d96a-5eb2-4059-b93e-f86fbedd5eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:12.052349 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d96a-5eb2-4059-b93e-f86fbedd5eef None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:12.053205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d96a-5eb2-4059-b93e-f86fbedd5eef None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:12.053882 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d96a-5eb2-4059-b93e-f86fbedd5eef None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/c5e98d3e170a4e95bc03daf2a950e5f6/roles/e30f4d3046084825ac1b052687c77151` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:12.059692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0d96a-5eb2-4059-b93e-f86fbedd5eef None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=c5e98d3e170a4e95bc03daf2a950e5f6, role_id=e30f4d3046084825ac1b052687c77151)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:12.062578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0d96a-5eb2-4059-b93e-f86fbedd5eef None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:12.089047 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 475/940] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:40:11 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/c5e98d3e170a4e95bc03daf2a950e5f6/roles/e30f4d3046084825ac1b052687c77151 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:40:12.191080 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d29c8-0c35-498f-838d-06c52ddb8f39 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:12.253348 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5310b-6ceb-4eb8-862e-f081530fa284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:12.255936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5310b-6ceb-4eb8-862e-f081530fa284 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:12.256732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5310b-6ceb-4eb8-862e-f081530fa284 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:12.257545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5310b-6ceb-4eb8-862e-f081530fa284 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:12.268353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5310b-6ceb-4eb8-862e-f081530fa284 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:12.271018 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5310b-6ceb-4eb8-862e-f081530fa284 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-aae5310b-6ceb-4eb8-862e-f081530fa284 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:40:12.287773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:12.289108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:12.289995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:40:12.289995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:40:12.289995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:40:12.289995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:40:12.289995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:40:12.289995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:40:12.289995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:12.289995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:12.293479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 466/941] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:12.302491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d96a-5eb2-4059-b93e-f86fbedd5eef None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:12.395474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485d2f2-0f2d-4b79-b06b-7ed6f888ee24 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:12.395988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485d2f2-0f2d-4b79-b06b-7ed6f888ee24 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:12.396470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485d2f2-0f2d-4b79-b06b-7ed6f888ee24 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:12.408066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 467/942] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:12 2022] GET /identity => generated 271 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:12.415177 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7168d-b43d-48ec-9807-3e71a4dd19d2 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:12.415509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7168d-b43d-48ec-9807-3e71a4dd19d2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:12.415731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7168d-b43d-48ec-9807-3e71a4dd19d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:12.440308 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-fac7168d-b43d-48ec-9807-3e71a4dd19d2 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:12.442829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fac7168d-b43d-48ec-9807-3e71a4dd19d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:12.558863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d96a-5eb2-4059-b93e-f86fbedd5eef None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:12.560092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:12.577671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 468/943] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:12 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:12.614530 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7168d-b43d-48ec-9807-3e71a4dd19d2 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:12.637595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc2d9-0f1b-4255-98a9-4bf4a45e5d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:12.639011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc2d9-0f1b-4255-98a9-4bf4a45e5d67 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:12.639694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc2d9-0f1b-4255-98a9-4bf4a45e5d67 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:12.640160 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc2d9-0f1b-4255-98a9-4bf4a45e5d67 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:12.641422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cc2d9-0f1b-4255-98a9-4bf4a45e5d67 None admin] RBAC: Adding query filter params (name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:12.641943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cc2d9-0f1b-4255-98a9-4bf4a45e5d67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:12.644746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cc2d9-0f1b-4255-98a9-4bf4a45e5d67 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:12.686996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 476/944] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:40:12 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:12.818015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7168d-b43d-48ec-9807-3e71a4dd19d2 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:12.867171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd581-f011-4246-868d-778469e6c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:12.868304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd581-f011-4246-868d-778469e6c20f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:12.868810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd581-f011-4246-868d-778469e6c20f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:12.869319 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd581-f011-4246-868d-778469e6c20f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:12.870224 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd581-f011-4246-868d-778469e6c20f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:12.872279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd581-f011-4246-868d-778469e6c20f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-861dd581-f011-4246-868d-778469e6c20f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:12.888763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:12.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:12.890941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:12.894333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 469/945] 10.222.0.124 () {56 vars in 1131 bytes} [Mon Aug 1 16:40:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:12.904627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc2d9-0f1b-4255-98a9-4bf4a45e5d67 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:12.960346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:13.114526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc2d9-0f1b-4255-98a9-4bf4a45e5d67 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:13.177693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b52c47-69c0-4116-802d-de317d76ec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:13.178345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52c47-69c0-4116-802d-de317d76ec73 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:13.178631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52c47-69c0-4116-802d-de317d76ec73 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:13.178907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52c47-69c0-4116-802d-de317d76ec73 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:13.179660 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b52c47-69c0-4116-802d-de317d76ec73 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:13.179970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b52c47-69c0-4116-802d-de317d76ec73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:13.181400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b52c47-69c0-4116-802d-de317d76ec73 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:13.187529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 477/946] 10.222.0.124 () {56 vars in 1127 bytes} [Mon Aug 1 16:40:12 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:13.193479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd581-f011-4246-868d-778469e6c20f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:13.266722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:13.319153 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd581-f011-4246-868d-778469e6c20f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:13.360545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217582e-48b0-4b2c-aa6d-703f65c2cbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:13.361603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217582e-48b0-4b2c-aa6d-703f65c2cbe3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:13.362145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217582e-48b0-4b2c-aa6d-703f65c2cbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:13.362625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217582e-48b0-4b2c-aa6d-703f65c2cbe3 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:13.363636 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217582e-48b0-4b2c-aa6d-703f65c2cbe3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:13.364155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217582e-48b0-4b2c-aa6d-703f65c2cbe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:13.365843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217582e-48b0-4b2c-aa6d-703f65c2cbe3 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:13.372642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 470/947] 10.222.0.124 () {56 vars in 1127 bytes} [Mon Aug 1 16:40:13 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:13.381341 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b52c47-69c0-4116-802d-de317d76ec73 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:13.488140 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:13.503839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b52c47-69c0-4116-802d-de317d76ec73 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:13.543527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008be47-8689-4f8d-8263-bc0fba2950e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:13.544476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008be47-8689-4f8d-8263-bc0fba2950e9 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:13.545398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008be47-8689-4f8d-8263-bc0fba2950e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:13.546089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008be47-8689-4f8d-8263-bc0fba2950e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:13.547127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008be47-8689-4f8d-8263-bc0fba2950e9 None admin] RBAC: Adding query filter params (interface=public, service_id=9c8ad95d2f2c42ac97ac7c82d92256e1, region_id=RegionOne) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:13.547620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008be47-8689-4f8d-8263-bc0fba2950e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:13.549199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008be47-8689-4f8d-8263-bc0fba2950e9 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:13.555801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 478/948] 10.222.0.124 () {56 vars in 1256 bytes} [Mon Aug 1 16:40:13 2022] GET /identity/v3/endpoints?service_id=9c8ad95d2f2c42ac97ac7c82d92256e1&interface=public®ion_id=RegionOne => generated 195 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:13.565578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217582e-48b0-4b2c-aa6d-703f65c2cbe3 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:13.702605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217582e-48b0-4b2c-aa6d-703f65c2cbe3 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:13.730847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:13.745783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621f52d-92f8-45ac-9510-ad8a70e33906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:13.746703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f52d-92f8-45ac-9510-ad8a70e33906 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:13.747162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f52d-92f8-45ac-9510-ad8a70e33906 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:13.747902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f52d-92f8-45ac-9510-ad8a70e33906 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:13.748837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621f52d-92f8-45ac-9510-ad8a70e33906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:13.751180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621f52d-92f8-45ac-9510-ad8a70e33906 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:13.759242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 471/949] 10.222.0.124 () {56 vars in 1092 bytes} [Mon Aug 1 16:40:13 2022] GET /identity/v3/services => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:40:13.897890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3ee9b-64c8-48c1-b2bf-985f6b782e90 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:13.898173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3ee9b-64c8-48c1-b2bf-985f6b782e90 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:13.898475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3ee9b-64c8-48c1-b2bf-985f6b782e90 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:13.900420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 479/950] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:13.906623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29939f-260f-477b-af52-bafc7a4abfb4 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:13.906916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29939f-260f-477b-af52-bafc7a4abfb4 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:13.907233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29939f-260f-477b-af52-bafc7a4abfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:13.932391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-0b29939f-260f-477b-af52-bafc7a4abfb4 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:13.933655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0b29939f-260f-477b-af52-bafc7a4abfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:14.048469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 472/951] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:13 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:14.084242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3ee9b-64c8-48c1-b2bf-985f6b782e90 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:14.215199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3ee9b-64c8-48c1-b2bf-985f6b782e90 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:14.282815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f57c41-e601-4a84-9aed-1ac79b7bcc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:14.284011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f57c41-e601-4a84-9aed-1ac79b7bcc35 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:14.284512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f57c41-e601-4a84-9aed-1ac79b7bcc35 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:14.285011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f57c41-e601-4a84-9aed-1ac79b7bcc35 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:14.286147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f57c41-e601-4a84-9aed-1ac79b7bcc35 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:14.288931 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f57c41-e601-4a84-9aed-1ac79b7bcc35 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-c5f57c41-e601-4a84-9aed-1ac79b7bcc35 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:14.304509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:14.305751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:14.306650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 480/952] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:40:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:14.315441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29939f-260f-477b-af52-bafc7a4abfb4 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:14.463936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29939f-260f-477b-af52-bafc7a4abfb4 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:14.485256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:14.511609 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587ac38-4eb5-4e46-95a2-f46a6213d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:14.512268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ac38-4eb5-4e46-95a2-f46a6213d28b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:14.512549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ac38-4eb5-4e46-95a2-f46a6213d28b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:14.512827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ac38-4eb5-4e46-95a2-f46a6213d28b None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:14.513783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587ac38-4eb5-4e46-95a2-f46a6213d28b None admin] RBAC: Adding query filter params (name=compute) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:14.514205 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587ac38-4eb5-4e46-95a2-f46a6213d28b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:14.515705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587ac38-4eb5-4e46-95a2-f46a6213d28b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:14.521870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 473/953] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:40:14 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:14.527580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f57c41-e601-4a84-9aed-1ac79b7bcc35 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:14.559906 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:14.696856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f57c41-e601-4a84-9aed-1ac79b7bcc35 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:14.755976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400afd3-09e6-435a-a83b-1e846eec090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:14.756630 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400afd3-09e6-435a-a83b-1e846eec090a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:14.756888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400afd3-09e6-435a-a83b-1e846eec090a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:14.757174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400afd3-09e6-435a-a83b-1e846eec090a None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:14.757887 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400afd3-09e6-435a-a83b-1e846eec090a None admin] RBAC: Adding query filter params (type=compute) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:14.758188 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400afd3-09e6-435a-a83b-1e846eec090a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:14.759649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400afd3-09e6-435a-a83b-1e846eec090a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:14.765888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 481/954] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:40:14 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:15.004831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870ad3-2915-40d6-b721-cf2a3d2a1a56 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:15.005384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870ad3-2915-40d6-b721-cf2a3d2a1a56 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:15.005384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870ad3-2915-40d6-b721-cf2a3d2a1a56 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:15.007293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 474/955] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:15.013333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e39c8-c80a-472a-8657-1b12868f7206 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:15.013773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e39c8-c80a-472a-8657-1b12868f7206 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:15.014021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e39c8-c80a-472a-8657-1b12868f7206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:15.036023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-776e39c8-c80a-472a-8657-1b12868f7206 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:15.037295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-776e39c8-c80a-472a-8657-1b12868f7206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:15.131109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 482/956] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:15 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:15.151682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4870ad3-2915-40d6-b721-cf2a3d2a1a56 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:15.279294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4870ad3-2915-40d6-b721-cf2a3d2a1a56 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:15.321825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5decb1-feeb-4cf5-8b70-d4877050d403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:15.322825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5decb1-feeb-4cf5-8b70-d4877050d403 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:15.322825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5decb1-feeb-4cf5-8b70-d4877050d403 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:15.323097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5decb1-feeb-4cf5-8b70-d4877050d403 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:15.336560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5decb1-feeb-4cf5-8b70-d4877050d403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-0f5decb1-feeb-4cf5-8b70-d4877050d403 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:40:15.341805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:15.343795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:15.345472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 475/957] 10.222.0.124 () {56 vars in 1125 bytes} [Mon Aug 1 16:40:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:15.350216 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e39c8-c80a-472a-8657-1b12868f7206 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:15.364730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:15.482768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e39c8-c80a-472a-8657-1b12868f7206 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:15.528367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cb3c4-dd25-4f69-9236-c79345884117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:15.529402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cb3c4-dd25-4f69-9236-c79345884117 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:15.529669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cb3c4-dd25-4f69-9236-c79345884117 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:15.529946 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cb3c4-dd25-4f69-9236-c79345884117 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:15.530782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cb3c4-dd25-4f69-9236-c79345884117 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:15.531134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cb3c4-dd25-4f69-9236-c79345884117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:15.532594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cb3c4-dd25-4f69-9236-c79345884117 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:15.542979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 483/958] 10.222.0.124 () {56 vars in 1120 bytes} [Mon Aug 1 16:40:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:15.549625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070473b-720d-4289-9d87-b33b7311d831 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:15.550123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070473b-720d-4289-9d87-b33b7311d831 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:15.550608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070473b-720d-4289-9d87-b33b7311d831 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:15.552113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cb3c4-dd25-4f69-9236-c79345884117 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:15.553378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 476/959] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:15 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:15.563131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc32497-9f11-4dd5-8df3-0380a6a7c8f1 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:15.564066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc32497-9f11-4dd5-8df3-0380a6a7c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:15.564874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc32497-9f11-4dd5-8df3-0380a6a7c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:15.593020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1cc32497-9f11-4dd5-8df3-0380a6a7c8f1 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:15.594701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1cc32497-9f11-4dd5-8df3-0380a6a7c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:15.637242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:15.686996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 477/960] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:15 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:15.709273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:15.726352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc32497-9f11-4dd5-8df3-0380a6a7c8f1 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:15.731112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cb3c4-dd25-4f69-9236-c79345884117 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:15.780333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31740d9-9983-46c5-a3d7-a7c04f6d7e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:15.781082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31740d9-9983-46c5-a3d7-a7c04f6d7e19 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:15.781364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31740d9-9983-46c5-a3d7-a7c04f6d7e19 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:15.781635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31740d9-9983-46c5-a3d7-a7c04f6d7e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:15.805277 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31740d9-9983-46c5-a3d7-a7c04f6d7e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:15.807151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31740d9-9983-46c5-a3d7-a7c04f6d7e19 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d31740d9-9983-46c5-a3d7-a7c04f6d7e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:15.829199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:15.831506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:15.833437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:15.833437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:15.833437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:15.833437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:15.833437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 484/961] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:15.837414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31740d9-9983-46c5-a3d7-a7c04f6d7e19 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:15.944432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc32497-9f11-4dd5-8df3-0380a6a7c8f1 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:16.000493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4228c-f86c-48d0-8f87-e6667ae1a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:16.002152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4228c-f86c-48d0-8f87-e6667ae1a36c None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:16.003103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4228c-f86c-48d0-8f87-e6667ae1a36c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:16.003971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4228c-f86c-48d0-8f87-e6667ae1a36c None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:16.005410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4228c-f86c-48d0-8f87-e6667ae1a36c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:16.008624 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4228c-f86c-48d0-8f87-e6667ae1a36c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:16.015433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31740d9-9983-46c5-a3d7-a7c04f6d7e19 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:16.043904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.sql.core [None req-fee4228c-f86c-48d0-8f87-e6667ae1a36c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 16:40:16.043904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 16:40:16.043904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [parameters: {'user_id': 'e5da274eeb764e27bcd614f40338376a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 16:40:16.043904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92121) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 16:40:16.044679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:16.060696 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb7cd3-76f0-4ab6-b90d-edaf0fe24b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:16.061553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb7cd3-76f0-4ab6-b90d-edaf0fe24b86 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:16.061827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb7cd3-76f0-4ab6-b90d-edaf0fe24b86 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:16.062105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb7cd3-76f0-4ab6-b90d-edaf0fe24b86 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:16.062833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb7cd3-76f0-4ab6-b90d-edaf0fe24b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:16.063179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb7cd3-76f0-4ab6-b90d-edaf0fe24b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-fee4228c-f86c-48d0-8f87-e6667ae1a36c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result.read() Aug 01 16:40:16.063514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:40:16.065063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application yield resource Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise self.value Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application session.commit() Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 16:40:16.069123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.session.flush() Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application compat.raise_( Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 16:40:16.070492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:40:16.072185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application result.read() Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:40:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e5da274eeb764e27bcd614f40338376a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:16.081234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 01 16:40:16.083594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 01 16:40:16.086208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 01 16:40:16.086208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 01 16:40:16.086208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 16:40:16.086208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 16:40:16.086208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 16:40:16.086208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:16.089136 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb7cd3-76f0-4ab6-b90d-edaf0fe24b86 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:16.089365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 478/962] 10.222.0.124 () {60 vars in 1136 bytes} [Mon Aug 1 16:40:15 2022] POST /identity/v3/users => generated 160 bytes in 362 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:16.091251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4228c-f86c-48d0-8f87-e6667ae1a36c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:16.098360 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 485/963] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:16.101147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb7cd3-76f0-4ab6-b90d-edaf0fe24b86 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:16.158753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:16.250870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb7cd3-76f0-4ab6-b90d-edaf0fe24b86 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:16.291234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4228c-f86c-48d0-8f87-e6667ae1a36c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:16.305300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50a84e-7a1e-4c3d-a79d-5558e87fa13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:16.306134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50a84e-7a1e-4c3d-a79d-5558e87fa13c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:16.306501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50a84e-7a1e-4c3d-a79d-5558e87fa13c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:16.306942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50a84e-7a1e-4c3d-a79d-5558e87fa13c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:16.317007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50a84e-7a1e-4c3d-a79d-5558e87fa13c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:16.318852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50a84e-7a1e-4c3d-a79d-5558e87fa13c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-8c50a84e-7a1e-4c3d-a79d-5558e87fa13c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:40:16.338499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:16.339623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:16.340609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:16.340609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:16.340609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:40:16.340609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:40:16.340609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:40:16.340609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:40:16.340609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:40:16.340609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:40:16.340609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:40:16.340609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:16.343123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 486/964] 10.222.0.124 () {56 vars in 1122 bytes} [Mon Aug 1 16:40:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:16.348343 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50a84e-7a1e-4c3d-a79d-5558e87fa13c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:16.359549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7a924-8513-4330-a523-7315f580dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:16.360964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7a924-8513-4330-a523-7315f580dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:16.361467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7a924-8513-4330-a523-7315f580dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:16.361921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7a924-8513-4330-a523-7315f580dbb3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:16.377166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7a924-8513-4330-a523-7315f580dbb3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:16.380806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7a924-8513-4330-a523-7315f580dbb3 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:16.409122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-2ff7a924-8513-4330-a523-7315f580dbb3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:40:16.409699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:16.411557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:16.413486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:16.413486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:16.413486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:40:16.413486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:40:16.413486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:40:16.413486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:40:16.413486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:40:16.413486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:40:16.413486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:40:16.413486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:16.418997 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 479/965] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:40:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:16.425119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7a924-8513-4330-a523-7315f580dbb3 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:16.540147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50a84e-7a1e-4c3d-a79d-5558e87fa13c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:16.579074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:16.593312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7a924-8513-4330-a523-7315f580dbb3 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:16.604621 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f985e-f847-4ff9-bc28-9c7c0629c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:16.605456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f985e-f847-4ff9-bc28-9c7c0629c1cb None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:16.605899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f985e-f847-4ff9-bc28-9c7c0629c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:16.606336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f985e-f847-4ff9-bc28-9c7c0629c1cb None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:16.608333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f985e-f847-4ff9-bc28-9c7c0629c1cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:16.608771 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f985e-f847-4ff9-bc28-9c7c0629c1cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:16.611347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f985e-f847-4ff9-bc28-9c7c0629c1cb None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:16.650934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 487/966] 10.222.0.124 () {56 vars in 1154 bytes} [Mon Aug 1 16:40:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:16.650934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31744e-d3f3-4873-b5c4-c61926aeed8a None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:16.650934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31744e-d3f3-4873-b5c4-c61926aeed8a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:16.650934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31744e-d3f3-4873-b5c4-c61926aeed8a None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:16.650934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 488/967] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:16.657060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ae7c-1d83-440b-9b10-0363d7478f01 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:16.657366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ae7c-1d83-440b-9b10-0363d7478f01 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:16.657852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ae7c-1d83-440b-9b10-0363d7478f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:16.660176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedabe6-2fd2-4674-8a9c-0e0bd03d2527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:16.660838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedabe6-2fd2-4674-8a9c-0e0bd03d2527 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:16.661124 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedabe6-2fd2-4674-8a9c-0e0bd03d2527 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:16.661459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedabe6-2fd2-4674-8a9c-0e0bd03d2527 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:16.662216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedabe6-2fd2-4674-8a9c-0e0bd03d2527 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:16.662623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedabe6-2fd2-4674-8a9c-0e0bd03d2527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:16.664170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedabe6-2fd2-4674-8a9c-0e0bd03d2527 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:16.691878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-e803ae7c-1d83-440b-9b10-0363d7478f01 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:16.693684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e803ae7c-1d83-440b-9b10-0363d7478f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:16.719082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 480/968] 10.222.0.124 () {56 vars in 1106 bytes} [Mon Aug 1 16:40:16 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:16.719082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedabe6-2fd2-4674-8a9c-0e0bd03d2527 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:16.843191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 489/969] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:16 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:16.868235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ae7c-1d83-440b-9b10-0363d7478f01 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:16.918158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:16.924608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedabe6-2fd2-4674-8a9c-0e0bd03d2527 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:16.966203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1ce0-eeae-4adb-97c0-b55530e60b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:16.966978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1ce0-eeae-4adb-97c0-b55530e60b3e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:16.967332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1ce0-eeae-4adb-97c0-b55530e60b3e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:16.967562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1ce0-eeae-4adb-97c0-b55530e60b3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:17.001578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:17.006365 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ae7c-1d83-440b-9b10-0363d7478f01 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:17.050338 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e1ce0-eeae-4adb-97c0-b55530e60b3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:17.052021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e1ce0-eeae-4adb-97c0-b55530e60b3e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:17.052772 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c726a-1ef0-4121-bead-4d5b8bdf0c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:17.053456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c726a-1ef0-4121-bead-4d5b8bdf0c39 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:17.053740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c726a-1ef0-4121-bead-4d5b8bdf0c39 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:17.054054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c726a-1ef0-4121-bead-4d5b8bdf0c39 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:17.054718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c726a-1ef0-4121-bead-4d5b8bdf0c39 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:17.056225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c726a-1ef0-4121-bead-4d5b8bdf0c39 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d98c726a-1ef0-4121-bead-4d5b8bdf0c39 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:17.069520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:17.070633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:17.071572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 490/970] 10.222.0.124 () {56 vars in 1131 bytes} [Mon Aug 1 16:40:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:17.077828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c726a-1ef0-4121-bead-4d5b8bdf0c39 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:17.176409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 481/971] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:40:16 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:40:17.182278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1ce0-eeae-4adb-97c0-b55530e60b3e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:17.196072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:17.209360 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c726a-1ef0-4121-bead-4d5b8bdf0c39 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:17.247594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:17.276617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5243126-efb2-4679-b74c-93f91b9b615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:17.277978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5243126-efb2-4679-b74c-93f91b9b615c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:17.278369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5243126-efb2-4679-b74c-93f91b9b615c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:17.278826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5243126-efb2-4679-b74c-93f91b9b615c None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:17.280371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5243126-efb2-4679-b74c-93f91b9b615c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:17.280901 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5243126-efb2-4679-b74c-93f91b9b615c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:17.282875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5243126-efb2-4679-b74c-93f91b9b615c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:17.292245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 491/972] 10.222.0.124 () {56 vars in 1127 bytes} [Mon Aug 1 16:40:17 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:17.299069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5243126-efb2-4679-b74c-93f91b9b615c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:17.309260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1ce0-eeae-4adb-97c0-b55530e60b3e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:17.351279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e83b1-52e7-456b-8de7-da979a3ba9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:17.352011 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e83b1-52e7-456b-8de7-da979a3ba9df None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:17.352287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e83b1-52e7-456b-8de7-da979a3ba9df None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:17.352559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e83b1-52e7-456b-8de7-da979a3ba9df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:17.364994 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e83b1-52e7-456b-8de7-da979a3ba9df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:17.366625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e83b1-52e7-456b-8de7-da979a3ba9df None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-265e83b1-52e7-456b-8de7-da979a3ba9df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:17.384761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:17.385956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:17.392329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:17.392329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:17.392329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:17.392329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:17.392329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 482/973] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:17.392801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e83b1-52e7-456b-8de7-da979a3ba9df None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:17.472589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5243126-efb2-4679-b74c-93f91b9b615c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:17.524293 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beb5c0-7b1a-4a94-a347-d3fc13c41d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:17.524944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beb5c0-7b1a-4a94-a347-d3fc13c41d37 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:17.525253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beb5c0-7b1a-4a94-a347-d3fc13c41d37 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:17.525514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beb5c0-7b1a-4a94-a347-d3fc13c41d37 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:17.526429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06beb5c0-7b1a-4a94-a347-d3fc13c41d37 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:17.526739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06beb5c0-7b1a-4a94-a347-d3fc13c41d37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:17.528220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06beb5c0-7b1a-4a94-a347-d3fc13c41d37 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:17.535261 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 492/974] 10.222.0.124 () {56 vars in 1127 bytes} [Mon Aug 1 16:40:17 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:17.539452 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e83b1-52e7-456b-8de7-da979a3ba9df None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:17.541452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beb5c0-7b1a-4a94-a347-d3fc13c41d37 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:17.542887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:17.576314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:17.594009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1be19-288f-45ce-9c85-010dfb06d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:17.594653 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1be19-288f-45ce-9c85-010dfb06d101 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:17.594935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1be19-288f-45ce-9c85-010dfb06d101 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:17.595236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1be19-288f-45ce-9c85-010dfb06d101 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:17.595958 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1be19-288f-45ce-9c85-010dfb06d101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:17.596260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1be19-288f-45ce-9c85-010dfb06d101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:17.598371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1be19-288f-45ce-9c85-010dfb06d101 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:17.616953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 483/975] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:17.626437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1be19-288f-45ce-9c85-010dfb06d101 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:17.686819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beb5c0-7b1a-4a94-a347-d3fc13c41d37 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:17.734828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596ee0-66fa-46d4-bb91-7a3d16e19a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:17.735455 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596ee0-66fa-46d4-bb91-7a3d16e19a23 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:17.735740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596ee0-66fa-46d4-bb91-7a3d16e19a23 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:17.736014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596ee0-66fa-46d4-bb91-7a3d16e19a23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:17.736771 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596ee0-66fa-46d4-bb91-7a3d16e19a23 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:17.738291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596ee0-66fa-46d4-bb91-7a3d16e19a23 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:17.773773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1be19-288f-45ce-9c85-010dfb06d101 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:17.787023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 493/976] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:40:17 2022] POST /identity/v3/endpoints => generated 351 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:40:17.832480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce572c40-b542-4d07-a661-1d12e4c25365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:17.833225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572c40-b542-4d07-a661-1d12e4c25365 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:17.833693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572c40-b542-4d07-a661-1d12e4c25365 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:17.833871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572c40-b542-4d07-a661-1d12e4c25365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:17.843090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce572c40-b542-4d07-a661-1d12e4c25365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:17.844672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce572c40-b542-4d07-a661-1d12e4c25365 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-ce572c40-b542-4d07-a661-1d12e4c25365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:40:17.858874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:17.866326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:17.867399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:40:17.867399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:40:17.867399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:40:17.867399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:40:17.867399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:40:17.867399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:40:17.867399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:17.867399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:17.867399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 484/977] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:40:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:17.872453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596ee0-66fa-46d4-bb91-7a3d16e19a23 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:18.027000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:18.065525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596ee0-66fa-46d4-bb91-7a3d16e19a23 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:18.124966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e0e3-b051-4157-831e-d8d8a7a9dc70 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:18.125273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e0e3-b051-4157-831e-d8d8a7a9dc70 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:18.125522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e0e3-b051-4157-831e-d8d8a7a9dc70 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:18.126966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 485/978] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:40:18.133331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f067-56c3-4dd3-aa0d-7293a793e5da None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:18.133783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f067-56c3-4dd3-aa0d-7293a793e5da None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:18.134162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f067-56c3-4dd3-aa0d-7293a793e5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:18.134724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907433d0-fb25-4fd5-ba68-1345e4889e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:18.135804 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907433d0-fb25-4fd5-ba68-1345e4889e9f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:18.136249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907433d0-fb25-4fd5-ba68-1345e4889e9f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:18.136729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907433d0-fb25-4fd5-ba68-1345e4889e9f None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:18.138203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907433d0-fb25-4fd5-ba68-1345e4889e9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:18.138742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907433d0-fb25-4fd5-ba68-1345e4889e9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:18.141488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907433d0-fb25-4fd5-ba68-1345e4889e9f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:18.159786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 494/979] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:40:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:18.168917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907433d0-fb25-4fd5-ba68-1345e4889e9f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:18.169280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-eea4f067-56c3-4dd3-aa0d-7293a793e5da None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:18.172114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-eea4f067-56c3-4dd3-aa0d-7293a793e5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:18.198203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:18.306909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 486/980] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:18 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:18.331439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4f067-56c3-4dd3-aa0d-7293a793e5da None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:18.339070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907433d0-fb25-4fd5-ba68-1345e4889e9f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:18.402611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88352ee4-6035-41f6-9172-63f80189c2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:18.404540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352ee4-6035-41f6-9172-63f80189c2ae None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:18.405241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352ee4-6035-41f6-9172-63f80189c2ae None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:18.405844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352ee4-6035-41f6-9172-63f80189c2ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:18.407556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88352ee4-6035-41f6-9172-63f80189c2ae None admin] RBAC: Adding query filter params (role.id=e30f4d3046084825ac1b052687c77151, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=c5e98d3e170a4e95bc03daf2a950e5f6) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:18.408273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88352ee4-6035-41f6-9172-63f80189c2ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:18.411661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88352ee4-6035-41f6-9172-63f80189c2ae None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:18.422423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 495/981] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:40:18 2022] GET /identity/v3/role_assignments?user.id=c5e98d3e170a4e95bc03daf2a950e5f6&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=e30f4d3046084825ac1b052687c77151 => generated 610 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:18.517148 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4f067-56c3-4dd3-aa0d-7293a793e5da None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:18.567047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5c796-5baf-485b-b9c6-cd55d44476be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:18.567581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5c796-5baf-485b-b9c6-cd55d44476be None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:18.567866 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5c796-5baf-485b-b9c6-cd55d44476be None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:18.568134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5c796-5baf-485b-b9c6-cd55d44476be None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:18.568857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5c796-5baf-485b-b9c6-cd55d44476be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:18.570325 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5c796-5baf-485b-b9c6-cd55d44476be None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:18.590476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 487/982] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:40:18 2022] POST /identity/v3/services => generated 243 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:40:20.838439 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fcf63-b7ef-4163-a29f-f16d480a507a None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:20.839288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fcf63-b7ef-4163-a29f-f16d480a507a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:20.839288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fcf63-b7ef-4163-a29f-f16d480a507a None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:20.840697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 496/983] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:40:20.846869 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0c26d-842e-4764-b7fd-76036036a2b1 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:20.847804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0c26d-842e-4764-b7fd-76036036a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:20.847804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0c26d-842e-4764-b7fd-76036036a2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:20.868778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-5ab0c26d-842e-4764-b7fd-76036036a2b1 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:20.870041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-5ab0c26d-842e-4764-b7fd-76036036a2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:20.872717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:20.978206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 488/984] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:20 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:21.002326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fcf63-b7ef-4163-a29f-f16d480a507a None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:21.008949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:21.088935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e40034-7405-4a10-9fc3-09ee7d6c4ab6 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:21.089189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e40034-7405-4a10-9fc3-09ee7d6c4ab6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:21.089544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e40034-7405-4a10-9fc3-09ee7d6c4ab6 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:21.091489 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 489/985] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:40:21.098426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06266ad-c51a-4d78-be7d-b357b98107ef None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:21.098792 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06266ad-c51a-4d78-be7d-b357b98107ef None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:21.099403 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06266ad-c51a-4d78-be7d-b357b98107ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:21.124320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d06266ad-c51a-4d78-be7d-b357b98107ef None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:21.125871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d06266ad-c51a-4d78-be7d-b357b98107ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:21.142645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fcf63-b7ef-4163-a29f-f16d480a507a None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:21.206601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a320e38-4650-410c-8ff9-a925794c72b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:21.207657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a320e38-4650-410c-8ff9-a925794c72b9 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:21.208132 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a320e38-4650-410c-8ff9-a925794c72b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:21.208571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a320e38-4650-410c-8ff9-a925794c72b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:21.209546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a320e38-4650-410c-8ff9-a925794c72b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:21.212035 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a320e38-4650-410c-8ff9-a925794c72b9 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-1a320e38-4650-410c-8ff9-a925794c72b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:21.229463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:21.230576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:40:21.231740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:21.239609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 497/986] 10.222.0.124 () {56 vars in 1110 bytes} [Mon Aug 1 16:40:21 2022] GET /identity/v3/services/image => generated 86 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:21.242223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a320e38-4650-410c-8ff9-a925794c72b9 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:21.248917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 490/987] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:21 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:21.287829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06266ad-c51a-4d78-be7d-b357b98107ef None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:21.373099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:21.404708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:21.428917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a320e38-4650-410c-8ff9-a925794c72b9 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:21.461082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06266ad-c51a-4d78-be7d-b357b98107ef None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:21.480522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dd5bb-a10f-4d97-8a4f-029bb440836f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:21.482091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd5bb-a10f-4d97-8a4f-029bb440836f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:21.482582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd5bb-a10f-4d97-8a4f-029bb440836f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:21.482869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd5bb-a10f-4d97-8a4f-029bb440836f None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:21.483821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dd5bb-a10f-4d97-8a4f-029bb440836f None admin] RBAC: Adding query filter params (name=image) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:21.484134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dd5bb-a10f-4d97-8a4f-029bb440836f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:21.485701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dd5bb-a10f-4d97-8a4f-029bb440836f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:21.491847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 498/988] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:21 2022] GET /identity/v3/services?name=image => generated 123 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:21.500488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dd5bb-a10f-4d97-8a4f-029bb440836f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:21.523437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5606e53-73aa-48bb-bea9-119df6b3753f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:21.524488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5606e53-73aa-48bb-bea9-119df6b3753f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:21.524922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5606e53-73aa-48bb-bea9-119df6b3753f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:21.525455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5606e53-73aa-48bb-bea9-119df6b3753f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:21.526453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5606e53-73aa-48bb-bea9-119df6b3753f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:21.529658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5606e53-73aa-48bb-bea9-119df6b3753f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-f5606e53-73aa-48bb-bea9-119df6b3753f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:21.546060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:21.547221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:21.548082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 491/989] 10.222.0.124 () {56 vars in 1131 bytes} [Mon Aug 1 16:40:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:21.556109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5606e53-73aa-48bb-bea9-119df6b3753f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:21.664693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dd5bb-a10f-4d97-8a4f-029bb440836f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:21.706921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:21.709564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5606e53-73aa-48bb-bea9-119df6b3753f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:21.713689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01eb115-6699-4240-98ca-2b908ba376a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:21.714335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01eb115-6699-4240-98ca-2b908ba376a1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:21.714618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01eb115-6699-4240-98ca-2b908ba376a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:21.714897 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01eb115-6699-4240-98ca-2b908ba376a1 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:21.716073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01eb115-6699-4240-98ca-2b908ba376a1 None admin] RBAC: Adding query filter params (type=image) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:21.716228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01eb115-6699-4240-98ca-2b908ba376a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:21.718007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01eb115-6699-4240-98ca-2b908ba376a1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:21.723822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 499/990] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:21 2022] GET /identity/v3/services?type=image => generated 123 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:21.749935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:21.762372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e9c72-bf43-4ca8-9123-52fab1d0cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:21.763520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e9c72-bf43-4ca8-9123-52fab1d0cd80 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:21.764256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e9c72-bf43-4ca8-9123-52fab1d0cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:21.764884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e9c72-bf43-4ca8-9123-52fab1d0cd80 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:21.765863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e9c72-bf43-4ca8-9123-52fab1d0cd80 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:21.766380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e9c72-bf43-4ca8-9123-52fab1d0cd80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:21.768116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e9c72-bf43-4ca8-9123-52fab1d0cd80 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:21.774746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 492/991] 10.222.0.124 () {56 vars in 1127 bytes} [Mon Aug 1 16:40:21 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:21.781724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01eb115-6699-4240-98ca-2b908ba376a1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:21.925895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01eb115-6699-4240-98ca-2b908ba376a1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:21.984291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c973546-e893-416d-8115-dcf646344c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:21.984954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973546-e893-416d-8115-dcf646344c2d None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:21.985238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973546-e893-416d-8115-dcf646344c2d None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:21.985512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973546-e893-416d-8115-dcf646344c2d None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:21.986227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c973546-e893-416d-8115-dcf646344c2d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:21.986535 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c973546-e893-416d-8115-dcf646344c2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:21.988170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c973546-e893-416d-8115-dcf646344c2d None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:21.994573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 500/992] 10.222.0.124 () {56 vars in 1127 bytes} [Mon Aug 1 16:40:21 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:22.002066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e9c72-bf43-4ca8-9123-52fab1d0cd80 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:22.086802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8580-3f7f-45b1-9595-85a4add1e772 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:22.087314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8580-3f7f-45b1-9595-85a4add1e772 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:22.087495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8580-3f7f-45b1-9595-85a4add1e772 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:22.089838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 501/993] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:22 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:22.097602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925df6-f79a-4c90-8248-4ebcc32aa233 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:22.098041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925df6-f79a-4c90-8248-4ebcc32aa233 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:22.098433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925df6-f79a-4c90-8248-4ebcc32aa233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:22.121687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-39925df6-f79a-4c90-8248-4ebcc32aa233 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:22.123255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-39925df6-f79a-4c90-8248-4ebcc32aa233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:22.202236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e9c72-bf43-4ca8-9123-52fab1d0cd80 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:22.219051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:22.243909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 502/994] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:22 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:22.263645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834aa3-4837-4d28-9182-74a6426cda0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:22.264630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834aa3-4837-4d28-9182-74a6426cda0c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:22.265072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834aa3-4837-4d28-9182-74a6426cda0c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:22.265375 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834aa3-4837-4d28-9182-74a6426cda0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:22.266213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65834aa3-4837-4d28-9182-74a6426cda0c None admin] RBAC: Adding query filter params (interface=admin, service_id=9c8ad95d2f2c42ac97ac7c82d92256e1, region_id=RegionOne) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:22.266633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65834aa3-4837-4d28-9182-74a6426cda0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:22.268128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65834aa3-4837-4d28-9182-74a6426cda0c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:22.278838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 493/995] 10.222.0.124 () {56 vars in 1254 bytes} [Mon Aug 1 16:40:22 2022] GET /identity/v3/endpoints?service_id=9c8ad95d2f2c42ac97ac7c82d92256e1&interface=admin®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:22.281054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39925df6-f79a-4c90-8248-4ebcc32aa233 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:22.285482 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834aa3-4837-4d28-9182-74a6426cda0c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:22.374163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:22.437806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39925df6-f79a-4c90-8248-4ebcc32aa233 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:22.484441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834aa3-4837-4d28-9182-74a6426cda0c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:22.501738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51e38-ce28-4963-9410-47ed73732206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:22.503469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51e38-ce28-4963-9410-47ed73732206 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:22.504256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51e38-ce28-4963-9410-47ed73732206 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:22.505011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51e38-ce28-4963-9410-47ed73732206 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:22.506684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced51e38-ce28-4963-9410-47ed73732206 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:22.509894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced51e38-ce28-4963-9410-47ed73732206 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-ced51e38-ce28-4963-9410-47ed73732206 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:22.524909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:22.526208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:40:22.527139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:22.529862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 503/996] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:40:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:22.535919 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51e38-ce28-4963-9410-47ed73732206 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:22.548214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa37c9a-32bb-4b96-8f1e-62e5c9e9b9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:22.548980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa37c9a-32bb-4b96-8f1e-62e5c9e9b9af None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:22.549327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa37c9a-32bb-4b96-8f1e-62e5c9e9b9af None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:22.549663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa37c9a-32bb-4b96-8f1e-62e5c9e9b9af None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:22.550445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa37c9a-32bb-4b96-8f1e-62e5c9e9b9af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:22.552005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa37c9a-32bb-4b96-8f1e-62e5c9e9b9af None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:22.567697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 494/997] 10.222.0.124 () {56 vars in 1092 bytes} [Mon Aug 1 16:40:22 2022] GET /identity/v3/services => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:40:22.648609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:22.744561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51e38-ce28-4963-9410-47ed73732206 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:22.821561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6eb13-e485-43e8-a150-ea82d093382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:22.822653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6eb13-e485-43e8-a150-ea82d093382a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:22.827234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6eb13-e485-43e8-a150-ea82d093382a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:22.827948 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6eb13-e485-43e8-a150-ea82d093382a None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:22.829310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6eb13-e485-43e8-a150-ea82d093382a None admin] RBAC: Adding query filter params (name=compute) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:22.830176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6eb13-e485-43e8-a150-ea82d093382a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:22.832855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6eb13-e485-43e8-a150-ea82d093382a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:22.843158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 504/998] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:40:22 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:22.850599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa37c9a-32bb-4b96-8f1e-62e5c9e9b9af None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:23.026789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa37c9a-32bb-4b96-8f1e-62e5c9e9b9af None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:23.053107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:23.072794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b3929-317e-4629-933d-51a4b1cc5709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:23.073530 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b3929-317e-4629-933d-51a4b1cc5709 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:23.073870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b3929-317e-4629-933d-51a4b1cc5709 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:23.074204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b3929-317e-4629-933d-51a4b1cc5709 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:23.075097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b3929-317e-4629-933d-51a4b1cc5709 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:23.075467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b3929-317e-4629-933d-51a4b1cc5709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:23.077045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b3929-317e-4629-933d-51a4b1cc5709 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:23.084009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 495/999] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:40:22 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:23.091239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6eb13-e485-43e8-a150-ea82d093382a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:23.285573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6eb13-e485-43e8-a150-ea82d093382a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:23.314474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:23.351832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357dfe2-7164-4859-80e2-675be29a45b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:23.352941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357dfe2-7164-4859-80e2-675be29a45b7 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:23.353438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357dfe2-7164-4859-80e2-675be29a45b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:23.353927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357dfe2-7164-4859-80e2-675be29a45b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:23.355433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357dfe2-7164-4859-80e2-675be29a45b7 None admin] RBAC: Adding query filter params (interface=public, service_id=2261e9abac534fd0bdee2c872a74851d, region_id=RegionOne) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:23.356495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357dfe2-7164-4859-80e2-675be29a45b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:23.358801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357dfe2-7164-4859-80e2-675be29a45b7 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:23.369849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 505/1000] 10.222.0.124 () {56 vars in 1256 bytes} [Mon Aug 1 16:40:23 2022] GET /identity/v3/endpoints?service_id=2261e9abac534fd0bdee2c872a74851d&interface=public®ion_id=RegionOne => generated 195 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:23.376317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b3929-317e-4629-933d-51a4b1cc5709 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:23.514246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b3929-317e-4629-933d-51a4b1cc5709 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:23.553695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35622d73-9bb9-4934-ac49-61f1050e6c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:23.554261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35622d73-9bb9-4934-ac49-61f1050e6c8c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:23.554537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35622d73-9bb9-4934-ac49-61f1050e6c8c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:23.554807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35622d73-9bb9-4934-ac49-61f1050e6c8c None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:23.555518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35622d73-9bb9-4934-ac49-61f1050e6c8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:23.556946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35622d73-9bb9-4934-ac49-61f1050e6c8c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:23.571094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 496/1001] 10.222.0.124 () {56 vars in 1092 bytes} [Mon Aug 1 16:40:23 2022] GET /identity/v3/services => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:40:24.505131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ffa2-57e2-467d-9e34-31da5d61770e None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:24.506800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ffa2-57e2-467d-9e34-31da5d61770e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:24.507646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ffa2-57e2-467d-9e34-31da5d61770e None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:24.512572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 506/1002] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:24 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:24.522627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f062175-4d02-44f3-98c0-e676ea02f8a8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:24.523580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f062175-4d02-44f3-98c0-e676ea02f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:24.523975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f062175-4d02-44f3-98c0-e676ea02f8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:24.558852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-5f062175-4d02-44f3-98c0-e676ea02f8a8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:24.561341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-5f062175-4d02-44f3-98c0-e676ea02f8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:24.657137 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:24.708032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 497/1003] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:24 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:24.749952 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8ffa2-57e2-467d-9e34-31da5d61770e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:24.965017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8ffa2-57e2-467d-9e34-31da5d61770e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:25.030767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187254e7-3b9a-4649-938e-85a71f29ca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:25.031885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187254e7-3b9a-4649-938e-85a71f29ca48 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:25.032333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187254e7-3b9a-4649-938e-85a71f29ca48 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:25.032780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187254e7-3b9a-4649-938e-85a71f29ca48 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:25.034076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187254e7-3b9a-4649-938e-85a71f29ca48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:25.036630 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187254e7-3b9a-4649-938e-85a71f29ca48 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:25.064750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 507/1004] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:40:24 2022] POST /identity/v3/services => generated 243 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:40:25.339206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68961-ed53-4409-a4d7-34a5e1a93a88 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:25.339708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68961-ed53-4409-a4d7-34a5e1a93a88 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:25.340214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68961-ed53-4409-a4d7-34a5e1a93a88 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:25.342819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 498/1005] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:25 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:25.348985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91f4b-6756-4f99-9135-a2a1f9a7c171 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:25.349306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91f4b-6756-4f99-9135-a2a1f9a7c171 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:25.349534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91f4b-6756-4f99-9135-a2a1f9a7c171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:25.374677 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-c4a91f4b-6756-4f99-9135-a2a1f9a7c171 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:25.376844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c4a91f4b-6756-4f99-9135-a2a1f9a7c171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:25.452198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:25.528818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 508/1006] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:25 2022] POST /identity/v3/auth/tokens => generated 1658 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:25.568982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc68961-ed53-4409-a4d7-34a5e1a93a88 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:25.737082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797f5fa-2724-44a0-aad9-8e0a560af4b3 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:25.737332 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797f5fa-2724-44a0-aad9-8e0a560af4b3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:25.737659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797f5fa-2724-44a0-aad9-8e0a560af4b3 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:25.740852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 509/1007] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:40:25.749214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3d02-6647-43cf-a6b2-20c4c4b28d79 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:25.749479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3d02-6647-43cf-a6b2-20c4c4b28d79 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:25.749643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3d02-6647-43cf-a6b2-20c4c4b28d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:25.777571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-d50b3d02-6647-43cf-a6b2-20c4c4b28d79 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:25.779832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d50b3d02-6647-43cf-a6b2-20c4c4b28d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:25.780477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc68961-ed53-4409-a4d7-34a5e1a93a88 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:25.852396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72639726-a576-49a8-84e2-f7c1fbb3c2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:25.853696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72639726-a576-49a8-84e2-f7c1fbb3c2ae None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:25.854178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72639726-a576-49a8-84e2-f7c1fbb3c2ae None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:25.854656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72639726-a576-49a8-84e2-f7c1fbb3c2ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:25.855998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72639726-a576-49a8-84e2-f7c1fbb3c2ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:25.859034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72639726-a576-49a8-84e2-f7c1fbb3c2ae None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-72639726-a576-49a8-84e2-f7c1fbb3c2ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:25.878261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:25.880666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:40:25.882608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:25.888114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 499/1008] 10.222.0.124 () {56 vars in 1131 bytes} [Mon Aug 1 16:40:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:25.889551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72639726-a576-49a8-84e2-f7c1fbb3c2ae None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:25.891783 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 510/1009] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:25 2022] POST /identity/v3/auth/tokens => generated 1658 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:25.916216 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b3d02-6647-43cf-a6b2-20c4c4b28d79 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:25.991412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:26.067590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:26.073226 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b3d02-6647-43cf-a6b2-20c4c4b28d79 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:26.115635 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72639726-a576-49a8-84e2-f7c1fbb3c2ae None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:26.135390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b752a-f6d2-4ccc-9e5f-350b4ee809d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:26.136061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b752a-f6d2-4ccc-9e5f-350b4ee809d9 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:26.136340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b752a-f6d2-4ccc-9e5f-350b4ee809d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:26.136618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b752a-f6d2-4ccc-9e5f-350b4ee809d9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:26.137799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b752a-f6d2-4ccc-9e5f-350b4ee809d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:26.139534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b752a-f6d2-4ccc-9e5f-350b4ee809d9 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-2a9b752a-f6d2-4ccc-9e5f-350b4ee809d9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:26.150199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:26.152487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:26.154312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 511/1010] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:40:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:26.162220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b752a-f6d2-4ccc-9e5f-350b4ee809d9 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:26.189139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495a63b-0080-487f-b3ce-7992782c4028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:26.191322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495a63b-0080-487f-b3ce-7992782c4028 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:26.192026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495a63b-0080-487f-b3ce-7992782c4028 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:26.192679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495a63b-0080-487f-b3ce-7992782c4028 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:26.194127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495a63b-0080-487f-b3ce-7992782c4028 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:26.195738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495a63b-0080-487f-b3ce-7992782c4028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:26.199245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495a63b-0080-487f-b3ce-7992782c4028 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:26.210894 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 500/1011] 10.222.0.124 () {56 vars in 1127 bytes} [Mon Aug 1 16:40:25 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:26.220966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495a63b-0080-487f-b3ce-7992782c4028 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:26.337782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b752a-f6d2-4ccc-9e5f-350b4ee809d9 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:26.393930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365edca4-252c-4c8e-801c-d2f4b8737516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:26.395313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365edca4-252c-4c8e-801c-d2f4b8737516 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:26.395812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365edca4-252c-4c8e-801c-d2f4b8737516 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:26.396101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365edca4-252c-4c8e-801c-d2f4b8737516 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:26.396870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365edca4-252c-4c8e-801c-d2f4b8737516 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:26.397249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365edca4-252c-4c8e-801c-d2f4b8737516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:26.399769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365edca4-252c-4c8e-801c-d2f4b8737516 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:26.410169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495a63b-0080-487f-b3ce-7992782c4028 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:26.428506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 512/1012] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:40:26 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:26.431530 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365edca4-252c-4c8e-801c-d2f4b8737516 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:26.445183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:26.475407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:26.523358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74becc-884a-43eb-b8dd-0c1298207010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:26.524008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74becc-884a-43eb-b8dd-0c1298207010 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:26.524354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74becc-884a-43eb-b8dd-0c1298207010 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:26.524537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74becc-884a-43eb-b8dd-0c1298207010 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:26.525521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74becc-884a-43eb-b8dd-0c1298207010 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:26.525803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74becc-884a-43eb-b8dd-0c1298207010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:26.527390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74becc-884a-43eb-b8dd-0c1298207010 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:26.534012 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 501/1013] 10.222.0.124 () {56 vars in 1127 bytes} [Mon Aug 1 16:40:26 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:26.540015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74becc-884a-43eb-b8dd-0c1298207010 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:26.609219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365edca4-252c-4c8e-801c-d2f4b8737516 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:26.651992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5febaf-d001-4343-a465-b273dc69db09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:26.652672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5febaf-d001-4343-a465-b273dc69db09 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:26.652977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5febaf-d001-4343-a465-b273dc69db09 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:26.653237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5febaf-d001-4343-a465-b273dc69db09 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:26.653923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5febaf-d001-4343-a465-b273dc69db09 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:26.654214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5febaf-d001-4343-a465-b273dc69db09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:26.655686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5febaf-d001-4343-a465-b273dc69db09 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:26.662117 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 513/1014] 10.222.0.124 () {56 vars in 1117 bytes} [Mon Aug 1 16:40:26 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:26.672789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5febaf-d001-4343-a465-b273dc69db09 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:26.701609 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74becc-884a-43eb-b8dd-0c1298207010 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:26.749244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921a097-e5b2-4bd4-818a-f7ffe74e7007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:26.750209 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921a097-e5b2-4bd4-818a-f7ffe74e7007 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:26.750613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921a097-e5b2-4bd4-818a-f7ffe74e7007 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:26.751272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921a097-e5b2-4bd4-818a-f7ffe74e7007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:26.752429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921a097-e5b2-4bd4-818a-f7ffe74e7007 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:26.754196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921a097-e5b2-4bd4-818a-f7ffe74e7007 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:26.778281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 502/1015] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:40:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:40:26.857950 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:26.881117 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5febaf-d001-4343-a465-b273dc69db09 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:26.971890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620c7bc-9366-483e-bf5b-5239aa8806be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:26.972914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c7bc-9366-483e-bf5b-5239aa8806be None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:26.973352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c7bc-9366-483e-bf5b-5239aa8806be None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:26.973834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c7bc-9366-483e-bf5b-5239aa8806be None admin] PATH_INFO: `/v3/endpoints` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:26.975335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620c7bc-9366-483e-bf5b-5239aa8806be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:26.977767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620c7bc-9366-483e-bf5b-5239aa8806be None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:27.012798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 514/1016] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:40:26 2022] POST /identity/v3/endpoints => generated 336 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:40:27.451941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e15cc-21e6-4079-81dd-82954934d3ed None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:27.452324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e15cc-21e6-4079-81dd-82954934d3ed None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:27.452510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e15cc-21e6-4079-81dd-82954934d3ed None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:27.454506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 503/1017] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:27.460293 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbc06b-d7dd-4c5c-ba45-858743d76b47 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:27.460584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbc06b-d7dd-4c5c-ba45-858743d76b47 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:27.461011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbc06b-d7dd-4c5c-ba45-858743d76b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:27.490770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-67bbc06b-d7dd-4c5c-ba45-858743d76b47 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:27.493058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-67bbc06b-d7dd-4c5c-ba45-858743d76b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:27.661266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 515/1018] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:27 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:27.701805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e15cc-21e6-4079-81dd-82954934d3ed None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:27.765601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:27.919451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e15cc-21e6-4079-81dd-82954934d3ed None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:27.991133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c0c9a-539e-46d5-b3bf-e7cd4e7db4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:27.992231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0c9a-539e-46d5-b3bf-e7cd4e7db4ec None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:27.992707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0c9a-539e-46d5-b3bf-e7cd4e7db4ec None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:27.993161 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0c9a-539e-46d5-b3bf-e7cd4e7db4ec None admin] PATH_INFO: `/v3/services/image` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:27.994311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c0c9a-539e-46d5-b3bf-e7cd4e7db4ec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:27.997009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c0c9a-539e-46d5-b3bf-e7cd4e7db4ec None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-3d6c0c9a-539e-46d5-b3bf-e7cd4e7db4ec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:28.014849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:28.017298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:40:28.019616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:28.023290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 504/1019] 10.222.0.124 () {56 vars in 1110 bytes} [Mon Aug 1 16:40:27 2022] GET /identity/v3/services/image => generated 86 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:28.027710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbc06b-d7dd-4c5c-ba45-858743d76b47 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:28.162185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:28.223731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbc06b-d7dd-4c5c-ba45-858743d76b47 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:28.274825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1c5fb-a601-47ed-9aa4-d0a905a74c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:28.275490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1c5fb-a601-47ed-9aa4-d0a905a74c03 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:28.275774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1c5fb-a601-47ed-9aa4-d0a905a74c03 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:28.276046 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1c5fb-a601-47ed-9aa4-d0a905a74c03 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:28.276777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1c5fb-a601-47ed-9aa4-d0a905a74c03 None admin] RBAC: Adding query filter params (name=image) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:28.277095 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1c5fb-a601-47ed-9aa4-d0a905a74c03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:28.279062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1c5fb-a601-47ed-9aa4-d0a905a74c03 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:28.285804 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 516/1020] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:28 2022] GET /identity/v3/services?name=image => generated 123 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:28.292729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c0c9a-539e-46d5-b3bf-e7cd4e7db4ec None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:28.462929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:28.478928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c0c9a-539e-46d5-b3bf-e7cd4e7db4ec None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:28.570607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4473c3-3877-4013-80cf-ee7ff647218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:28.571592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4473c3-3877-4013-80cf-ee7ff647218b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:28.572081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4473c3-3877-4013-80cf-ee7ff647218b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:28.572569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4473c3-3877-4013-80cf-ee7ff647218b None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:28.573842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4473c3-3877-4013-80cf-ee7ff647218b None admin] RBAC: Adding query filter params (type=image) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:28.575149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4473c3-3877-4013-80cf-ee7ff647218b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:28.578481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4473c3-3877-4013-80cf-ee7ff647218b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:28.595033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 505/1021] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:28 2022] GET /identity/v3/services?type=image => generated 352 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:28.599740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1c5fb-a601-47ed-9aa4-d0a905a74c03 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:28.794304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1c5fb-a601-47ed-9aa4-d0a905a74c03 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:28.854699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:28.866003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6c329-e1d9-4ac2-bd1e-d1e849c135f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:28.867113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6c329-e1d9-4ac2-bd1e-d1e849c135f3 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:28.867593 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6c329-e1d9-4ac2-bd1e-d1e849c135f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:28.868041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6c329-e1d9-4ac2-bd1e-d1e849c135f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:28.869316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6c329-e1d9-4ac2-bd1e-d1e849c135f3 None admin] RBAC: Adding query filter params (interface=public, service_id=ed75832a671541a190dcbc14618f86e1, region_id=RegionOne) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:28.869802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6c329-e1d9-4ac2-bd1e-d1e849c135f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:28.872484 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6c329-e1d9-4ac2-bd1e-d1e849c135f3 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:28.887000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 517/1022] 10.222.0.124 () {56 vars in 1256 bytes} [Mon Aug 1 16:40:28 2022] GET /identity/v3/endpoints?service_id=ed75832a671541a190dcbc14618f86e1&interface=public®ion_id=RegionOne => generated 195 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:28.893905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4473c3-3877-4013-80cf-ee7ff647218b None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:29.087483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4473c3-3877-4013-80cf-ee7ff647218b None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:29.154154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913fd93-8a3e-4e2e-a578-ae4d120f6986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:29.155024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913fd93-8a3e-4e2e-a578-ae4d120f6986 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:29.155404 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913fd93-8a3e-4e2e-a578-ae4d120f6986 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:29.155876 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913fd93-8a3e-4e2e-a578-ae4d120f6986 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:29.157074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913fd93-8a3e-4e2e-a578-ae4d120f6986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:29.159316 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913fd93-8a3e-4e2e-a578-ae4d120f6986 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:29.179049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 506/1023] 10.222.0.124 () {56 vars in 1092 bytes} [Mon Aug 1 16:40:28 2022] GET /identity/v3/services => generated 1966 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:40:29.290195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994762-a6b4-4ebe-8aff-4f8a71ee2e7e None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:29.290731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994762-a6b4-4ebe-8aff-4f8a71ee2e7e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:29.291275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994762-a6b4-4ebe-8aff-4f8a71ee2e7e None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:29.294151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 518/1024] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:29 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:40:29.301766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bd12d-866e-44cd-a7d8-b33ed894f71a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:29.302362 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bd12d-866e-44cd-a7d8-b33ed894f71a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:29.302908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bd12d-866e-44cd-a7d8-b33ed894f71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:29.336879 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1f5bd12d-866e-44cd-a7d8-b33ed894f71a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:29.339620 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1f5bd12d-866e-44cd-a7d8-b33ed894f71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:29.376735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:29.477831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 507/1025] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:29 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:29.515793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38994762-a6b4-4ebe-8aff-4f8a71ee2e7e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:29.562867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad2ea4-040c-4de1-8c41-13da439de679 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:29.563393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad2ea4-040c-4de1-8c41-13da439de679 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:29.563852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad2ea4-040c-4de1-8c41-13da439de679 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:29.566506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 508/1026] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:29 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:29.572826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156a91-1879-4265-8611-3e74155350ea None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:29.573129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156a91-1879-4265-8611-3e74155350ea None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:29.573500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9156a91-1879-4265-8611-3e74155350ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:29.602720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b9156a91-1879-4265-8611-3e74155350ea None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:29.604077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b9156a91-1879-4265-8611-3e74155350ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:29.699301 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 509/1027] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:29 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:29.705411 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38994762-a6b4-4ebe-8aff-4f8a71ee2e7e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:29.724814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9156a91-1879-4265-8611-3e74155350ea None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:29.760315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b6bdc-c13b-4dac-9c36-b1126fd93c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:29.760987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b6bdc-c13b-4dac-9c36-b1126fd93c5e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:29.761270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b6bdc-c13b-4dac-9c36-b1126fd93c5e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:29.761596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b6bdc-c13b-4dac-9c36-b1126fd93c5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:29.763396 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b6bdc-c13b-4dac-9c36-b1126fd93c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:29.764908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b6bdc-c13b-4dac-9c36-b1126fd93c5e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:29.766664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 519/1028] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:29 2022] GET /identity/v3/domains/default => generated 200 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:29.773238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b6bdc-c13b-4dac-9c36-b1126fd93c5e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:29.880900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:29.890434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:29.917412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9156a91-1879-4265-8611-3e74155350ea None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:29.941014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b6bdc-c13b-4dac-9c36-b1126fd93c5e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:29.982244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0fba8-9bdd-4919-b4a1-3c77fdc3be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:29.983368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0fba8-9bdd-4919-b4a1-3c77fdc3be9e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:29.983502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe5bd-7606-4721-9e54-3bb9fb677a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:29.983863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0fba8-9bdd-4919-b4a1-3c77fdc3be9e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:29.984102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe5bd-7606-4721-9e54-3bb9fb677a47 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:29.984338 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0fba8-9bdd-4919-b4a1-3c77fdc3be9e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:29.984436 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe5bd-7606-4721-9e54-3bb9fb677a47 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:29.984682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe5bd-7606-4721-9e54-3bb9fb677a47 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:29.985354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fe5bd-7606-4721-9e54-3bb9fb677a47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:29.986834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fe5bd-7606-4721-9e54-3bb9fb677a47 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:30.000202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0fba8-9bdd-4919-b4a1-3c77fdc3be9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-35c0fba8-9bdd-4919-b4a1-3c77fdc3be9e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:40:30.005708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:30.007602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:30.009245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:30.011474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 510/1029] 10.222.0.124 () {56 vars in 1125 bytes} [Mon Aug 1 16:40:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:30.013769 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0fba8-9bdd-4919-b4a1-3c77fdc3be9e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:30.043078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 520/1030] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:40:29 2022] POST /identity/v3/projects => generated 312 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:40:30.184437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0fba8-9bdd-4919-b4a1-3c77fdc3be9e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:30.235458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c295cd-0c4a-4d7a-b285-c06ec0c15182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:30.236353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c295cd-0c4a-4d7a-b285-c06ec0c15182 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:30.236805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c295cd-0c4a-4d7a-b285-c06ec0c15182 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:30.237257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c295cd-0c4a-4d7a-b285-c06ec0c15182 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:30.238232 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c295cd-0c4a-4d7a-b285-c06ec0c15182 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:30.238678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c295cd-0c4a-4d7a-b285-c06ec0c15182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:30.240859 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c295cd-0c4a-4d7a-b285-c06ec0c15182 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:30.254079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 511/1031] 10.222.0.124 () {56 vars in 1120 bytes} [Mon Aug 1 16:40:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:30.260436 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe5bd-7606-4721-9e54-3bb9fb677a47 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:30.439732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe5bd-7606-4721-9e54-3bb9fb677a47 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:30.472433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:30.512813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85972c23-0b7e-4d4e-bd84-6086bde1dabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:30.512813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85972c23-0b7e-4d4e-bd84-6086bde1dabe None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:30.514496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85972c23-0b7e-4d4e-bd84-6086bde1dabe None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:30.514838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85972c23-0b7e-4d4e-bd84-6086bde1dabe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:30.528175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85972c23-0b7e-4d4e-bd84-6086bde1dabe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:30.529721 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85972c23-0b7e-4d4e-bd84-6086bde1dabe None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-85972c23-0b7e-4d4e-bd84-6086bde1dabe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:30.550782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:30.556557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:30.558712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:30.558712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:30.558712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:30.558712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:30.558712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 521/1032] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:30.562816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c295cd-0c4a-4d7a-b285-c06ec0c15182 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:30.571739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:30.767881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c295cd-0c4a-4d7a-b285-c06ec0c15182 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:30.832423 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955f637-5d4d-48d4-b13e-22602935ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:30.833525 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955f637-5d4d-48d4-b13e-22602935ca9d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:30.833910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955f637-5d4d-48d4-b13e-22602935ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:30.834372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955f637-5d4d-48d4-b13e-22602935ca9d None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:30.835635 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955f637-5d4d-48d4-b13e-22602935ca9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:30.836135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955f637-5d4d-48d4-b13e-22602935ca9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:30.838791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955f637-5d4d-48d4-b13e-22602935ca9d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:30.866335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 512/1033] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:30.868712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85972c23-0b7e-4d4e-bd84-6086bde1dabe None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:31.076306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85972c23-0b7e-4d4e-bd84-6086bde1dabe None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:31.148228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffce27-e0e7-4cbc-8483-403e2583d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:31.149478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffce27-e0e7-4cbc-8483-403e2583d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:31.150074 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffce27-e0e7-4cbc-8483-403e2583d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:31.150565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffce27-e0e7-4cbc-8483-403e2583d0d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:31.165975 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffce27-e0e7-4cbc-8483-403e2583d0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:31.168942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffce27-e0e7-4cbc-8483-403e2583d0d8 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-6dffce27-e0e7-4cbc-8483-403e2583d0d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:40:31.192624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:31.194052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:31.196622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:31.196622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:31.196622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:40:31.196622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:40:31.196622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:40:31.196622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:40:31.196622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:40:31.196622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:40:31.196622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:40:31.196622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:31.196622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 522/1034] 10.222.0.124 () {56 vars in 1098 bytes} [Mon Aug 1 16:40:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:31.203106 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955f637-5d4d-48d4-b13e-22602935ca9d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:31.322206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:31.397699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955f637-5d4d-48d4-b13e-22602935ca9d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:31.475860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13537b9a-c9e5-4059-a8dc-6f573ddeea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:31.476921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537b9a-c9e5-4059-a8dc-6f573ddeea08 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:31.477388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537b9a-c9e5-4059-a8dc-6f573ddeea08 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:31.477859 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537b9a-c9e5-4059-a8dc-6f573ddeea08 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:31.479311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13537b9a-c9e5-4059-a8dc-6f573ddeea08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:31.479834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13537b9a-c9e5-4059-a8dc-6f573ddeea08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:31.482858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13537b9a-c9e5-4059-a8dc-6f573ddeea08 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:31.522939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 513/1035] 10.222.0.124 () {56 vars in 1138 bytes} [Mon Aug 1 16:40:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:31.525041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffce27-e0e7-4cbc-8483-403e2583d0d8 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:31.579808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:31.676844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffce27-e0e7-4cbc-8483-403e2583d0d8 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:31.718835 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9aeec-aa69-42ac-ad03-efc95ba1e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:31.719521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9aeec-aa69-42ac-ad03-efc95ba1e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:31.719798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9aeec-aa69-42ac-ad03-efc95ba1e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:31.720069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9aeec-aa69-42ac-ad03-efc95ba1e1f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:31.837345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9aeec-aa69-42ac-ad03-efc95ba1e1f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:31.840214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9aeec-aa69-42ac-ad03-efc95ba1e1f2 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:31.888723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca509-e30a-4a15-83ab-431d99521d1e None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:31.889089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca509-e30a-4a15-83ab-431d99521d1e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:31.889273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca509-e30a-4a15-83ab-431d99521d1e None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:31.891319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:31.895168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 514/1036] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:31 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:31.896722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f26ac-2a1e-42b9-9065-4cdc1558429e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:31.896950 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f26ac-2a1e-42b9-9065-4cdc1558429e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:31.897231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f26ac-2a1e-42b9-9065-4cdc1558429e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:31.924453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b41f26ac-2a1e-42b9-9065-4cdc1558429e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:31.925976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b41f26ac-2a1e-42b9-9065-4cdc1558429e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:32.021498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 515/1037] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:31 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:32.023030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 523/1038] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:40:31 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:40:32.034294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f26ac-2a1e-42b9-9065-4cdc1558429e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:32.046136 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9aeec-aa69-42ac-ad03-efc95ba1e1f2 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:32.144798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:32.184855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9aeec-aa69-42ac-ad03-efc95ba1e1f2 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:32.221411 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:32.233391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c2fd6-f726-4b48-a1b1-9074c4833f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:32.234388 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c2fd6-f726-4b48-a1b1-9074c4833f8b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:32.234776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c2fd6-f726-4b48-a1b1-9074c4833f8b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:32.234931 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c2fd6-f726-4b48-a1b1-9074c4833f8b None admin] PATH_INFO: `/v3/services/image` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:32.235671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c2fd6-f726-4b48-a1b1-9074c4833f8b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:32.237112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c2fd6-f726-4b48-a1b1-9074c4833f8b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-093c2fd6-f726-4b48-a1b1-9074c4833f8b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:32.247833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:32.249859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:32.252146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 524/1039] 10.222.0.124 () {56 vars in 1110 bytes} [Mon Aug 1 16:40:32 2022] GET /identity/v3/services/image => generated 86 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:32.256129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c2fd6-f726-4b48-a1b1-9074c4833f8b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:32.264776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f26ac-2a1e-42b9-9065-4cdc1558429e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:32.322359 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385fc08-6c42-439d-8942-ec49827448fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:32.323487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385fc08-6c42-439d-8942-ec49827448fa None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:32.323801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385fc08-6c42-439d-8942-ec49827448fa None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:32.324514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385fc08-6c42-439d-8942-ec49827448fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:32.340500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385fc08-6c42-439d-8942-ec49827448fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:32.343606 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385fc08-6c42-439d-8942-ec49827448fa None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-f385fc08-6c42-439d-8942-ec49827448fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:32.373935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:32.374921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:32.376147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:32.376147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:32.376147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:32.376147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:32.376870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 516/1040] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:32.387917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385fc08-6c42-439d-8942-ec49827448fa None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:32.428840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c2fd6-f726-4b48-a1b1-9074c4833f8b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:32.476555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de191-a2f8-4409-9228-bbcbd56f9c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:32.477198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de191-a2f8-4409-9228-bbcbd56f9c93 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:32.477490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de191-a2f8-4409-9228-bbcbd56f9c93 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:32.477734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de191-a2f8-4409-9228-bbcbd56f9c93 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:32.478463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8de191-a2f8-4409-9228-bbcbd56f9c93 None admin] RBAC: Adding query filter params (name=image) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:32.478770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8de191-a2f8-4409-9228-bbcbd56f9c93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:32.480651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8de191-a2f8-4409-9228-bbcbd56f9c93 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:32.496088 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 525/1041] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:32 2022] GET /identity/v3/services?name=image => generated 123 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:32.499990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de191-a2f8-4409-9228-bbcbd56f9c93 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:32.578113 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385fc08-6c42-439d-8942-ec49827448fa None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:32.582721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:32.617430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:32.625715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c9df4-f827-496b-b32f-a90b871e8958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:32.626463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c9df4-f827-496b-b32f-a90b871e8958 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:32.626805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c9df4-f827-496b-b32f-a90b871e8958 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:32.627189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c9df4-f827-496b-b32f-a90b871e8958 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:32.628093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c9df4-f827-496b-b32f-a90b871e8958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:32.628477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c9df4-f827-496b-b32f-a90b871e8958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:32.630371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c9df4-f827-496b-b32f-a90b871e8958 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:32.649954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 517/1042] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:32.649954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9d76-8b6b-4bdb-902e-e3c79fda70f9 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:32.649954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9d76-8b6b-4bdb-902e-e3c79fda70f9 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:32.649954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9d76-8b6b-4bdb-902e-e3c79fda70f9 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:32.649954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 518/1043] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:32.652100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc9d76-8b6b-4bdb-902e-e3c79fda70f9 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:32.693042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de191-a2f8-4409-9228-bbcbd56f9c93 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:32.744224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ad41-e713-4f87-ab22-2e6c79b6bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:32.745019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ad41-e713-4f87-ab22-2e6c79b6bd35 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:32.745454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ad41-e713-4f87-ab22-2e6c79b6bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:32.745845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ad41-e713-4f87-ab22-2e6c79b6bd35 None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:32.746732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7ad41-e713-4f87-ab22-2e6c79b6bd35 None admin] RBAC: Adding query filter params (type=image) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:32.747178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7ad41-e713-4f87-ab22-2e6c79b6bd35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:32.748778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7ad41-e713-4f87-ab22-2e6c79b6bd35 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:32.754905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 526/1044] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:32 2022] GET /identity/v3/services?type=image => generated 352 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:32.756434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ca2a5-725f-4c2b-8134-6e0f41bc941b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:32.756733 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ca2a5-725f-4c2b-8134-6e0f41bc941b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:32.757010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ca2a5-725f-4c2b-8134-6e0f41bc941b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:32.777007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-180ca2a5-725f-4c2b-8134-6e0f41bc941b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:32.778285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-180ca2a5-725f-4c2b-8134-6e0f41bc941b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:32.790541 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc9d76-8b6b-4bdb-902e-e3c79fda70f9 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:32.834269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761e4f2-1dce-487e-adb8-23caa7449a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:32.834934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761e4f2-1dce-487e-adb8-23caa7449a7f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:32.835297 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761e4f2-1dce-487e-adb8-23caa7449a7f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:32.835613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761e4f2-1dce-487e-adb8-23caa7449a7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:32.844888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761e4f2-1dce-487e-adb8-23caa7449a7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:32.846681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761e4f2-1dce-487e-adb8-23caa7449a7f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-2761e4f2-1dce-487e-adb8-23caa7449a7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:40:32.860411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:32.862484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:32.864738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:40:32.864738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:40:32.864738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:40:32.864738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:40:32.864738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:40:32.864738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:40:32.864738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:32.864738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:32.864738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 519/1045] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:32.864738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761e4f2-1dce-487e-adb8-23caa7449a7f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:32.885096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 527/1046] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:32 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:32.885988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ca2a5-725f-4c2b-8134-6e0f41bc941b None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:32.902108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:32.958498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:33.005970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761e4f2-1dce-487e-adb8-23caa7449a7f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:33.027636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ca2a5-725f-4c2b-8134-6e0f41bc941b None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:33.045687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd8819-6a3c-450f-aab5-fcbb55e8aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:33.046334 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd8819-6a3c-450f-aab5-fcbb55e8aae4 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:33.046614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd8819-6a3c-450f-aab5-fcbb55e8aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:33.046889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd8819-6a3c-450f-aab5-fcbb55e8aae4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:33.047930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd8819-6a3c-450f-aab5-fcbb55e8aae4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:33.049361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd8819-6a3c-450f-aab5-fcbb55e8aae4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:33.074659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 520/1047] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:40:32 2022] POST /identity/v3/endpoints => generated 329 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:40:33.075605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd8819-6a3c-450f-aab5-fcbb55e8aae4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:33.105617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79de790-4ee5-4020-87d9-8809d1dfd5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:33.106616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de790-4ee5-4020-87d9-8809d1dfd5ed None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:33.107104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de790-4ee5-4020-87d9-8809d1dfd5ed None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:33.107524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de790-4ee5-4020-87d9-8809d1dfd5ed None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:33.108816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79de790-4ee5-4020-87d9-8809d1dfd5ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:33.109284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79de790-4ee5-4020-87d9-8809d1dfd5ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:33.111861 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79de790-4ee5-4020-87d9-8809d1dfd5ed None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:33.133853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 528/1048] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:33.143812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79de790-4ee5-4020-87d9-8809d1dfd5ed None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:33.198547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:33.228902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd8819-6a3c-450f-aab5-fcbb55e8aae4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:33.297984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a114a-b6aa-4b17-8eea-3149529a761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:33.299242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a114a-b6aa-4b17-8eea-3149529a761c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:33.299440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a114a-b6aa-4b17-8eea-3149529a761c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:33.299821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a114a-b6aa-4b17-8eea-3149529a761c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:33.301378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a114a-b6aa-4b17-8eea-3149529a761c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:33.304141 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a114a-b6aa-4b17-8eea-3149529a761c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:33.307546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 521/1049] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:33.315565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79de790-4ee5-4020-87d9-8809d1dfd5ed None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:33.318184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a114a-b6aa-4b17-8eea-3149529a761c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:33.328879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:33.370022 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf229b-53c4-4bbf-b70c-7a059833ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:33.371137 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf229b-53c4-4bbf-b70c-7a059833ff61 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:33.371137 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf229b-53c4-4bbf-b70c-7a059833ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:33.371913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf229b-53c4-4bbf-b70c-7a059833ff61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:33.373146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf229b-53c4-4bbf-b70c-7a059833ff61 None admin] RBAC: Adding query filter params (role.id=e30f4d3046084825ac1b052687c77151, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=9728f2fe7b5a40cd9f8ead5cf99af581) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:33.373620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf229b-53c4-4bbf-b70c-7a059833ff61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:33.375822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf229b-53c4-4bbf-b70c-7a059833ff61 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:33.387013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 529/1050] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:40:33 2022] GET /identity/v3/role_assignments?user.id=9728f2fe7b5a40cd9f8ead5cf99af581&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=e30f4d3046084825ac1b052687c77151 => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:33.526914 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a114a-b6aa-4b17-8eea-3149529a761c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:33.592243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ca57a-3710-456b-aaf0-e97df5cd7fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:33.594140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ca57a-3710-456b-aaf0-e97df5cd7fb8 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:33.594941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ca57a-3710-456b-aaf0-e97df5cd7fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:33.595672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ca57a-3710-456b-aaf0-e97df5cd7fb8 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:33.597169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ca57a-3710-456b-aaf0-e97df5cd7fb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:33.600255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ca57a-3710-456b-aaf0-e97df5cd7fb8 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:33.644828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 522/1051] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:40:33 2022] POST /identity/v3/users => generated 286 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:40:35.459634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40cc0f-7ac5-4528-85c6-a3429ea20c5a None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:35.460281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40cc0f-7ac5-4528-85c6-a3429ea20c5a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:35.460281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40cc0f-7ac5-4528-85c6-a3429ea20c5a None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:35.461880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 530/1052] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:35.468120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeccb6-d763-4840-a62d-5f15b4cc28b9 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:35.468703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeccb6-d763-4840-a62d-5f15b4cc28b9 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:35.468703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeccb6-d763-4840-a62d-5f15b4cc28b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:35.477204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:35.506333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-9efeccb6-d763-4840-a62d-5f15b4cc28b9 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:35.507916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9efeccb6-d763-4840-a62d-5f15b4cc28b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:35.536247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148ba7-4a06-46ae-8b24-becd481f0ef8 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:35.536520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148ba7-4a06-46ae-8b24-becd481f0ef8 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:35.536625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148ba7-4a06-46ae-8b24-becd481f0ef8 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:35.538398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 531/1053] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:35.545311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d49c2-a02e-478b-8de7-3e3fd97a1dd3 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:35.546435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d49c2-a02e-478b-8de7-3e3fd97a1dd3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:35.547379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d49c2-a02e-478b-8de7-3e3fd97a1dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:35.575045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-b96d49c2-a02e-478b-8de7-3e3fd97a1dd3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:35.577565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b96d49c2-a02e-478b-8de7-3e3fd97a1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:35.600142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 523/1054] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:35 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:35.622536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeccb6-d763-4840-a62d-5f15b4cc28b9 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:35.673750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 532/1055] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:35 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:35.696827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d49c2-a02e-478b-8de7-3e3fd97a1dd3 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:35.741775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeccb6-d763-4840-a62d-5f15b4cc28b9 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:35.783982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d147c-9f92-476b-afd3-28adfc0b5e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:35.784721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d147c-9f92-476b-afd3-28adfc0b5e22 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:35.785004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d147c-9f92-476b-afd3-28adfc0b5e22 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:35.785281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d147c-9f92-476b-afd3-28adfc0b5e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:35.788473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:35.821047 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:35.825622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d49c2-a02e-478b-8de7-3e3fd97a1dd3 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:35.869821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13d78-b277-4388-acbf-80d37fdcc668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:35.870194 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d147c-9f92-476b-afd3-28adfc0b5e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:35.870583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13d78-b277-4388-acbf-80d37fdcc668 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:35.870860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13d78-b277-4388-acbf-80d37fdcc668 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:35.871176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13d78-b277-4388-acbf-80d37fdcc668 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:35.872552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d147c-9f92-476b-afd3-28adfc0b5e22 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:35.884565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e13d78-b277-4388-acbf-80d37fdcc668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-02e13d78-b277-4388-acbf-80d37fdcc668 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:40:35.890312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:35.891407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:35.892276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 533/1056] 10.222.0.124 () {56 vars in 1125 bytes} [Mon Aug 1 16:40:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:35.898385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13d78-b277-4388-acbf-80d37fdcc668 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:36.008528 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 524/1057] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:40:35 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:40:36.009767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc375-f28b-4e35-862c-4841441c64fd None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:36.010057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc375-f28b-4e35-862c-4841441c64fd None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:36.010335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc375-f28b-4e35-862c-4841441c64fd None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:36.011873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 525/1058] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:36.015591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc375-f28b-4e35-862c-4841441c64fd None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:36.039563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13d78-b277-4388-acbf-80d37fdcc668 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:36.058762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:36.080594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0ca4f-d622-4ed8-a09a-73a49b04c439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:36.081246 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ca4f-d622-4ed8-a09a-73a49b04c439 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:36.081525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ca4f-d622-4ed8-a09a-73a49b04c439 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:36.081797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ca4f-d622-4ed8-a09a-73a49b04c439 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:36.082556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0ca4f-d622-4ed8-a09a-73a49b04c439 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:36.082861 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0ca4f-d622-4ed8-a09a-73a49b04c439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:36.084352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0ca4f-d622-4ed8-a09a-73a49b04c439 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:36.094321 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 534/1059] 10.222.0.124 () {56 vars in 1120 bytes} [Mon Aug 1 16:40:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:36.095828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5bd90-09bb-4588-adaf-ab097bf75a43 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:36.096122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5bd90-09bb-4588-adaf-ab097bf75a43 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:36.096398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5bd90-09bb-4588-adaf-ab097bf75a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:36.117083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-b2f5bd90-09bb-4588-adaf-ab097bf75a43 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:36.118354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b2f5bd90-09bb-4588-adaf-ab097bf75a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:36.138630 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:36.143882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc375-f28b-4e35-862c-4841441c64fd None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:36.186178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd9bc5-2687-40ae-a952-03636aadda29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:36.186984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9bc5-2687-40ae-a952-03636aadda29 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:36.187265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9bc5-2687-40ae-a952-03636aadda29 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:36.187557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9bc5-2687-40ae-a952-03636aadda29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:36.199184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd9bc5-2687-40ae-a952-03636aadda29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:36.200873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd9bc5-2687-40ae-a952-03636aadda29 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:36.204476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 535/1060] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:36 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:36.206544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5bd90-09bb-4588-adaf-ab097bf75a43 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-95fd9bc5-2687-40ae-a952-03636aadda29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:36.219028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:36.220835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:36.222379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:36.222379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:36.222379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:36.222379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:36.224001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 526/1061] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:36.226735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd9bc5-2687-40ae-a952-03636aadda29 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:36.342418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:36.346317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5bd90-09bb-4588-adaf-ab097bf75a43 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:36.364429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd9bc5-2687-40ae-a952-03636aadda29 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:36.395026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abcf6-6c08-45c1-bb7e-45c787c08c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:36.395872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abcf6-6c08-45c1-bb7e-45c787c08c6a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:36.396270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abcf6-6c08-45c1-bb7e-45c787c08c6a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:36.396673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abcf6-6c08-45c1-bb7e-45c787c08c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:36.410699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234abcf6-6c08-45c1-bb7e-45c787c08c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:36.412396 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234abcf6-6c08-45c1-bb7e-45c787c08c6a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:36.425613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcac0fd-3273-4d70-9dae-afcc68aa8bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:36.426627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcac0fd-3273-4d70-9dae-afcc68aa8bb4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:36.427141 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcac0fd-3273-4d70-9dae-afcc68aa8bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:36.427606 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcac0fd-3273-4d70-9dae-afcc68aa8bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:36.428868 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcac0fd-3273-4d70-9dae-afcc68aa8bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:36.429395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcac0fd-3273-4d70-9dae-afcc68aa8bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-234abcf6-6c08-45c1-bb7e-45c787c08c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:36.429744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:36.431486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:36.433741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:36.433741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:36.433741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:36.433741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:36.433741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 536/1062] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:36.433741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abcf6-6c08-45c1-bb7e-45c787c08c6a None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:36.434700 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcac0fd-3273-4d70-9dae-afcc68aa8bb4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:36.443055 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:36.454594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 527/1063] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:36.455718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcac0fd-3273-4d70-9dae-afcc68aa8bb4 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:36.631252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcac0fd-3273-4d70-9dae-afcc68aa8bb4 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:36.657393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abcf6-6c08-45c1-bb7e-45c787c08c6a None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:36.690926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7cdc6-1a57-4b38-a2df-495cc0855493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:36.691958 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7cdc6-1a57-4b38-a2df-495cc0855493 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:36.692313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7cdc6-1a57-4b38-a2df-495cc0855493 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:36.692681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7cdc6-1a57-4b38-a2df-495cc0855493 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:36.693748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7cdc6-1a57-4b38-a2df-495cc0855493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:36.694267 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7cdc6-1a57-4b38-a2df-495cc0855493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:36.696323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7cdc6-1a57-4b38-a2df-495cc0855493 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:36.718013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 528/1064] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:36.725438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7cdc6-1a57-4b38-a2df-495cc0855493 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:36.730654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0a54d-7914-4fcd-b10d-3e770f3a8e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:36.733424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0a54d-7914-4fcd-b10d-3e770f3a8e30 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:36.733921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0a54d-7914-4fcd-b10d-3e770f3a8e30 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:36.734392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0a54d-7914-4fcd-b10d-3e770f3a8e30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:36.741528 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:36.757234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0a54d-7914-4fcd-b10d-3e770f3a8e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-bbf0a54d-7914-4fcd-b10d-3e770f3a8e30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:40:36.764825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:36.766637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:36.769115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 537/1065] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:36.775628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0a54d-7914-4fcd-b10d-3e770f3a8e30 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:36.887435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:36.905421 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7cdc6-1a57-4b38-a2df-495cc0855493 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:36.936254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0a54d-7914-4fcd-b10d-3e770f3a8e30 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:36.965579 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358ce76-03c9-4756-8c20-b2f215b38f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:36.966262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358ce76-03c9-4756-8c20-b2f215b38f3d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:36.966543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358ce76-03c9-4756-8c20-b2f215b38f3d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:36.966817 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358ce76-03c9-4756-8c20-b2f215b38f3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:36.976348 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358ce76-03c9-4756-8c20-b2f215b38f3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:36.977858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358ce76-03c9-4756-8c20-b2f215b38f3d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:36.978591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a846bd0-c762-40fb-8ef9-070482c2a173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:36.979371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a846bd0-c762-40fb-8ef9-070482c2a173 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:36.979832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a846bd0-c762-40fb-8ef9-070482c2a173 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:36.980170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a846bd0-c762-40fb-8ef9-070482c2a173 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:36.981009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a846bd0-c762-40fb-8ef9-070482c2a173 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:36.981496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a846bd0-c762-40fb-8ef9-070482c2a173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:36.983219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a846bd0-c762-40fb-8ef9-070482c2a173 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-f358ce76-03c9-4756-8c20-b2f215b38f3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:40:36.991468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:36.993386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:36.995379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:36.995379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:36.995379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:40:36.995379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:40:36.995379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:40:36.995379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:40:36.995379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:40:36.995379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:40:36.995379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:40:36.995379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:36.995379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 529/1066] 10.222.0.124 () {56 vars in 1098 bytes} [Mon Aug 1 16:40:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:36.996797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 538/1067] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:40:36 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:36.999138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358ce76-03c9-4756-8c20-b2f215b38f3d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:37.001468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a846bd0-c762-40fb-8ef9-070482c2a173 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:37.076636 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:37.128983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358ce76-03c9-4756-8c20-b2f215b38f3d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:37.162849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a846bd0-c762-40fb-8ef9-070482c2a173 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:37.187223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589b77e-445a-454a-8e3c-4a78991a8838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:37.188284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589b77e-445a-454a-8e3c-4a78991a8838 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:37.188782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589b77e-445a-454a-8e3c-4a78991a8838 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:37.189237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589b77e-445a-454a-8e3c-4a78991a8838 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:37.190714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589b77e-445a-454a-8e3c-4a78991a8838 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:37.191290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589b77e-445a-454a-8e3c-4a78991a8838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:37.194111 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589b77e-445a-454a-8e3c-4a78991a8838 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:37.197639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:37.209509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630908f5-b2bc-47e5-907d-21d67cbf9257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:37.210193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630908f5-b2bc-47e5-907d-21d67cbf9257 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:37.210477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630908f5-b2bc-47e5-907d-21d67cbf9257 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:37.210754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630908f5-b2bc-47e5-907d-21d67cbf9257 None admin] PATH_INFO: `/v3/users/5806881f104b4b18ac16d3c27fdb066d` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:37.220632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 530/1068] 10.222.0.124 () {56 vars in 1138 bytes} [Mon Aug 1 16:40:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:37.227248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589b77e-445a-454a-8e3c-4a78991a8838 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:37.231089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630908f5-b2bc-47e5-907d-21d67cbf9257 None admin] RBAC: Authorizing `identity:get_user(user_id=5806881f104b4b18ac16d3c27fdb066d)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:37.232727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630908f5-b2bc-47e5-907d-21d67cbf9257 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:37.234579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 539/1069] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:40:36 2022] GET /identity/v3/users/5806881f104b4b18ac16d3c27fdb066d => generated 286 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:37.241067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630908f5-b2bc-47e5-907d-21d67cbf9257 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:37.363870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630908f5-b2bc-47e5-907d-21d67cbf9257 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:37.387760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589b77e-445a-454a-8e3c-4a78991a8838 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:37.410066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f0857-4f27-406a-a3ec-80fe702ecd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:37.411179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f0857-4f27-406a-a3ec-80fe702ecd43 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:37.411671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f0857-4f27-406a-a3ec-80fe702ecd43 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:37.412159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f0857-4f27-406a-a3ec-80fe702ecd43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:37.420239 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:37.434252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74d91d-a418-457f-ac40-e50c9817ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:37.434971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d91d-a418-457f-ac40-e50c9817ea52 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:37.435283 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d91d-a418-457f-ac40-e50c9817ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:37.435570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d91d-a418-457f-ac40-e50c9817ea52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:37.447911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74d91d-a418-457f-ac40-e50c9817ea52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:37.449475 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74d91d-a418-457f-ac40-e50c9817ea52 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-3f74d91d-a418-457f-ac40-e50c9817ea52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:37.467090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:37.468379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:37.470002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:37.470002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:37.470002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:37.470002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:37.470002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 531/1070] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:37.477937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74d91d-a418-457f-ac40-e50c9817ea52 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:37.495405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:37.525080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f0857-4f27-406a-a3ec-80fe702ecd43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:37.528078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f0857-4f27-406a-a3ec-80fe702ecd43 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:37.600204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74d91d-a418-457f-ac40-e50c9817ea52 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:37.658842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d89bb-af3f-4029-b8e1-83187dcf9595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:37.659991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d89bb-af3f-4029-b8e1-83187dcf9595 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:37.660498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d89bb-af3f-4029-b8e1-83187dcf9595 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:37.660965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d89bb-af3f-4029-b8e1-83187dcf9595 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:37.662305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d89bb-af3f-4029-b8e1-83187dcf9595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:37.662879 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d89bb-af3f-4029-b8e1-83187dcf9595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:37.665569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d89bb-af3f-4029-b8e1-83187dcf9595 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:37.669392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 540/1071] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:40:37 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 16:40:37.676382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f0857-4f27-406a-a3ec-80fe702ecd43 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:37.694739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 532/1072] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:37.696075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d89bb-af3f-4029-b8e1-83187dcf9595 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:37.751652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:37.778227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:37.797079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f0857-4f27-406a-a3ec-80fe702ecd43 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:37.836071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67b669-db8e-4888-a1a2-faf204ea6608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:37.836752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67b669-db8e-4888-a1a2-faf204ea6608 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:37.837737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67b669-db8e-4888-a1a2-faf204ea6608 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:37.838024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67b669-db8e-4888-a1a2-faf204ea6608 None admin] PATH_INFO: `/v3/projects/cf519958945c4c6b95c464badafc3dd0` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:37.839676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67b669-db8e-4888-a1a2-faf204ea6608 None admin] RBAC: Authorizing `identity:get_project(project_id=cf519958945c4c6b95c464badafc3dd0)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:37.841327 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67b669-db8e-4888-a1a2-faf204ea6608 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:37.843219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 541/1073] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:40:37 2022] GET /identity/v3/projects/cf519958945c4c6b95c464badafc3dd0 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:37.854877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67b669-db8e-4888-a1a2-faf204ea6608 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:37.868359 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d89bb-af3f-4029-b8e1-83187dcf9595 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:37.912042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950c87f-d927-4a21-ae69-4d3bbde52f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:37.912940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950c87f-d927-4a21-ae69-4d3bbde52f97 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:37.913290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950c87f-d927-4a21-ae69-4d3bbde52f97 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:37.913635 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950c87f-d927-4a21-ae69-4d3bbde52f97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:37.923295 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950c87f-d927-4a21-ae69-4d3bbde52f97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:37.925343 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950c87f-d927-4a21-ae69-4d3bbde52f97 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-d950c87f-d927-4a21-ae69-4d3bbde52f97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:40:37.940617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:37.942467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:37.943695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:40:37.943695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:40:37.943695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:40:37.943695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:40:37.943695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:40:37.943695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:40:37.943695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:37.943695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:37.943695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 533/1074] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:37.949598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950c87f-d927-4a21-ae69-4d3bbde52f97 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:37.987225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67b669-db8e-4888-a1a2-faf204ea6608 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:38.031253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58ee8-a230-41a8-adc6-0aeeda886178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:38.032030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58ee8-a230-41a8-adc6-0aeeda886178 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:38.032402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58ee8-a230-41a8-adc6-0aeeda886178 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:38.032831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58ee8-a230-41a8-adc6-0aeeda886178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:38.033793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58ee8-a230-41a8-adc6-0aeeda886178 None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=cf519958945c4c6b95c464badafc3dd0, user.id=5806881f104b4b18ac16d3c27fdb066d) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:38.034203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58ee8-a230-41a8-adc6-0aeeda886178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:38.035824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58ee8-a230-41a8-adc6-0aeeda886178 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:38.042911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 542/1075] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:40:37 2022] GET /identity/v3/role_assignments?user.id=5806881f104b4b18ac16d3c27fdb066d&scope.project.id=cf519958945c4c6b95c464badafc3dd0&role.id=390e487a45f74246ba84773e8760bc7c => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:38.072144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:38.083769 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950c87f-d927-4a21-ae69-4d3bbde52f97 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:38.131473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841cdd6-ae1e-49ec-9658-7c4e89a009a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:38.132218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841cdd6-ae1e-49ec-9658-7c4e89a009a1 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:38.132564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841cdd6-ae1e-49ec-9658-7c4e89a009a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:38.132907 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841cdd6-ae1e-49ec-9658-7c4e89a009a1 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:38.133800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841cdd6-ae1e-49ec-9658-7c4e89a009a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:38.134229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841cdd6-ae1e-49ec-9658-7c4e89a009a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:38.135934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841cdd6-ae1e-49ec-9658-7c4e89a009a1 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:38.152456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 534/1076] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:38.159957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58ee8-a230-41a8-adc6-0aeeda886178 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:38.194818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:38.346096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58ee8-a230-41a8-adc6-0aeeda886178 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:38.412146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae096-5300-40b7-8060-da2b1ad48cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:38.413307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae096-5300-40b7-8060-da2b1ad48cdb None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:38.413777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae096-5300-40b7-8060-da2b1ad48cdb None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:38.414244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae096-5300-40b7-8060-da2b1ad48cdb None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/9728f2fe7b5a40cd9f8ead5cf99af581/roles/e30f4d3046084825ac1b052687c77151` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:38.418409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ae096-5300-40b7-8060-da2b1ad48cdb None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=9728f2fe7b5a40cd9f8ead5cf99af581, role_id=e30f4d3046084825ac1b052687c77151)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:38.421267 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ae096-5300-40b7-8060-da2b1ad48cdb None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:38.442690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 543/1077] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:40:38 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/9728f2fe7b5a40cd9f8ead5cf99af581/roles/e30f4d3046084825ac1b052687c77151 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:40:40.261241 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2e7de-ad5e-4fe5-b0d0-f057df86fe23 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:40.261820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2e7de-ad5e-4fe5-b0d0-f057df86fe23 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:40.262282 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2e7de-ad5e-4fe5-b0d0-f057df86fe23 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:40.264767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 535/1078] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:40 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:40.271845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae80ab1-71c7-48ca-b354-9ef4508bb53c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:40.272419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae80ab1-71c7-48ca-b354-9ef4508bb53c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:40.272740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae80ab1-71c7-48ca-b354-9ef4508bb53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:40.305126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-dae80ab1-71c7-48ca-b354-9ef4508bb53c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:40.307470 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-dae80ab1-71c7-48ca-b354-9ef4508bb53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:40.440002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 544/1079] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:40 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:40.480595 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2e7de-ad5e-4fe5-b0d0-f057df86fe23 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:40.621326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f75592-e3b0-462c-be0a-dcb2a3118bcd None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:40.621575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f75592-e3b0-462c-be0a-dcb2a3118bcd None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:40.621749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f75592-e3b0-462c-be0a-dcb2a3118bcd None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:40.623453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 545/1080] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:40.629077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde70e-0c13-49d3-86bd-bbd53a8f996b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:40.629324 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde70e-0c13-49d3-86bd-bbd53a8f996b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:40.629614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde70e-0c13-49d3-86bd-bbd53a8f996b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:40.645094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:40.652955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-d4bde70e-0c13-49d3-86bd-bbd53a8f996b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:40.655041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d4bde70e-0c13-49d3-86bd-bbd53a8f996b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:40.663471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2e7de-ad5e-4fe5-b0d0-f057df86fe23 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:40.712273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8b19a-9c51-4b84-b50e-775451f8c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:40.713090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8b19a-9c51-4b84-b50e-775451f8c8f6 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:40.713494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8b19a-9c51-4b84-b50e-775451f8c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:40.713857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8b19a-9c51-4b84-b50e-775451f8c8f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:40.727672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8b19a-9c51-4b84-b50e-775451f8c8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-16f8b19a-9c51-4b84-b50e-775451f8c8f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:40:40.733418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:40.734478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:40.735382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 536/1081] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:40.744364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8b19a-9c51-4b84-b50e-775451f8c8f6 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:40.762650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 546/1082] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:40 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:40.767114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:40.790434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bde70e-0c13-49d3-86bd-bbd53a8f996b None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:40.880116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8b19a-9c51-4b84-b50e-775451f8c8f6 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:40.919467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bde70e-0c13-49d3-86bd-bbd53a8f996b None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:40.921951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab91546-32cb-40ef-afb2-7ffce214d5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:40.922602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab91546-32cb-40ef-afb2-7ffce214d5f8 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:40.922874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab91546-32cb-40ef-afb2-7ffce214d5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:40.923239 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab91546-32cb-40ef-afb2-7ffce214d5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:40.923933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab91546-32cb-40ef-afb2-7ffce214d5f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:40.924245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab91546-32cb-40ef-afb2-7ffce214d5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:40.925689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab91546-32cb-40ef-afb2-7ffce214d5f8 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:40.938367 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 537/1083] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:40:40 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:40.945504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab91546-32cb-40ef-afb2-7ffce214d5f8 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:40.970203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5992e-c6e7-45e9-8a6e-ff60ce1008c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:40.970869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5992e-c6e7-45e9-8a6e-ff60ce1008c9 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:40.971192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5992e-c6e7-45e9-8a6e-ff60ce1008c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:40.971463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5992e-c6e7-45e9-8a6e-ff60ce1008c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:40.974744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:40.991159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5992e-c6e7-45e9-8a6e-ff60ce1008c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-3ad5992e-c6e7-45e9-8a6e-ff60ce1008c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:40:41.001172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:41.002401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:41.003401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 547/1084] 10.222.0.124 () {56 vars in 1125 bytes} [Mon Aug 1 16:40:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:41.009924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5992e-c6e7-45e9-8a6e-ff60ce1008c9 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:41.065014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:41.094183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab91546-32cb-40ef-afb2-7ffce214d5f8 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:41.134077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fd432-61db-4265-8841-2ce3e0807ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:41.134656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd432-61db-4265-8841-2ce3e0807ccd None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:41.134928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd432-61db-4265-8841-2ce3e0807ccd None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:41.135232 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd432-61db-4265-8841-2ce3e0807ccd None admin] PATH_INFO: `/v3/users/5806881f104b4b18ac16d3c27fdb066d` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:41.136576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fd432-61db-4265-8841-2ce3e0807ccd None admin] RBAC: Authorizing `identity:get_user(user_id=5806881f104b4b18ac16d3c27fdb066d)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:41.138080 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fd432-61db-4265-8841-2ce3e0807ccd None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:41.139837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 538/1085] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:40:40 2022] GET /identity/v3/users/5806881f104b4b18ac16d3c27fdb066d => generated 286 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:41.146228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fd432-61db-4265-8841-2ce3e0807ccd None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:41.165996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5992e-c6e7-45e9-8a6e-ff60ce1008c9 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:41.229381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2bffd-7031-48cc-8e8e-4311b4ac33c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:41.230486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2bffd-7031-48cc-8e8e-4311b4ac33c1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:41.231036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2bffd-7031-48cc-8e8e-4311b4ac33c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:41.231548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2bffd-7031-48cc-8e8e-4311b4ac33c1 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:41.232986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2bffd-7031-48cc-8e8e-4311b4ac33c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:41.233558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2bffd-7031-48cc-8e8e-4311b4ac33c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:41.236344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2bffd-7031-48cc-8e8e-4311b4ac33c1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:41.251713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 548/1086] 10.222.0.124 () {56 vars in 1120 bytes} [Mon Aug 1 16:40:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:41.258228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2bffd-7031-48cc-8e8e-4311b4ac33c1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:41.267531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fd432-61db-4265-8841-2ce3e0807ccd None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:41.306421 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa548de3-acab-4d02-8004-819fb27d0490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:41.307202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa548de3-acab-4d02-8004-819fb27d0490 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:41.307483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa548de3-acab-4d02-8004-819fb27d0490 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:41.307755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa548de3-acab-4d02-8004-819fb27d0490 None admin] PATH_INFO: `/v3/projects/cf519958945c4c6b95c464badafc3dd0` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:41.309068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa548de3-acab-4d02-8004-819fb27d0490 None admin] RBAC: Authorizing `identity:get_project(project_id=cf519958945c4c6b95c464badafc3dd0)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:41.310529 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa548de3-acab-4d02-8004-819fb27d0490 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:41.312314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 539/1087] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:40:41 2022] GET /identity/v3/projects/cf519958945c4c6b95c464badafc3dd0 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:41.321101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa548de3-acab-4d02-8004-819fb27d0490 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:41.345014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:41.351434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:41.397193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2bffd-7031-48cc-8e8e-4311b4ac33c1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:41.439164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692152a-2c53-41be-85f9-b5847ebe4903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:41.439946 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692152a-2c53-41be-85f9-b5847ebe4903 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:41.440283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692152a-2c53-41be-85f9-b5847ebe4903 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:41.440614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692152a-2c53-41be-85f9-b5847ebe4903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:41.456958 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692152a-2c53-41be-85f9-b5847ebe4903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:41.459590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692152a-2c53-41be-85f9-b5847ebe4903 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-3692152a-2c53-41be-85f9-b5847ebe4903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:41.478723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:41.480672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:41.485128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:41.485128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:41.485128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:41.485128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:41.485128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 549/1088] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:41.490274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692152a-2c53-41be-85f9-b5847ebe4903 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:41.497170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa548de3-acab-4d02-8004-819fb27d0490 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:41.542115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad93793-75c5-4007-92f3-889cc505069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:41.543072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93793-75c5-4007-92f3-889cc505069d None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:41.543415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93793-75c5-4007-92f3-889cc505069d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:41.543812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93793-75c5-4007-92f3-889cc505069d None admin] PATH_INFO: `/v3/projects/cf519958945c4c6b95c464badafc3dd0/users/5806881f104b4b18ac16d3c27fdb066d/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:41.546472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad93793-75c5-4007-92f3-889cc505069d None admin] RBAC: Authorizing `identity:create_grant(project_id=cf519958945c4c6b95c464badafc3dd0, user_id=5806881f104b4b18ac16d3c27fdb066d, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:41.548247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad93793-75c5-4007-92f3-889cc505069d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:41.565591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 540/1089] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:40:41 2022] PUT /identity/v3/projects/cf519958945c4c6b95c464badafc3dd0/users/5806881f104b4b18ac16d3c27fdb066d/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:40:41.644376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692152a-2c53-41be-85f9-b5847ebe4903 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:41.659072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:41.689734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb2786-3395-4c15-aa5a-cad0363a1df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:41.690482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2786-3395-4c15-aa5a-cad0363a1df1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:41.690825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2786-3395-4c15-aa5a-cad0363a1df1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:41.691206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2786-3395-4c15-aa5a-cad0363a1df1 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:41.692077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb2786-3395-4c15-aa5a-cad0363a1df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:41.692452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb2786-3395-4c15-aa5a-cad0363a1df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:41.694077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb2786-3395-4c15-aa5a-cad0363a1df1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:41.711779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 550/1090] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:41.717981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad93793-75c5-4007-92f3-889cc505069d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:41.823107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:41.856490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad93793-75c5-4007-92f3-889cc505069d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:41.903145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06648535-fb49-4101-b4c7-e017a64ca810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:41.903867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06648535-fb49-4101-b4c7-e017a64ca810 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:41.904147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06648535-fb49-4101-b4c7-e017a64ca810 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:41.904429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06648535-fb49-4101-b4c7-e017a64ca810 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:41.913694 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06648535-fb49-4101-b4c7-e017a64ca810 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:41.915105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06648535-fb49-4101-b4c7-e017a64ca810 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-06648535-fb49-4101-b4c7-e017a64ca810 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:40:41.936929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:41.938047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:41.939074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:41.939074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:41.939074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:40:41.939074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:40:41.939074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:40:41.939074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:40:41.939074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:40:41.939074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:40:41.939074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:40:41.939074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:41.939074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 541/1091] 10.222.0.124 () {56 vars in 1098 bytes} [Mon Aug 1 16:40:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:40:41.944731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb2786-3395-4c15-aa5a-cad0363a1df1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:42.070885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb2786-3395-4c15-aa5a-cad0363a1df1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:42.112383 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaee8f-7fc0-461a-8b1c-f4964763d856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:42.113030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaee8f-7fc0-461a-8b1c-f4964763d856 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:42.113312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaee8f-7fc0-461a-8b1c-f4964763d856 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:42.113580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaee8f-7fc0-461a-8b1c-f4964763d856 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:42.114425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaee8f-7fc0-461a-8b1c-f4964763d856 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:42.114736 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaee8f-7fc0-461a-8b1c-f4964763d856 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:42.116310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaee8f-7fc0-461a-8b1c-f4964763d856 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:42.138996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 551/1092] 10.222.0.124 () {56 vars in 1138 bytes} [Mon Aug 1 16:40:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:42.145448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06648535-fb49-4101-b4c7-e017a64ca810 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:42.271854 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06648535-fb49-4101-b4c7-e017a64ca810 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:42.312931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f934e0-3bbf-409a-9d70-17d3b55ada10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:42.313579 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f934e0-3bbf-409a-9d70-17d3b55ada10 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:42.313860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f934e0-3bbf-409a-9d70-17d3b55ada10 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:42.314133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f934e0-3bbf-409a-9d70-17d3b55ada10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:42.317457 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:42.403115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f934e0-3bbf-409a-9d70-17d3b55ada10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:42.404708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f934e0-3bbf-409a-9d70-17d3b55ada10 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:42.550645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 542/1093] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:40:42 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:40:42.557730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaee8f-7fc0-461a-8b1c-f4964763d856 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:42.611649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:42.747044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaee8f-7fc0-461a-8b1c-f4964763d856 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:42.801974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afe4b7-4295-43c4-b0c1-7a55df3f597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:42.802639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe4b7-4295-43c4-b0c1-7a55df3f597e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:42.803027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe4b7-4295-43c4-b0c1-7a55df3f597e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:42.803372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe4b7-4295-43c4-b0c1-7a55df3f597e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:42.817344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afe4b7-4295-43c4-b0c1-7a55df3f597e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:42.819034 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afe4b7-4295-43c4-b0c1-7a55df3f597e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-76afe4b7-4295-43c4-b0c1-7a55df3f597e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:40:42.837503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:42.839454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:42.841144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:40:42.841144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:40:42.841144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:40:42.841144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:42.841144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 552/1094] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:42.846303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f934e0-3bbf-409a-9d70-17d3b55ada10 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:42.890224 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:42.997152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f934e0-3bbf-409a-9d70-17d3b55ada10 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:43.063546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381cf99-3d60-4c77-b835-be5e8f5e310e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:43.064522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381cf99-3d60-4c77-b835-be5e8f5e310e None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:43.065021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381cf99-3d60-4c77-b835-be5e8f5e310e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:43.065514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381cf99-3d60-4c77-b835-be5e8f5e310e None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:43.066896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381cf99-3d60-4c77-b835-be5e8f5e310e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:43.067475 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381cf99-3d60-4c77-b835-be5e8f5e310e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:43.070132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381cf99-3d60-4c77-b835-be5e8f5e310e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:43.099370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 543/1095] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:40:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:43.101159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afe4b7-4295-43c4-b0c1-7a55df3f597e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:43.204719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:43.240415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afe4b7-4295-43c4-b0c1-7a55df3f597e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:43.304655 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57f45-e58d-43c7-8328-8b3c5d680e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:43.305393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57f45-e58d-43c7-8328-8b3c5d680e30 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:43.305678 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57f45-e58d-43c7-8328-8b3c5d680e30 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:43.305956 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57f45-e58d-43c7-8328-8b3c5d680e30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:43.314923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb57f45-e58d-43c7-8328-8b3c5d680e30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:43.316547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb57f45-e58d-43c7-8328-8b3c5d680e30 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-dbb57f45-e58d-43c7-8328-8b3c5d680e30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:40:43.331637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:43.333565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:43.335744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:40:43.335744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:40:43.335744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:40:43.335744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:40:43.335744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:40:43.335744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:40:43.335744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:40:43.335744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:40:43.338057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 553/1096] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:43.340808 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381cf99-3d60-4c77-b835-be5e8f5e310e None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:43.487989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:43.502216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381cf99-3d60-4c77-b835-be5e8f5e310e None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:43.564597 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93157d06-6b9a-4f5c-b6fd-db19fb07db85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:43.565730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93157d06-6b9a-4f5c-b6fd-db19fb07db85 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:43.566152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93157d06-6b9a-4f5c-b6fd-db19fb07db85 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:43.566610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93157d06-6b9a-4f5c-b6fd-db19fb07db85 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:43.568392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93157d06-6b9a-4f5c-b6fd-db19fb07db85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:43.568944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93157d06-6b9a-4f5c-b6fd-db19fb07db85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:43.571747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93157d06-6b9a-4f5c-b6fd-db19fb07db85 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:43.600156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 544/1097] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:40:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:43.602752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57f45-e58d-43c7-8328-8b3c5d680e30 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:43.755506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57f45-e58d-43c7-8328-8b3c5d680e30 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:43.821640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaf10c-0cb9-4740-b7cc-0b0f2bc53515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:43.822667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaf10c-0cb9-4740-b7cc-0b0f2bc53515 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:43.823097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaf10c-0cb9-4740-b7cc-0b0f2bc53515 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:43.823355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaf10c-0cb9-4740-b7cc-0b0f2bc53515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:43.824934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaf10c-0cb9-4740-b7cc-0b0f2bc53515 None admin] RBAC: Adding query filter params (role.id=e30f4d3046084825ac1b052687c77151, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=9728f2fe7b5a40cd9f8ead5cf99af581) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:43.825437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaf10c-0cb9-4740-b7cc-0b0f2bc53515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:43.828433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaf10c-0cb9-4740-b7cc-0b0f2bc53515 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:43.850999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 554/1098] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:40:43 2022] GET /identity/v3/role_assignments?user.id=9728f2fe7b5a40cd9f8ead5cf99af581&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=e30f4d3046084825ac1b052687c77151 => generated 610 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:43.902625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231dec8-af54-43f8-aec9-28ba73b40230 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:43.902972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231dec8-af54-43f8-aec9-28ba73b40230 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:43.903387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231dec8-af54-43f8-aec9-28ba73b40230 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:43.905039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 545/1099] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:43.915493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1986-a76c-4958-84a1-06b56fbbfc54 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:43.915984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1986-a76c-4958-84a1-06b56fbbfc54 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:43.916552 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1986-a76c-4958-84a1-06b56fbbfc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:43.930142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:43.944231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-037f1986-a76c-4958-84a1-06b56fbbfc54 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:43.945691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-037f1986-a76c-4958-84a1-06b56fbbfc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:44.066693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 555/1100] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:43 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:44.108903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231dec8-af54-43f8-aec9-28ba73b40230 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:44.283256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231dec8-af54-43f8-aec9-28ba73b40230 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:44.333616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c90d8-2e0d-4f28-bf99-191cea8c6bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:44.334293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c90d8-2e0d-4f28-bf99-191cea8c6bda None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:44.334587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c90d8-2e0d-4f28-bf99-191cea8c6bda None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:44.334847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c90d8-2e0d-4f28-bf99-191cea8c6bda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:44.349900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c90d8-2e0d-4f28-bf99-191cea8c6bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-769c90d8-2e0d-4f28-bf99-191cea8c6bda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:40:44.355536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:40:44.356631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:40:44.357874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 546/1101] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:40:44.363590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f1986-a76c-4958-84a1-06b56fbbfc54 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:44.494460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f1986-a76c-4958-84a1-06b56fbbfc54 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:44.537251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcd56e-6360-4f4f-9e8c-2b403c274f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:44.537927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd56e-6360-4f4f-9e8c-2b403c274f17 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:44.538208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd56e-6360-4f4f-9e8c-2b403c274f17 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:44.538482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd56e-6360-4f4f-9e8c-2b403c274f17 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:44.539305 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcd56e-6360-4f4f-9e8c-2b403c274f17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:44.539614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcd56e-6360-4f4f-9e8c-2b403c274f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:44.541073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcd56e-6360-4f4f-9e8c-2b403c274f17 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:44.543006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:44.554589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 556/1102] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:40:44 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:44.561500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c90d8-2e0d-4f28-bf99-191cea8c6bda None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:44.583872 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:44.709616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c90d8-2e0d-4f28-bf99-191cea8c6bda None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:44.753402 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47172347-a30c-4107-a69e-75dd7bbd071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:44.754078 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47172347-a30c-4107-a69e-75dd7bbd071b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:44.754361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47172347-a30c-4107-a69e-75dd7bbd071b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:44.754608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47172347-a30c-4107-a69e-75dd7bbd071b None admin] PATH_INFO: `/v3/users/5806881f104b4b18ac16d3c27fdb066d` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:44.755978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47172347-a30c-4107-a69e-75dd7bbd071b None admin] RBAC: Authorizing `identity:get_user(user_id=5806881f104b4b18ac16d3c27fdb066d)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:44.757466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47172347-a30c-4107-a69e-75dd7bbd071b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:44.759173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 547/1103] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:40:44 2022] GET /identity/v3/users/5806881f104b4b18ac16d3c27fdb066d => generated 286 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:44.766335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcd56e-6360-4f4f-9e8c-2b403c274f17 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:44.897076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcd56e-6360-4f4f-9e8c-2b403c274f17 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:44.942375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c7259-f6fc-431e-9f79-85434d0ea32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:44.943069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c7259-f6fc-431e-9f79-85434d0ea32b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:44.943362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c7259-f6fc-431e-9f79-85434d0ea32b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:44.943632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c7259-f6fc-431e-9f79-85434d0ea32b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:45.033351 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:45.041174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c7259-f6fc-431e-9f79-85434d0ea32b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:45.042654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c7259-f6fc-431e-9f79-85434d0ea32b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:45.150970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 557/1104] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:40:44 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:40:45.157381 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47172347-a30c-4107-a69e-75dd7bbd071b None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:45.254693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:45.277976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47172347-a30c-4107-a69e-75dd7bbd071b None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:45.317763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05980a58-3fbe-4ff9-a548-f503493de5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:45.318335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05980a58-3fbe-4ff9-a548-f503493de5dd None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:45.318616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05980a58-3fbe-4ff9-a548-f503493de5dd None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:45.318902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05980a58-3fbe-4ff9-a548-f503493de5dd None admin] PATH_INFO: `/v3/projects/cf519958945c4c6b95c464badafc3dd0` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:45.320184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05980a58-3fbe-4ff9-a548-f503493de5dd None admin] RBAC: Authorizing `identity:get_project(project_id=cf519958945c4c6b95c464badafc3dd0)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:45.321664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05980a58-3fbe-4ff9-a548-f503493de5dd None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:45.323617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 548/1105] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:40:45 2022] GET /identity/v3/projects/cf519958945c4c6b95c464badafc3dd0 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:45.330493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c7259-f6fc-431e-9f79-85434d0ea32b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:45.443194 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:45.450879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c7259-f6fc-431e-9f79-85434d0ea32b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:45.504187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10351cc3-ff43-460d-a175-e85275c65c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:45.505270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351cc3-ff43-460d-a175-e85275c65c6f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:45.505771 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351cc3-ff43-460d-a175-e85275c65c6f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:45.506259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351cc3-ff43-460d-a175-e85275c65c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:45.507826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10351cc3-ff43-460d-a175-e85275c65c6f None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=cf519958945c4c6b95c464badafc3dd0, user.id=5806881f104b4b18ac16d3c27fdb066d) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:45.508382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10351cc3-ff43-460d-a175-e85275c65c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:45.512532 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10351cc3-ff43-460d-a175-e85275c65c6f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:45.524234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 558/1106] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:40:45 2022] GET /identity/v3/role_assignments?user.id=5806881f104b4b18ac16d3c27fdb066d&scope.project.id=cf519958945c4c6b95c464badafc3dd0&role.id=390e487a45f74246ba84773e8760bc7c => generated 610 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:47.760157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c402b2-8868-4f99-9f64-c5dd07207d67 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:47.760751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c402b2-8868-4f99-9f64-c5dd07207d67 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:47.760751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c402b2-8868-4f99-9f64-c5dd07207d67 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:47.762018 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 549/1107] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:47.768175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375056-c212-48b6-9999-1188a2fceb57 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:47.768826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375056-c212-48b6-9999-1188a2fceb57 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:47.768826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375056-c212-48b6-9999-1188a2fceb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:47.797533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a5375056-c212-48b6-9999-1188a2fceb57 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:47.798769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a5375056-c212-48b6-9999-1188a2fceb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:47.886703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 559/1108] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:47 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:47.911367 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c402b2-8868-4f99-9f64-c5dd07207d67 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:48.024759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c402b2-8868-4f99-9f64-c5dd07207d67 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:48.071438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e2bf2-2819-412d-88f0-1067963f2beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:48.072703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e2bf2-2819-412d-88f0-1067963f2beb None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:48.073161 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e2bf2-2819-412d-88f0-1067963f2beb None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:48.073559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e2bf2-2819-412d-88f0-1067963f2beb None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:48.075648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e2bf2-2819-412d-88f0-1067963f2beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:48.077825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e2bf2-2819-412d-88f0-1067963f2beb None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:48.079819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 550/1109] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:40:47 2022] GET /identity/v3/domains/default => generated 200 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:48.086335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5375056-c212-48b6-9999-1188a2fceb57 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:48.182712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:48.194109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5375056-c212-48b6-9999-1188a2fceb57 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:48.235400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ae2f7-d44e-448a-899b-64da5c950d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:48.236010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ae2f7-d44e-448a-899b-64da5c950d84 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:48.236287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ae2f7-d44e-448a-899b-64da5c950d84 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:48.236577 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ae2f7-d44e-448a-899b-64da5c950d84 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:48.237292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ae2f7-d44e-448a-899b-64da5c950d84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:48.238770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ae2f7-d44e-448a-899b-64da5c950d84 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:48.266029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 560/1110] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:40:48 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:40:50.449358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee635-feab-4451-846d-391e87a8ae82 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:50.449997 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee635-feab-4451-846d-391e87a8ae82 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:50.449997 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee635-feab-4451-846d-391e87a8ae82 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:50.451873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 551/1111] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:50.458240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f287d-7463-4e81-a821-eacc05cddc03 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:50.458889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f287d-7463-4e81-a821-eacc05cddc03 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:50.458889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f287d-7463-4e81-a821-eacc05cddc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:50.481829 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-292f287d-7463-4e81-a821-eacc05cddc03 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:50.483178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-292f287d-7463-4e81-a821-eacc05cddc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:50.566211 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 561/1112] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:50 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:50.591330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ee635-feab-4451-846d-391e87a8ae82 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:50.615321 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:50.710627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ee635-feab-4451-846d-391e87a8ae82 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:50.751486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7579543-3af3-4b35-b3f2-b8f6e9f47cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:50.752209 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7579543-3af3-4b35-b3f2-b8f6e9f47cea None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:50.752435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7579543-3af3-4b35-b3f2-b8f6e9f47cea None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:50.752715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7579543-3af3-4b35-b3f2-b8f6e9f47cea None admin] PATH_INFO: `/v3/roles/1f3d7dea677f4b82a9728c6f9083d706` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:50.754234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7579543-3af3-4b35-b3f2-b8f6e9f47cea None admin] RBAC: Authorizing `identity:get_role(role_id=1f3d7dea677f4b82a9728c6f9083d706)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:50.755765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7579543-3af3-4b35-b3f2-b8f6e9f47cea None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:50.757270 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 552/1113] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:40:50 2022] GET /identity/v3/roles/1f3d7dea677f4b82a9728c6f9083d706 => generated 224 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:50.763959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f287d-7463-4e81-a821-eacc05cddc03 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:50.851223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:50.877953 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f287d-7463-4e81-a821-eacc05cddc03 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:50.916604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd8eaa-fb54-4d16-a77f-4de2ee896e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:50.917273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd8eaa-fb54-4d16-a77f-4de2ee896e22 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:50.917541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd8eaa-fb54-4d16-a77f-4de2ee896e22 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:50.917827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd8eaa-fb54-4d16-a77f-4de2ee896e22 None admin] PATH_INFO: `/v3/users/9740db9414b8415c877f9daab000cd2f` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:50.935315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd8eaa-fb54-4d16-a77f-4de2ee896e22 None admin] RBAC: Authorizing `identity:get_user(user_id=9740db9414b8415c877f9daab000cd2f)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:50.936814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd8eaa-fb54-4d16-a77f-4de2ee896e22 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:50.938616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 562/1114] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:40:50 2022] GET /identity/v3/users/9740db9414b8415c877f9daab000cd2f => generated 287 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:50.946520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7579543-3af3-4b35-b3f2-b8f6e9f47cea None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:51.040744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:51.057591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7579543-3af3-4b35-b3f2-b8f6e9f47cea None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:51.096729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247b0e-7076-4377-bead-d0a33afeb1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:51.097350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247b0e-7076-4377-bead-d0a33afeb1c0 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:51.097645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247b0e-7076-4377-bead-d0a33afeb1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:51.097918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247b0e-7076-4377-bead-d0a33afeb1c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:51.204747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e247b0e-7076-4377-bead-d0a33afeb1c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:51.206806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e247b0e-7076-4377-bead-d0a33afeb1c0 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:51.364410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:51.392593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 553/1115] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:40:50 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 16:40:51.399298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd8eaa-fb54-4d16-a77f-4de2ee896e22 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:51.522388 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd8eaa-fb54-4d16-a77f-4de2ee896e22 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:51.561039 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df8e2e-681d-45d2-bf16-de2a14ef594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:51.561708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df8e2e-681d-45d2-bf16-de2a14ef594c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:51.561984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df8e2e-681d-45d2-bf16-de2a14ef594c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:51.562253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df8e2e-681d-45d2-bf16-de2a14ef594c None admin] PATH_INFO: `/v3/projects/cf519958945c4c6b95c464badafc3dd0` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:51.563479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df8e2e-681d-45d2-bf16-de2a14ef594c None admin] RBAC: Authorizing `identity:get_project(project_id=cf519958945c4c6b95c464badafc3dd0)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:51.564944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df8e2e-681d-45d2-bf16-de2a14ef594c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:51.566813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 563/1116] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:40:51 2022] GET /identity/v3/projects/cf519958945c4c6b95c464badafc3dd0 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:51.573855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247b0e-7076-4377-bead-d0a33afeb1c0 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:51.695809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247b0e-7076-4377-bead-d0a33afeb1c0 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:51.736061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc254d51-fcbd-412c-8ba7-54ca262c380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:51.736700 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254d51-fcbd-412c-8ba7-54ca262c380b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:51.736984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254d51-fcbd-412c-8ba7-54ca262c380b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:51.737263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254d51-fcbd-412c-8ba7-54ca262c380b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:51.738074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc254d51-fcbd-412c-8ba7-54ca262c380b None admin] RBAC: Adding query filter params (role.id=1f3d7dea677f4b82a9728c6f9083d706, scope.project.id=cf519958945c4c6b95c464badafc3dd0, user.id=9740db9414b8415c877f9daab000cd2f) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:51.738384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc254d51-fcbd-412c-8ba7-54ca262c380b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:51.739883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc254d51-fcbd-412c-8ba7-54ca262c380b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:51.746645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 554/1117] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:40:51 2022] GET /identity/v3/role_assignments?user.id=9740db9414b8415c877f9daab000cd2f&scope.project.id=cf519958945c4c6b95c464badafc3dd0&role.id=1f3d7dea677f4b82a9728c6f9083d706 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:53.853891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeca596-7dad-426c-af12-49f2dbc677f8 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:53.854432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeca596-7dad-426c-af12-49f2dbc677f8 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:53.854432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeca596-7dad-426c-af12-49f2dbc677f8 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:53.855789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 564/1118] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:53.869718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2e66b-55d7-4668-9726-c99d3762969a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:53.870317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2e66b-55d7-4668-9726-c99d3762969a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:53.870317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2e66b-55d7-4668-9726-c99d3762969a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:53.889850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6fe2e66b-55d7-4668-9726-c99d3762969a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:53.891128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6fe2e66b-55d7-4668-9726-c99d3762969a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:53.944602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:53.975276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 555/1119] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:40:53.998249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeca596-7dad-426c-af12-49f2dbc677f8 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:54.002607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:54.122241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeca596-7dad-426c-af12-49f2dbc677f8 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:54.159289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b49243-9f82-4add-b955-8b2df3a1ff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:54.159954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49243-9f82-4add-b955-8b2df3a1ff64 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:54.160234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49243-9f82-4add-b955-8b2df3a1ff64 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:54.160508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49243-9f82-4add-b955-8b2df3a1ff64 None admin] PATH_INFO: `/v3/roles/1f3d7dea677f4b82a9728c6f9083d706` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:54.162026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b49243-9f82-4add-b955-8b2df3a1ff64 None admin] RBAC: Authorizing `identity:get_role(role_id=1f3d7dea677f4b82a9728c6f9083d706)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:54.163482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b49243-9f82-4add-b955-8b2df3a1ff64 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:54.164905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 565/1120] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:40:53 2022] GET /identity/v3/roles/1f3d7dea677f4b82a9728c6f9083d706 => generated 224 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:54.171759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2e66b-55d7-4668-9726-c99d3762969a None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:54.316453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2e66b-55d7-4668-9726-c99d3762969a None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:54.357023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206d06a-11ca-462c-a6e9-f63565d0b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:54.357692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206d06a-11ca-462c-a6e9-f63565d0b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:54.357969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206d06a-11ca-462c-a6e9-f63565d0b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:54.358242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206d06a-11ca-462c-a6e9-f63565d0b8a7 None admin] PATH_INFO: `/v3/users/9740db9414b8415c877f9daab000cd2f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:54.359484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206d06a-11ca-462c-a6e9-f63565d0b8a7 None admin] RBAC: Authorizing `identity:get_user(user_id=9740db9414b8415c877f9daab000cd2f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:54.360949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206d06a-11ca-462c-a6e9-f63565d0b8a7 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:54.362654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 556/1121] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:40:54 2022] GET /identity/v3/users/9740db9414b8415c877f9daab000cd2f => generated 287 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:54.369928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b49243-9f82-4add-b955-8b2df3a1ff64 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:54.496511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:54.540568 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b49243-9f82-4add-b955-8b2df3a1ff64 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:54.582102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412d6fc-e5e9-4c17-9030-1048beeef5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:54.582767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412d6fc-e5e9-4c17-9030-1048beeef5ac None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:54.583080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412d6fc-e5e9-4c17-9030-1048beeef5ac None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:54.583354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412d6fc-e5e9-4c17-9030-1048beeef5ac None admin] PATH_INFO: `/v3/projects/cf519958945c4c6b95c464badafc3dd0` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:54.584588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412d6fc-e5e9-4c17-9030-1048beeef5ac None admin] RBAC: Authorizing `identity:get_project(project_id=cf519958945c4c6b95c464badafc3dd0)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:54.586067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412d6fc-e5e9-4c17-9030-1048beeef5ac None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:54.587950 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 566/1122] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:40:54 2022] GET /identity/v3/projects/cf519958945c4c6b95c464badafc3dd0 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:54.594708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206d06a-11ca-462c-a6e9-f63565d0b8a7 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:54.652973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:54.716964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206d06a-11ca-462c-a6e9-f63565d0b8a7 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:54.758818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6a926-eb16-40cc-9cb6-668366ada391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:54.759448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a926-eb16-40cc-9cb6-668366ada391 None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:54.759726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a926-eb16-40cc-9cb6-668366ada391 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:54.759991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a926-eb16-40cc-9cb6-668366ada391 None admin] PATH_INFO: `/v3/projects/cf519958945c4c6b95c464badafc3dd0/users/9740db9414b8415c877f9daab000cd2f/roles/1f3d7dea677f4b82a9728c6f9083d706` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:54.762415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6a926-eb16-40cc-9cb6-668366ada391 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf519958945c4c6b95c464badafc3dd0, user_id=9740db9414b8415c877f9daab000cd2f, role_id=1f3d7dea677f4b82a9728c6f9083d706)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:54.764151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6a926-eb16-40cc-9cb6-668366ada391 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:54.782195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 557/1123] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:40:54 2022] PUT /identity/v3/projects/cf519958945c4c6b95c464badafc3dd0/users/9740db9414b8415c877f9daab000cd2f/roles/1f3d7dea677f4b82a9728c6f9083d706 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:40:57.110677 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eca61b-81ac-48e4-b900-f185f88894ba None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:57.111390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eca61b-81ac-48e4-b900-f185f88894ba None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:57.111390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eca61b-81ac-48e4-b900-f185f88894ba None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:57.112894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 567/1124] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:40:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:40:57.119332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3d6f3-795f-4048-8755-1d9672f2560c None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:57.120163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3d6f3-795f-4048-8755-1d9672f2560c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:57.120163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3d6f3-795f-4048-8755-1d9672f2560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:57.141243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a8c3d6f3-795f-4048-8755-1d9672f2560c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:40:57.142573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a8c3d6f3-795f-4048-8755-1d9672f2560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:40:57.226137 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 558/1125] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:40:57 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:40:57.264172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eca61b-81ac-48e4-b900-f185f88894ba None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:57.415235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eca61b-81ac-48e4-b900-f185f88894ba None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:57.481014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd6d4-f996-4cc3-9d72-f52e192a72b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:57.482114 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd6d4-f996-4cc3-9d72-f52e192a72b4 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:57.482597 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd6d4-f996-4cc3-9d72-f52e192a72b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:57.483096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd6d4-f996-4cc3-9d72-f52e192a72b4 None admin] PATH_INFO: `/v3/roles/1f3d7dea677f4b82a9728c6f9083d706` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:57.485811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfd6d4-f996-4cc3-9d72-f52e192a72b4 None admin] RBAC: Authorizing `identity:get_role(role_id=1f3d7dea677f4b82a9728c6f9083d706)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:57.488190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfd6d4-f996-4cc3-9d72-f52e192a72b4 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:57.490639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 568/1126] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:40:57 2022] GET /identity/v3/roles/1f3d7dea677f4b82a9728c6f9083d706 => generated 224 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:57.497954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3d6f3-795f-4048-8755-1d9672f2560c None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:57.548241 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:57.624017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3d6f3-795f-4048-8755-1d9672f2560c None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:57.668269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21c78b-40e3-42f0-986c-096dfe1cdb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:57.668838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21c78b-40e3-42f0-986c-096dfe1cdb54 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:57.669116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21c78b-40e3-42f0-986c-096dfe1cdb54 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:57.669387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21c78b-40e3-42f0-986c-096dfe1cdb54 None admin] PATH_INFO: `/v3/users/9740db9414b8415c877f9daab000cd2f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:57.670663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21c78b-40e3-42f0-986c-096dfe1cdb54 None admin] RBAC: Authorizing `identity:get_user(user_id=9740db9414b8415c877f9daab000cd2f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:57.672353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21c78b-40e3-42f0-986c-096dfe1cdb54 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:57.674237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 559/1127] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:40:57 2022] GET /identity/v3/users/9740db9414b8415c877f9daab000cd2f => generated 287 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:40:57.680641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd6d4-f996-4cc3-9d72-f52e192a72b4 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:57.692091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:57.809512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd6d4-f996-4cc3-9d72-f52e192a72b4 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:57.858844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715436d-9030-4bd3-87b6-8028a316301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:57.859519 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715436d-9030-4bd3-87b6-8028a316301e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:57.859794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715436d-9030-4bd3-87b6-8028a316301e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:57.860063 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715436d-9030-4bd3-87b6-8028a316301e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:57.942375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715436d-9030-4bd3-87b6-8028a316301e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:57.944051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715436d-9030-4bd3-87b6-8028a316301e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:57.954000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:58.064746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 569/1128] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:40:57 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:40:58.071471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21c78b-40e3-42f0-986c-096dfe1cdb54 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:58.191830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21c78b-40e3-42f0-986c-096dfe1cdb54 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:58.202238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:58.237217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27d559-f308-4b8b-bcbd-3c536e69f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:58.237893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27d559-f308-4b8b-bcbd-3c536e69f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:58.238180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27d559-f308-4b8b-bcbd-3c536e69f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:58.238458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27d559-f308-4b8b-bcbd-3c536e69f9e4 None admin] PATH_INFO: `/v3/projects/cf519958945c4c6b95c464badafc3dd0` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:58.239955 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27d559-f308-4b8b-bcbd-3c536e69f9e4 None admin] RBAC: Authorizing `identity:get_project(project_id=cf519958945c4c6b95c464badafc3dd0)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:58.241468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27d559-f308-4b8b-bcbd-3c536e69f9e4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:58.245306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 560/1129] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:40:58 2022] GET /identity/v3/projects/cf519958945c4c6b95c464badafc3dd0 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:40:58.252673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715436d-9030-4bd3-87b6-8028a316301e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:40:58.410283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715436d-9030-4bd3-87b6-8028a316301e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:40:58.419687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:58.451921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd424d-40c1-4869-b8f2-21cf51a76216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:40:58.452687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd424d-40c1-4869-b8f2-21cf51a76216 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:40:58.452936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd424d-40c1-4869-b8f2-21cf51a76216 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:40:58.453243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd424d-40c1-4869-b8f2-21cf51a76216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:40:58.454098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd424d-40c1-4869-b8f2-21cf51a76216 None admin] RBAC: Adding query filter params (role.id=1f3d7dea677f4b82a9728c6f9083d706, scope.project.id=cf519958945c4c6b95c464badafc3dd0, user.id=9740db9414b8415c877f9daab000cd2f) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:40:58.454658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd424d-40c1-4869-b8f2-21cf51a76216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:40:58.457078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd424d-40c1-4869-b8f2-21cf51a76216 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:40:58.465674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 570/1130] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:40:58 2022] GET /identity/v3/role_assignments?user.id=9740db9414b8415c877f9daab000cd2f&scope.project.id=cf519958945c4c6b95c464badafc3dd0&role.id=1f3d7dea677f4b82a9728c6f9083d706 => generated 610 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:00.610847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c9d65-3104-4776-ae0e-4bf700e439a5 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:00.611569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c9d65-3104-4776-ae0e-4bf700e439a5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:00.611569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c9d65-3104-4776-ae0e-4bf700e439a5 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:00.612826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 561/1131] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:00.619717 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a638-002c-42bc-97b3-2082976b1b79 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:00.620304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a638-002c-42bc-97b3-2082976b1b79 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:00.620304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a638-002c-42bc-97b3-2082976b1b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:00.640968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-94f0a638-002c-42bc-97b3-2082976b1b79 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:00.642316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-94f0a638-002c-42bc-97b3-2082976b1b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:00.730991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 571/1132] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:00 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:00.756414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c9d65-3104-4776-ae0e-4bf700e439a5 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:00.885415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c9d65-3104-4776-ae0e-4bf700e439a5 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:00.927441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41028fa-d183-44ae-952a-842ed02e382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:00.928119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41028fa-d183-44ae-952a-842ed02e382f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:00.928398 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41028fa-d183-44ae-952a-842ed02e382f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:00.928675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41028fa-d183-44ae-952a-842ed02e382f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:00.930029 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41028fa-d183-44ae-952a-842ed02e382f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:00.932058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41028fa-d183-44ae-952a-842ed02e382f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:00.933865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 562/1133] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:41:00 2022] GET /identity/v3/domains/default => generated 200 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:00.948542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0a638-002c-42bc-97b3-2082976b1b79 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:01.064744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:01.068154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0a638-002c-42bc-97b3-2082976b1b79 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:01.115576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead48b4e-c0be-48b4-84d3-3e741626fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:01.116217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead48b4e-c0be-48b4-84d3-3e741626fe53 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:01.116498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead48b4e-c0be-48b4-84d3-3e741626fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:01.116770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead48b4e-c0be-48b4-84d3-3e741626fe53 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:01.117480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead48b4e-c0be-48b4-84d3-3e741626fe53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:01.118992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead48b4e-c0be-48b4-84d3-3e741626fe53 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:01.154231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 572/1134] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:41:00 2022] POST /identity/v3/projects => generated 312 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:41:03.321531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacbe28-dbe8-47cd-99d2-336cd65a5507 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:03.322413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacbe28-dbe8-47cd-99d2-336cd65a5507 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:03.322413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacbe28-dbe8-47cd-99d2-336cd65a5507 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:03.324182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 563/1135] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:03.330679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34c162-b67d-4c60-9f3f-9c836df66c4e None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:03.331279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34c162-b67d-4c60-9f3f-9c836df66c4e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:03.331279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34c162-b67d-4c60-9f3f-9c836df66c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:03.352759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-8b34c162-b67d-4c60-9f3f-9c836df66c4e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:03.354029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8b34c162-b67d-4c60-9f3f-9c836df66c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:03.433296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 573/1136] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:03 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:03.460093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacbe28-dbe8-47cd-99d2-336cd65a5507 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:03.518887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:03.591893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacbe28-dbe8-47cd-99d2-336cd65a5507 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:03.638931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbccf4-a1dd-48c8-9e2e-66a39209c5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:03.639701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbccf4-a1dd-48c8-9e2e-66a39209c5b4 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:03.640005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbccf4-a1dd-48c8-9e2e-66a39209c5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:03.640285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbccf4-a1dd-48c8-9e2e-66a39209c5b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:03.641981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbccf4-a1dd-48c8-9e2e-66a39209c5b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:03.643569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbccf4-a1dd-48c8-9e2e-66a39209c5b4 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:03.645396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 564/1137] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:41:03 2022] GET /identity/v3/domains/default => generated 200 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:41:03.653057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34c162-b67d-4c60-9f3f-9c836df66c4e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:03.747167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:03.768220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34c162-b67d-4c60-9f3f-9c836df66c4e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:03.812609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9e367-12de-44ed-b6c0-9712a8280d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:03.813256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9e367-12de-44ed-b6c0-9712a8280d52 None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:03.813534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9e367-12de-44ed-b6c0-9712a8280d52 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:03.813804 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9e367-12de-44ed-b6c0-9712a8280d52 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:03.814518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9e367-12de-44ed-b6c0-9712a8280d52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:03.816343 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9e367-12de-44ed-b6c0-9712a8280d52 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:03.847154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 574/1138] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:41:03 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:41:06.153625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fd1f0-03e0-46fd-b4c9-c2279c086d8c None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:06.154217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fd1f0-03e0-46fd-b4c9-c2279c086d8c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:06.154217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fd1f0-03e0-46fd-b4c9-c2279c086d8c None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:06.155608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 565/1139] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:06.161939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e45a6e-9753-4a93-a977-3df1aaf8f0e2 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:06.162504 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e45a6e-9753-4a93-a977-3df1aaf8f0e2 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:06.162504 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e45a6e-9753-4a93-a977-3df1aaf8f0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:06.183192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-d2e45a6e-9753-4a93-a977-3df1aaf8f0e2 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:06.184426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d2e45a6e-9753-4a93-a977-3df1aaf8f0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:06.263770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 575/1140] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:06 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:06.288441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fd1f0-03e0-46fd-b4c9-c2279c086d8c None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:06.411420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fd1f0-03e0-46fd-b4c9-c2279c086d8c None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:06.426047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:06.454651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cb7cb-e40f-4d52-ba09-7d7f79f179ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:06.455378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cb7cb-e40f-4d52-ba09-7d7f79f179ea None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:06.455659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cb7cb-e40f-4d52-ba09-7d7f79f179ea None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:06.455937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cb7cb-e40f-4d52-ba09-7d7f79f179ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:06.468579 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cb7cb-e40f-4d52-ba09-7d7f79f179ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-4f8cb7cb-e40f-4d52-ba09-7d7f79f179ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:41:06.473683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:41:06.475675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:41:06.477839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 566/1141] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:41:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:41:06.481996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e45a6e-9753-4a93-a977-3df1aaf8f0e2 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:06.560519 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:06.613056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e45a6e-9753-4a93-a977-3df1aaf8f0e2 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:06.664478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c8367-5494-4f74-9eb4-b4377fb84d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:06.665267 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c8367-5494-4f74-9eb4-b4377fb84d37 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:06.665741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c8367-5494-4f74-9eb4-b4377fb84d37 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:06.666301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c8367-5494-4f74-9eb4-b4377fb84d37 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:06.667551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c8367-5494-4f74-9eb4-b4377fb84d37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:41:06.668053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c8367-5494-4f74-9eb4-b4377fb84d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:06.670186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c8367-5494-4f74-9eb4-b4377fb84d37 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:06.686111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 576/1142] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:41:06 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:06.695212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cb7cb-e40f-4d52-ba09-7d7f79f179ea None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:06.812256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cb7cb-e40f-4d52-ba09-7d7f79f179ea None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:06.852932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4b061-e5d0-429f-90f7-43cec8ef103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:06.853600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4b061-e5d0-429f-90f7-43cec8ef103c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:06.853884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4b061-e5d0-429f-90f7-43cec8ef103c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:06.854157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4b061-e5d0-429f-90f7-43cec8ef103c None admin] PATH_INFO: `/v3/users/100362bda4504ab3a6fd45c35cea5837` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:06.870225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4b061-e5d0-429f-90f7-43cec8ef103c None admin] RBAC: Authorizing `identity:get_user(user_id=100362bda4504ab3a6fd45c35cea5837)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:06.871738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4b061-e5d0-429f-90f7-43cec8ef103c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:06.873509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 567/1143] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:41:06 2022] GET /identity/v3/users/100362bda4504ab3a6fd45c35cea5837 => generated 287 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:06.879926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c8367-5494-4f74-9eb4-b4377fb84d37 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:06.998758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c8367-5494-4f74-9eb4-b4377fb84d37 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:07.028059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:07.034277 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5af15-4d11-40ca-baef-8ea016893205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:07.034909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5af15-4d11-40ca-baef-8ea016893205 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:07.035227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5af15-4d11-40ca-baef-8ea016893205 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:07.035495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5af15-4d11-40ca-baef-8ea016893205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:07.104494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5af15-4d11-40ca-baef-8ea016893205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:07.105951 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5af15-4d11-40ca-baef-8ea016893205 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:07.239980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 577/1144] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:41:06 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:41:07.247008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4b061-e5d0-429f-90f7-43cec8ef103c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:07.280173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:07.358112 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4b061-e5d0-429f-90f7-43cec8ef103c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:07.397056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5092f5-b13f-49ba-9b95-df503772c054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:07.397981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5092f5-b13f-49ba-9b95-df503772c054 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:07.398295 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5092f5-b13f-49ba-9b95-df503772c054 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:07.398659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5092f5-b13f-49ba-9b95-df503772c054 None admin] PATH_INFO: `/v3/projects/bd82d98d06b946dbafd08b55b0d2260b` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:07.400349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5092f5-b13f-49ba-9b95-df503772c054 None admin] RBAC: Authorizing `identity:get_project(project_id=bd82d98d06b946dbafd08b55b0d2260b)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:07.402112 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5092f5-b13f-49ba-9b95-df503772c054 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:07.404118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 568/1145] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:41:07 2022] GET /identity/v3/projects/bd82d98d06b946dbafd08b55b0d2260b => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:07.410838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5af15-4d11-40ca-baef-8ea016893205 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:07.443492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:07.526258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5af15-4d11-40ca-baef-8ea016893205 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:07.566657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b1ef6-23fc-4bde-adfd-f16cf84bcc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:07.567220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1ef6-23fc-4bde-adfd-f16cf84bcc09 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:07.567499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1ef6-23fc-4bde-adfd-f16cf84bcc09 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:07.567769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1ef6-23fc-4bde-adfd-f16cf84bcc09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:07.568572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b1ef6-23fc-4bde-adfd-f16cf84bcc09 None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=bd82d98d06b946dbafd08b55b0d2260b, user.id=100362bda4504ab3a6fd45c35cea5837) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:41:07.568877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b1ef6-23fc-4bde-adfd-f16cf84bcc09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:07.570335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b1ef6-23fc-4bde-adfd-f16cf84bcc09 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:07.576833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 578/1146] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:41:07 2022] GET /identity/v3/role_assignments?user.id=100362bda4504ab3a6fd45c35cea5837&scope.project.id=bd82d98d06b946dbafd08b55b0d2260b&role.id=390e487a45f74246ba84773e8760bc7c => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:09.656058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd771f9e-4108-4893-a67f-836dc5c455e3 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:09.656616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd771f9e-4108-4893-a67f-836dc5c455e3 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:09.656616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd771f9e-4108-4893-a67f-836dc5c455e3 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:09.657998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 569/1147] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:09.663967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110497-15ed-4bc6-88e1-0f925151e8f6 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:09.664488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110497-15ed-4bc6-88e1-0f925151e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:09.664718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110497-15ed-4bc6-88e1-0f925151e8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:09.684208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-db110497-15ed-4bc6-88e1-0f925151e8f6 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:09.685438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-db110497-15ed-4bc6-88e1-0f925151e8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:09.767687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 579/1148] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:09 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:09.792502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd771f9e-4108-4893-a67f-836dc5c455e3 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:09.916949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:09.925809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd771f9e-4108-4893-a67f-836dc5c455e3 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:09.984461 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587b927-5f44-441c-93a4-d6f6743a1ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:09.985550 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587b927-5f44-441c-93a4-d6f6743a1ce7 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:09.986154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587b927-5f44-441c-93a4-d6f6743a1ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:09.986646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587b927-5f44-441c-93a4-d6f6743a1ce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:10.006724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587b927-5f44-441c-93a4-d6f6743a1ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-3587b927-5f44-441c-93a4-d6f6743a1ce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:41:10.016659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:41:10.017863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:41:10.018929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 570/1149] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:41:10.025675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db110497-15ed-4bc6-88e1-0f925151e8f6 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:10.055226 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:10.142506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db110497-15ed-4bc6-88e1-0f925151e8f6 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:10.205437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39f8fc-fe92-4117-a3b6-ca33a618e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:10.206511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39f8fc-fe92-4117-a3b6-ca33a618e4e1 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:10.206938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39f8fc-fe92-4117-a3b6-ca33a618e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:10.207471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39f8fc-fe92-4117-a3b6-ca33a618e4e1 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:10.208802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39f8fc-fe92-4117-a3b6-ca33a618e4e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:41:10.209324 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39f8fc-fe92-4117-a3b6-ca33a618e4e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:10.212058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39f8fc-fe92-4117-a3b6-ca33a618e4e1 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:10.222935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 580/1150] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:41:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:10.229485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587b927-5f44-441c-93a4-d6f6743a1ce7 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:10.340029 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587b927-5f44-441c-93a4-d6f6743a1ce7 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:10.379755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c67de-9b80-4a30-a597-6ffb89cec09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:10.380407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c67de-9b80-4a30-a597-6ffb89cec09a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:10.380693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c67de-9b80-4a30-a597-6ffb89cec09a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:10.380964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c67de-9b80-4a30-a597-6ffb89cec09a None admin] PATH_INFO: `/v3/users/100362bda4504ab3a6fd45c35cea5837` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:10.382424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c67de-9b80-4a30-a597-6ffb89cec09a None admin] RBAC: Authorizing `identity:get_user(user_id=100362bda4504ab3a6fd45c35cea5837)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:10.383924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c67de-9b80-4a30-a597-6ffb89cec09a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:10.385580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 571/1151] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:41:10 2022] GET /identity/v3/users/100362bda4504ab3a6fd45c35cea5837 => generated 287 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:10.391977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39f8fc-fe92-4117-a3b6-ca33a618e4e1 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:10.496565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:10.516943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39f8fc-fe92-4117-a3b6-ca33a618e4e1 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:10.562579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecdba7-945e-41c0-93d4-885195b688f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:10.563325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecdba7-945e-41c0-93d4-885195b688f3 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:10.563604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecdba7-945e-41c0-93d4-885195b688f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:10.563875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecdba7-945e-41c0-93d4-885195b688f3 None admin] PATH_INFO: `/v3/projects/bd82d98d06b946dbafd08b55b0d2260b` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:10.565185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecdba7-945e-41c0-93d4-885195b688f3 None admin] RBAC: Authorizing `identity:get_project(project_id=bd82d98d06b946dbafd08b55b0d2260b)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:10.566805 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecdba7-945e-41c0-93d4-885195b688f3 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:10.568707 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 581/1152] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:41:10 2022] GET /identity/v3/projects/bd82d98d06b946dbafd08b55b0d2260b => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:10.575805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c67de-9b80-4a30-a597-6ffb89cec09a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:10.605672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:10.694152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c67de-9b80-4a30-a597-6ffb89cec09a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:10.735312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6e2c1-41f5-439a-9060-72d19a0cf838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:10.736019 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6e2c1-41f5-439a-9060-72d19a0cf838 None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:10.736304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6e2c1-41f5-439a-9060-72d19a0cf838 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:10.736580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6e2c1-41f5-439a-9060-72d19a0cf838 None admin] PATH_INFO: `/v3/projects/bd82d98d06b946dbafd08b55b0d2260b/users/100362bda4504ab3a6fd45c35cea5837/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:10.738829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6e2c1-41f5-439a-9060-72d19a0cf838 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd82d98d06b946dbafd08b55b0d2260b, user_id=100362bda4504ab3a6fd45c35cea5837, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:10.740340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6e2c1-41f5-439a-9060-72d19a0cf838 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:10.757692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 572/1153] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:41:10 2022] PUT /identity/v3/projects/bd82d98d06b946dbafd08b55b0d2260b/users/100362bda4504ab3a6fd45c35cea5837/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:41:13.131259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1024e1-959e-4979-a5dd-476cb9be6c94 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:13.131887 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1024e1-959e-4979-a5dd-476cb9be6c94 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:13.132237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1024e1-959e-4979-a5dd-476cb9be6c94 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:13.134553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 582/1154] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:13 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:13.140916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4313495-02e5-4670-837f-7a6b42f8becd None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:13.141519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4313495-02e5-4670-837f-7a6b42f8becd None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:13.141519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4313495-02e5-4670-837f-7a6b42f8becd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:13.161292 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d4313495-02e5-4670-837f-7a6b42f8becd None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:13.162538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d4313495-02e5-4670-837f-7a6b42f8becd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:13.252016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 573/1155] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:13 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:13.276770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1024e1-959e-4979-a5dd-476cb9be6c94 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:13.410152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1024e1-959e-4979-a5dd-476cb9be6c94 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:13.455582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d47cde-8f7d-4791-a2dd-dd1a7d25ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:13.456255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47cde-8f7d-4791-a2dd-dd1a7d25ea19 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:13.456532 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47cde-8f7d-4791-a2dd-dd1a7d25ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:13.456801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47cde-8f7d-4791-a2dd-dd1a7d25ea19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:13.470441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d47cde-8f7d-4791-a2dd-dd1a7d25ea19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-e0d47cde-8f7d-4791-a2dd-dd1a7d25ea19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:41:13.475898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:41:13.478007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:41:13.479970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 583/1156] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:41:13.486052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4313495-02e5-4670-837f-7a6b42f8becd None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:13.504383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:13.606191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4313495-02e5-4670-837f-7a6b42f8becd None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:13.646408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6fc5-81b9-40f2-b1f3-f743cd22fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:13.647170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6fc5-81b9-40f2-b1f3-f743cd22fc1d None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:13.647624 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6fc5-81b9-40f2-b1f3-f743cd22fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:13.648025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6fc5-81b9-40f2-b1f3-f743cd22fc1d None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:13.648870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c6fc5-81b9-40f2-b1f3-f743cd22fc1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:41:13.649178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c6fc5-81b9-40f2-b1f3-f743cd22fc1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:13.650615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c6fc5-81b9-40f2-b1f3-f743cd22fc1d None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:13.660668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 574/1157] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:41:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:13.667656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d47cde-8f7d-4791-a2dd-dd1a7d25ea19 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:13.686082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:13.792584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d47cde-8f7d-4791-a2dd-dd1a7d25ea19 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:13.836925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c27cc6-75bd-4db2-b7ff-de35807e3700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:13.837590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27cc6-75bd-4db2-b7ff-de35807e3700 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:13.837865 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27cc6-75bd-4db2-b7ff-de35807e3700 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:13.838131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27cc6-75bd-4db2-b7ff-de35807e3700 None admin] PATH_INFO: `/v3/users/100362bda4504ab3a6fd45c35cea5837` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:13.839750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c27cc6-75bd-4db2-b7ff-de35807e3700 None admin] RBAC: Authorizing `identity:get_user(user_id=100362bda4504ab3a6fd45c35cea5837)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:13.841482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c27cc6-75bd-4db2-b7ff-de35807e3700 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:13.843324 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 584/1158] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:41:13 2022] GET /identity/v3/users/100362bda4504ab3a6fd45c35cea5837 => generated 287 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:41:13.850059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6fc5-81b9-40f2-b1f3-f743cd22fc1d None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:13.933126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:13.964777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6fc5-81b9-40f2-b1f3-f743cd22fc1d None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:14.000305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1b378-e08c-4081-a9b1-be1eef839c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:14.000953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1b378-e08c-4081-a9b1-be1eef839c90 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:14.001238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1b378-e08c-4081-a9b1-be1eef839c90 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:14.001515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1b378-e08c-4081-a9b1-be1eef839c90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:14.075485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1b378-e08c-4081-a9b1-be1eef839c90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:14.076969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1b378-e08c-4081-a9b1-be1eef839c90 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:14.177154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:14.210366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 575/1159] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:41:13 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:41:14.220499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c27cc6-75bd-4db2-b7ff-de35807e3700 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:14.318511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:14.343002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c27cc6-75bd-4db2-b7ff-de35807e3700 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:14.383309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70483154-5f3b-42ea-ae0f-1f08beddd97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:14.384034 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70483154-5f3b-42ea-ae0f-1f08beddd97f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:14.384344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70483154-5f3b-42ea-ae0f-1f08beddd97f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:14.384676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70483154-5f3b-42ea-ae0f-1f08beddd97f None admin] PATH_INFO: `/v3/projects/bd82d98d06b946dbafd08b55b0d2260b` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:14.386049 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70483154-5f3b-42ea-ae0f-1f08beddd97f None admin] RBAC: Authorizing `identity:get_project(project_id=bd82d98d06b946dbafd08b55b0d2260b)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:14.387656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70483154-5f3b-42ea-ae0f-1f08beddd97f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:14.389491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 585/1160] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:41:14 2022] GET /identity/v3/projects/bd82d98d06b946dbafd08b55b0d2260b => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:14.396386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1b378-e08c-4081-a9b1-be1eef839c90 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:14.519544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1b378-e08c-4081-a9b1-be1eef839c90 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:14.560740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6a256-7510-4e41-b04a-188d896e96c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:14.561457 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6a256-7510-4e41-b04a-188d896e96c6 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:14.561782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6a256-7510-4e41-b04a-188d896e96c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:14.562097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6a256-7510-4e41-b04a-188d896e96c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:14.562988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6a256-7510-4e41-b04a-188d896e96c6 None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=bd82d98d06b946dbafd08b55b0d2260b, user.id=100362bda4504ab3a6fd45c35cea5837) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:41:14.563399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6a256-7510-4e41-b04a-188d896e96c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:14.564946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6a256-7510-4e41-b04a-188d896e96c6 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:14.572114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 576/1161] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:41:14 2022] GET /identity/v3/role_assignments?user.id=100362bda4504ab3a6fd45c35cea5837&scope.project.id=bd82d98d06b946dbafd08b55b0d2260b&role.id=390e487a45f74246ba84773e8760bc7c => generated 610 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:16.707754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651833-cadd-4e06-b2a5-097fb32b0076 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:16.708353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651833-cadd-4e06-b2a5-097fb32b0076 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:16.708353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651833-cadd-4e06-b2a5-097fb32b0076 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:16.709978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 586/1162] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:16.716838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f54a-2880-41cf-a3b8-0b0792d49741 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:16.717391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f54a-2880-41cf-a3b8-0b0792d49741 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:16.717519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f54a-2880-41cf-a3b8-0b0792d49741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:16.738364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-c3d3f54a-2880-41cf-a3b8-0b0792d49741 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:16.740013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c3d3f54a-2880-41cf-a3b8-0b0792d49741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:16.778558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:16.813599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 577/1163] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:16 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:16.836894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31651833-cadd-4e06-b2a5-097fb32b0076 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:16.956053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31651833-cadd-4e06-b2a5-097fb32b0076 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:17.000858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80799a32-158d-4db0-acb6-f00d3461c237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:17.000858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80799a32-158d-4db0-acb6-f00d3461c237 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:17.001407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80799a32-158d-4db0-acb6-f00d3461c237 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:17.001407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80799a32-158d-4db0-acb6-f00d3461c237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:17.023859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:17.076397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80799a32-158d-4db0-acb6-f00d3461c237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:17.077784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80799a32-158d-4db0-acb6-f00d3461c237 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:17.179048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 587/1164] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:41:16 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:41:17.185716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f54a-2880-41cf-a3b8-0b0792d49741 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:17.295444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f54a-2880-41cf-a3b8-0b0792d49741 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:17.332693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5a72-f50d-4013-b759-5718764dbcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:17.333256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5a72-f50d-4013-b759-5718764dbcea None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:17.333534 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5a72-f50d-4013-b759-5718764dbcea None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:17.333803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5a72-f50d-4013-b759-5718764dbcea None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:17.342017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5a72-f50d-4013-b759-5718764dbcea None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:17.343603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5a72-f50d-4013-b759-5718764dbcea None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-5edc5a72-f50d-4013-b759-5718764dbcea None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:41:17.357150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:41:17.359300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:41:17.360927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 578/1165] 10.222.0.124 () {56 vars in 1122 bytes} [Mon Aug 1 16:41:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:41:17.366573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80799a32-158d-4db0-acb6-f00d3461c237 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:17.441100 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:17.501612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80799a32-158d-4db0-acb6-f00d3461c237 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:17.544041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc7b44-60e3-40b7-b532-cba52227a775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:17.544689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc7b44-60e3-40b7-b532-cba52227a775 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:17.544972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc7b44-60e3-40b7-b532-cba52227a775 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:17.545248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc7b44-60e3-40b7-b532-cba52227a775 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:17.545973 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc7b44-60e3-40b7-b532-cba52227a775 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:41:17.546283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc7b44-60e3-40b7-b532-cba52227a775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:17.547738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc7b44-60e3-40b7-b532-cba52227a775 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:17.557363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 588/1166] 10.222.0.124 () {56 vars in 1120 bytes} [Mon Aug 1 16:41:17 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:19.731454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74bfe5-bfa6-4cba-a59f-1fdebe4c38b6 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:19.732211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74bfe5-bfa6-4cba-a59f-1fdebe4c38b6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:19.732211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74bfe5-bfa6-4cba-a59f-1fdebe4c38b6 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:19.733377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 579/1167] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:19.739453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9e06e-d28b-4570-9a74-fed9811f2c43 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:19.740076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9e06e-d28b-4570-9a74-fed9811f2c43 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:19.740076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9e06e-d28b-4570-9a74-fed9811f2c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:19.759974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-95b9e06e-d28b-4570-9a74-fed9811f2c43 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:19.761094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-95b9e06e-d28b-4570-9a74-fed9811f2c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:19.839868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 589/1168] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:19 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:19.863378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74bfe5-bfa6-4cba-a59f-1fdebe4c38b6 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:19.897898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:19.991393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74bfe5-bfa6-4cba-a59f-1fdebe4c38b6 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:20.036012 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33afa1-17d8-4237-ad94-e9f149f4f807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:20.036562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33afa1-17d8-4237-ad94-e9f149f4f807 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:20.036885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33afa1-17d8-4237-ad94-e9f149f4f807 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:20.037175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33afa1-17d8-4237-ad94-e9f149f4f807 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:20.038107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33afa1-17d8-4237-ad94-e9f149f4f807 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:20.039567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33afa1-17d8-4237-ad94-e9f149f4f807 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:20.059242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 580/1169] 10.222.0.124 () {60 vars in 1143 bytes} [Mon Aug 1 16:41:19 2022] POST /identity/v3/domains => generated 268 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:41:22.193320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076620b-b192-4a3f-b857-5a7aad658f89 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:22.194005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076620b-b192-4a3f-b857-5a7aad658f89 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:22.194005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076620b-b192-4a3f-b857-5a7aad658f89 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:22.195310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 590/1170] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:22.201971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6424-fd54-48c8-8725-2a86422211cf None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:22.202509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6424-fd54-48c8-8725-2a86422211cf None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:22.202614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6424-fd54-48c8-8725-2a86422211cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:22.222886 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f47f6424-fd54-48c8-8725-2a86422211cf None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:22.224163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f47f6424-fd54-48c8-8725-2a86422211cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:22.310931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 581/1171] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:22 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:22.336007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076620b-b192-4a3f-b857-5a7aad658f89 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:22.389359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:22.449137 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076620b-b192-4a3f-b857-5a7aad658f89 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:22.492541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a086af3-825b-477b-bb5b-281489e4c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:22.493214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a086af3-825b-477b-bb5b-281489e4c484 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:22.493499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a086af3-825b-477b-bb5b-281489e4c484 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:22.493784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a086af3-825b-477b-bb5b-281489e4c484 None admin] PATH_INFO: `/v3/domains/cc0d26bd6b83478daff463e86cf372c5` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:22.507071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a086af3-825b-477b-bb5b-281489e4c484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc0d26bd6b83478daff463e86cf372c5)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:22.508582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a086af3-825b-477b-bb5b-281489e4c484 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:22.510357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 591/1172] 10.222.0.124 () {56 vars in 1188 bytes} [Mon Aug 1 16:41:22 2022] GET /identity/v3/domains/cc0d26bd6b83478daff463e86cf372c5 => generated 268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:22.516860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f6424-fd54-48c8-8725-2a86422211cf None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:22.543669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:22.641003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f6424-fd54-48c8-8725-2a86422211cf None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:22.680098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda359b6-a6de-4698-bea4-3bbf400dd85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:22.680730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda359b6-a6de-4698-bea4-3bbf400dd85c None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:22.681007 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda359b6-a6de-4698-bea4-3bbf400dd85c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:22.681279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda359b6-a6de-4698-bea4-3bbf400dd85c None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:22.681971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda359b6-a6de-4698-bea4-3bbf400dd85c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:22.683520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda359b6-a6de-4698-bea4-3bbf400dd85c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:22.714720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 582/1173] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:41:22 2022] POST /identity/v3/projects => generated 362 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:41:24.882557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1872b-e432-41a5-a7e5-cf2dfcb91e8d None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:24.883164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1872b-e432-41a5-a7e5-cf2dfcb91e8d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:24.883164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1872b-e432-41a5-a7e5-cf2dfcb91e8d None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:24.884566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 592/1174] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:24.890417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e243d-61b5-49fc-a6ef-f3c6829cb3ec None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:24.891056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e243d-61b5-49fc-a6ef-f3c6829cb3ec None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:24.891056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e243d-61b5-49fc-a6ef-f3c6829cb3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:24.915021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ef1e243d-61b5-49fc-a6ef-f3c6829cb3ec None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:24.916249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ef1e243d-61b5-49fc-a6ef-f3c6829cb3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:24.990430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 583/1175] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:24 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:25.020928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1872b-e432-41a5-a7e5-cf2dfcb91e8d None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:25.140364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1872b-e432-41a5-a7e5-cf2dfcb91e8d None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:25.143072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:25.179002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f67982-01cb-4f6c-8878-87b138852ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:25.179662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f67982-01cb-4f6c-8878-87b138852ade None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:25.179936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f67982-01cb-4f6c-8878-87b138852ade None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:25.180229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f67982-01cb-4f6c-8878-87b138852ade None admin] PATH_INFO: `/v3/domains/cc0d26bd6b83478daff463e86cf372c5` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:25.181392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f67982-01cb-4f6c-8878-87b138852ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc0d26bd6b83478daff463e86cf372c5)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:25.182898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f67982-01cb-4f6c-8878-87b138852ade None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:25.184526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 593/1176] 10.222.0.124 () {56 vars in 1188 bytes} [Mon Aug 1 16:41:25 2022] GET /identity/v3/domains/cc0d26bd6b83478daff463e86cf372c5 => generated 268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:25.190786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e243d-61b5-49fc-a6ef-f3c6829cb3ec None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:25.193246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:25.309419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e243d-61b5-49fc-a6ef-f3c6829cb3ec None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:25.348622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ce0e9-2db9-4eb1-a1a2-681a82e3691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:25.349610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ce0e9-2db9-4eb1-a1a2-681a82e3691e None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:25.349897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ce0e9-2db9-4eb1-a1a2-681a82e3691e None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:25.350176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ce0e9-2db9-4eb1-a1a2-681a82e3691e None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:25.350893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ce0e9-2db9-4eb1-a1a2-681a82e3691e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:25.352376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ce0e9-2db9-4eb1-a1a2-681a82e3691e None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:25.376565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 584/1177] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:41:25 2022] POST /identity/v3/users => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:41:27.461998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8f96-4bae-4fb3-b598-7b8acc532b9c None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:27.462665 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8f96-4bae-4fb3-b598-7b8acc532b9c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:27.462665 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8f96-4bae-4fb3-b598-7b8acc532b9c None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:27.464087 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 594/1178] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:27.471368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59783bf3-40ba-49e3-a48a-d7bf0833862e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:27.472154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59783bf3-40ba-49e3-a48a-d7bf0833862e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:27.472154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59783bf3-40ba-49e3-a48a-d7bf0833862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:27.491777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-59783bf3-40ba-49e3-a48a-d7bf0833862e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:27.493050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-59783bf3-40ba-49e3-a48a-d7bf0833862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:27.557705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:27.573819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 585/1179] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:27 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:27.597506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac8f96-4bae-4fb3-b598-7b8acc532b9c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:27.708895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac8f96-4bae-4fb3-b598-7b8acc532b9c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:27.746737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81375c-e224-46ac-bc75-1b060ac4778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:27.747417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81375c-e224-46ac-bc75-1b060ac4778c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:27.747697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81375c-e224-46ac-bc75-1b060ac4778c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:27.747971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81375c-e224-46ac-bc75-1b060ac4778c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:27.759381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81375c-e224-46ac-bc75-1b060ac4778c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-4d81375c-e224-46ac-bc75-1b060ac4778c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:41:27.764320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:41:27.765473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:41:27.766337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 595/1180] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:41:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:41:27.772128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59783bf3-40ba-49e3-a48a-d7bf0833862e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:27.886497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59783bf3-40ba-49e3-a48a-d7bf0833862e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:27.924933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a985896-3f1a-4834-b7bd-90377a2ef174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:27.925650 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a985896-3f1a-4834-b7bd-90377a2ef174 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:27.925938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a985896-3f1a-4834-b7bd-90377a2ef174 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:27.926211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a985896-3f1a-4834-b7bd-90377a2ef174 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:27.927070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a985896-3f1a-4834-b7bd-90377a2ef174 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:41:27.927477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a985896-3f1a-4834-b7bd-90377a2ef174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:27.929229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a985896-3f1a-4834-b7bd-90377a2ef174 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:27.941195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 586/1181] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:41:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:27.949750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81375c-e224-46ac-bc75-1b060ac4778c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:27.998227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:28.077625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81375c-e224-46ac-bc75-1b060ac4778c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:28.117005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2f2f-00ab-4d5a-956d-f18215949b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:28.117652 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2f2f-00ab-4d5a-956d-f18215949b0f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:28.117933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2f2f-00ab-4d5a-956d-f18215949b0f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:28.118198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2f2f-00ab-4d5a-956d-f18215949b0f None admin] PATH_INFO: `/v3/users/f1a4454ba6194682be96665dc34bffaf` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:28.134474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee2f2f-00ab-4d5a-956d-f18215949b0f None admin] RBAC: Authorizing `identity:get_user(user_id=f1a4454ba6194682be96665dc34bffaf)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:28.136136 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee2f2f-00ab-4d5a-956d-f18215949b0f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:28.137882 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 596/1182] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:41:27 2022] GET /identity/v3/users/f1a4454ba6194682be96665dc34bffaf => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:28.143989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a985896-3f1a-4834-b7bd-90377a2ef174 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:28.195972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:28.250687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a985896-3f1a-4834-b7bd-90377a2ef174 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:28.285060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0337f-31b0-4fd1-91ef-4312e0ec66e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:28.285709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0337f-31b0-4fd1-91ef-4312e0ec66e8 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:28.285987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0337f-31b0-4fd1-91ef-4312e0ec66e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:28.286263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0337f-31b0-4fd1-91ef-4312e0ec66e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:28.357824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0337f-31b0-4fd1-91ef-4312e0ec66e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:28.360514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0337f-31b0-4fd1-91ef-4312e0ec66e8 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:28.415836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:28.470853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 587/1183] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:41:28 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:41:28.477578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2f2f-00ab-4d5a-956d-f18215949b0f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:28.583925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:28.594647 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2f2f-00ab-4d5a-956d-f18215949b0f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:28.637709 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3721fc-bfae-4387-aae9-822941e9787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:28.638377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3721fc-bfae-4387-aae9-822941e9787e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:28.638723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3721fc-bfae-4387-aae9-822941e9787e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:28.639027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3721fc-bfae-4387-aae9-822941e9787e None admin] PATH_INFO: `/v3/projects/63270d7848ee48efaae0f568fdf4f814` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:28.640249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3721fc-bfae-4387-aae9-822941e9787e None admin] RBAC: Authorizing `identity:get_project(project_id=63270d7848ee48efaae0f568fdf4f814)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:28.641738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3721fc-bfae-4387-aae9-822941e9787e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:28.643512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 597/1184] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:41:28 2022] GET /identity/v3/projects/63270d7848ee48efaae0f568fdf4f814 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:41:28.650441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0337f-31b0-4fd1-91ef-4312e0ec66e8 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:28.756268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0337f-31b0-4fd1-91ef-4312e0ec66e8 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:28.803250 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884eaf42-10b7-4e62-8458-89b612f8a691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:28.803887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884eaf42-10b7-4e62-8458-89b612f8a691 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:28.804167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884eaf42-10b7-4e62-8458-89b612f8a691 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:28.804437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884eaf42-10b7-4e62-8458-89b612f8a691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:28.805236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884eaf42-10b7-4e62-8458-89b612f8a691 None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=63270d7848ee48efaae0f568fdf4f814, user.id=f1a4454ba6194682be96665dc34bffaf) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:41:28.805538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884eaf42-10b7-4e62-8458-89b612f8a691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:28.807004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884eaf42-10b7-4e62-8458-89b612f8a691 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:28.813196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 588/1185] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:41:28 2022] GET /identity/v3/role_assignments?user.id=f1a4454ba6194682be96665dc34bffaf&scope.project.id=63270d7848ee48efaae0f568fdf4f814&role.id=390e487a45f74246ba84773e8760bc7c => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:30.836691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d284-4ecc-4f38-9f53-2fb8fd76ae8a None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:30.837254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d284-4ecc-4f38-9f53-2fb8fd76ae8a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:30.837254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d284-4ecc-4f38-9f53-2fb8fd76ae8a None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:30.838495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 598/1186] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:30.844904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7766e-7d23-41c7-a7f9-4b29cde3d550 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:30.845598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7766e-7d23-41c7-a7f9-4b29cde3d550 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:30.845773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7766e-7d23-41c7-a7f9-4b29cde3d550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:30.873991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f0b7766e-7d23-41c7-a7f9-4b29cde3d550 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:30.875261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f0b7766e-7d23-41c7-a7f9-4b29cde3d550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:30.886673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:30.952823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 589/1187] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:30 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:30.977375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8d284-4ecc-4f38-9f53-2fb8fd76ae8a None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:31.093554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8d284-4ecc-4f38-9f53-2fb8fd76ae8a None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:31.141093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cbbf9-b561-45c7-9cd3-36256ab47f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:31.142173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cbbf9-b561-45c7-9cd3-36256ab47f25 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:31.142667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cbbf9-b561-45c7-9cd3-36256ab47f25 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:31.143207 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cbbf9-b561-45c7-9cd3-36256ab47f25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:31.162490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cbbf9-b561-45c7-9cd3-36256ab47f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-569cbbf9-b561-45c7-9cd3-36256ab47f25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:41:31.169440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:41:31.170631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:41:31.171711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 599/1188] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:41:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:41:31.177354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7766e-7d23-41c7-a7f9-4b29cde3d550 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:31.287646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7766e-7d23-41c7-a7f9-4b29cde3d550 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:31.324376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc62b5f-b0a9-4dce-b07e-eeb6f28e069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:31.325006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc62b5f-b0a9-4dce-b07e-eeb6f28e069a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:31.325283 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc62b5f-b0a9-4dce-b07e-eeb6f28e069a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:31.325561 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc62b5f-b0a9-4dce-b07e-eeb6f28e069a None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:31.326286 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc62b5f-b0a9-4dce-b07e-eeb6f28e069a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:41:31.326595 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc62b5f-b0a9-4dce-b07e-eeb6f28e069a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:31.328028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc62b5f-b0a9-4dce-b07e-eeb6f28e069a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:31.337257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 590/1189] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:41:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:41:31.346727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cbbf9-b561-45c7-9cd3-36256ab47f25 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:31.372873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:31.458613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cbbf9-b561-45c7-9cd3-36256ab47f25 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:31.500221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3081ba5-7a03-44c9-a90f-12ce0a3e5a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:31.500880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3081ba5-7a03-44c9-a90f-12ce0a3e5a62 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:31.501162 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3081ba5-7a03-44c9-a90f-12ce0a3e5a62 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:31.501497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3081ba5-7a03-44c9-a90f-12ce0a3e5a62 None admin] PATH_INFO: `/v3/users/f1a4454ba6194682be96665dc34bffaf` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:31.502716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3081ba5-7a03-44c9-a90f-12ce0a3e5a62 None admin] RBAC: Authorizing `identity:get_user(user_id=f1a4454ba6194682be96665dc34bffaf)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:31.504580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3081ba5-7a03-44c9-a90f-12ce0a3e5a62 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:31.506000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 600/1190] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:41:31 2022] GET /identity/v3/users/f1a4454ba6194682be96665dc34bffaf => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:31.514464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc62b5f-b0a9-4dce-b07e-eeb6f28e069a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:31.524781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:31.627263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc62b5f-b0a9-4dce-b07e-eeb6f28e069a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:31.666607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430f926-386e-403c-934c-abb7c71bb98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:31.667302 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430f926-386e-403c-934c-abb7c71bb98a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:31.667594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430f926-386e-403c-934c-abb7c71bb98a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:31.667878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430f926-386e-403c-934c-abb7c71bb98a None admin] PATH_INFO: `/v3/projects/63270d7848ee48efaae0f568fdf4f814` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:31.669115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430f926-386e-403c-934c-abb7c71bb98a None admin] RBAC: Authorizing `identity:get_project(project_id=63270d7848ee48efaae0f568fdf4f814)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:31.670585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430f926-386e-403c-934c-abb7c71bb98a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:31.672345 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 591/1191] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:41:31 2022] GET /identity/v3/projects/63270d7848ee48efaae0f568fdf4f814 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:31.679588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3081ba5-7a03-44c9-a90f-12ce0a3e5a62 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:31.776058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:31.793182 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3081ba5-7a03-44c9-a90f-12ce0a3e5a62 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:31.830433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cf2ef-c019-4ca0-b754-1c0a5e01b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:31.831156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf2ef-c019-4ca0-b754-1c0a5e01b1e2 None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:31.831435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf2ef-c019-4ca0-b754-1c0a5e01b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:31.831708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf2ef-c019-4ca0-b754-1c0a5e01b1e2 None admin] PATH_INFO: `/v3/projects/63270d7848ee48efaae0f568fdf4f814/users/f1a4454ba6194682be96665dc34bffaf/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:31.833799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cf2ef-c019-4ca0-b754-1c0a5e01b1e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=63270d7848ee48efaae0f568fdf4f814, user_id=f1a4454ba6194682be96665dc34bffaf, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:31.835270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cf2ef-c019-4ca0-b754-1c0a5e01b1e2 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:31.851339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 601/1192] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:41:31 2022] PUT /identity/v3/projects/63270d7848ee48efaae0f568fdf4f814/users/f1a4454ba6194682be96665dc34bffaf/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:41:33.939975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241afa2-20d5-407a-b3c8-b69811101314 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:33.940540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241afa2-20d5-407a-b3c8-b69811101314 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:33.940540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241afa2-20d5-407a-b3c8-b69811101314 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:33.941853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 592/1193] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:41:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:41:33.948551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334166b-81b0-49a1-ac5e-128709866236 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:33.949131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334166b-81b0-49a1-ac5e-128709866236 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:33.949131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334166b-81b0-49a1-ac5e-128709866236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:33.968831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-5334166b-81b0-49a1-ac5e-128709866236 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:41:33.970044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5334166b-81b0-49a1-ac5e-128709866236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:41:34.055769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 602/1194] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:41:33 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:41:34.086374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241afa2-20d5-407a-b3c8-b69811101314 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:34.178139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:34.205951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241afa2-20d5-407a-b3c8-b69811101314 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:34.245687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1d9c-c4d7-43b8-bf7f-6e50bb1f79f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:34.246347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1d9c-c4d7-43b8-bf7f-6e50bb1f79f3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:34.246632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1d9c-c4d7-43b8-bf7f-6e50bb1f79f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:34.246909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1d9c-c4d7-43b8-bf7f-6e50bb1f79f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:34.259717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1d9c-c4d7-43b8-bf7f-6e50bb1f79f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-83ef1d9c-c4d7-43b8-bf7f-6e50bb1f79f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:41:34.265394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:41:34.266545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:41:34.267592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 593/1195] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:41:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:41:34.274726 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334166b-81b0-49a1-ac5e-128709866236 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:34.369025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:34.396869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334166b-81b0-49a1-ac5e-128709866236 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:34.435055 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415a515-4928-46a0-a4a0-292c0b993982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:34.435685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415a515-4928-46a0-a4a0-292c0b993982 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:34.435962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415a515-4928-46a0-a4a0-292c0b993982 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:34.436233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415a515-4928-46a0-a4a0-292c0b993982 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:34.436968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415a515-4928-46a0-a4a0-292c0b993982 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:41:34.437269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415a515-4928-46a0-a4a0-292c0b993982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:34.438670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415a515-4928-46a0-a4a0-292c0b993982 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:34.448284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 603/1196] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:41:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:41:34.455024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1d9c-c4d7-43b8-bf7f-6e50bb1f79f3 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:34.566899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1d9c-c4d7-43b8-bf7f-6e50bb1f79f3 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:34.603320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e87bc-e9d0-4caf-8cd8-c4436ad05275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:34.603991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e87bc-e9d0-4caf-8cd8-c4436ad05275 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:34.604275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e87bc-e9d0-4caf-8cd8-c4436ad05275 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:34.604555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e87bc-e9d0-4caf-8cd8-c4436ad05275 None admin] PATH_INFO: `/v3/users/f1a4454ba6194682be96665dc34bffaf` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:34.605893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e87bc-e9d0-4caf-8cd8-c4436ad05275 None admin] RBAC: Authorizing `identity:get_user(user_id=f1a4454ba6194682be96665dc34bffaf)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:34.607411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e87bc-e9d0-4caf-8cd8-c4436ad05275 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:34.609096 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 594/1197] 10.222.0.124 () {56 vars in 1182 bytes} [Mon Aug 1 16:41:34 2022] GET /identity/v3/users/f1a4454ba6194682be96665dc34bffaf => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:34.615558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415a515-4928-46a0-a4a0-292c0b993982 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:34.726184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415a515-4928-46a0-a4a0-292c0b993982 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:34.764728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01ce68-3f8f-4f3d-9346-69e9830180af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:34.765281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01ce68-3f8f-4f3d-9346-69e9830180af None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:34.765562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01ce68-3f8f-4f3d-9346-69e9830180af None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:34.765838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01ce68-3f8f-4f3d-9346-69e9830180af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:34.776599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:34.850714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01ce68-3f8f-4f3d-9346-69e9830180af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:34.852285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01ce68-3f8f-4f3d-9346-69e9830180af None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:34.959734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 604/1198] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:41:34 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:41:34.965854 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e87bc-e9d0-4caf-8cd8-c4436ad05275 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:34.968923 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:35.079250 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e87bc-e9d0-4caf-8cd8-c4436ad05275 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:35.114747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9db026-e7a9-4849-949c-c6ef5d9c0430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:35.115429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9db026-e7a9-4849-949c-c6ef5d9c0430 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:35.115706 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9db026-e7a9-4849-949c-c6ef5d9c0430 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:35.115980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9db026-e7a9-4849-949c-c6ef5d9c0430 None admin] PATH_INFO: `/v3/projects/63270d7848ee48efaae0f568fdf4f814` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:35.117222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9db026-e7a9-4849-949c-c6ef5d9c0430 None admin] RBAC: Authorizing `identity:get_project(project_id=63270d7848ee48efaae0f568fdf4f814)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:35.118674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9db026-e7a9-4849-949c-c6ef5d9c0430 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:35.120607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 595/1199] 10.222.0.124 () {56 vars in 1191 bytes} [Mon Aug 1 16:41:34 2022] GET /identity/v3/projects/63270d7848ee48efaae0f568fdf4f814 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:35.126934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01ce68-3f8f-4f3d-9346-69e9830180af None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:41:35.169472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:35.256586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01ce68-3f8f-4f3d-9346-69e9830180af None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:41:35.308306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aae1e-4e74-4bfa-af86-e191f567415c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:41:35.308985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aae1e-4e74-4bfa-af86-e191f567415c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:41:35.309269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aae1e-4e74-4bfa-af86-e191f567415c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:41:35.309541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aae1e-4e74-4bfa-af86-e191f567415c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:41:35.310363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aae1e-4e74-4bfa-af86-e191f567415c None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=63270d7848ee48efaae0f568fdf4f814, user.id=f1a4454ba6194682be96665dc34bffaf) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:41:35.310679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aae1e-4e74-4bfa-af86-e191f567415c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:41:35.312183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aae1e-4e74-4bfa-af86-e191f567415c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:41:35.319641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 605/1200] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:41:35 2022] GET /identity/v3/role_assignments?user.id=f1a4454ba6194682be96665dc34bffaf&scope.project.id=63270d7848ee48efaae0f568fdf4f814&role.id=390e487a45f74246ba84773e8760bc7c => generated 610 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:41:45.111013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=65 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:45.316718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=49 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:38.197276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06087-4287-4bcb-a944-0c7ac53312b4 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:38.197909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06087-4287-4bcb-a944-0c7ac53312b4 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:38.197909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06087-4287-4bcb-a944-0c7ac53312b4 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:38.199891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 596/1201] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:42:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:42:38.206481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b08a7-ff62-4a62-9e84-85199225b1c2 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:38.207109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b08a7-ff62-4a62-9e84-85199225b1c2 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:38.207109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b08a7-ff62-4a62-9e84-85199225b1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:38.233789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-e63b08a7-ff62-4a62-9e84-85199225b1c2 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:42:38.235527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e63b08a7-ff62-4a62-9e84-85199225b1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:42:38.335004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 606/1202] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:42:38 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:42:38.361880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f06087-4287-4bcb-a944-0c7ac53312b4 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:38.503431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f06087-4287-4bcb-a944-0c7ac53312b4 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:38.563807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2335a-ed46-48d0-85b5-a57bdbbe6993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:38.563807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2335a-ed46-48d0-85b5-a57bdbbe6993 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:38.563807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2335a-ed46-48d0-85b5-a57bdbbe6993 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:38.563807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2335a-ed46-48d0-85b5-a57bdbbe6993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:38.578100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2335a-ed46-48d0-85b5-a57bdbbe6993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:38.579743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2335a-ed46-48d0-85b5-a57bdbbe6993 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-63a2335a-ed46-48d0-85b5-a57bdbbe6993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:42:38.600778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:38.602038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:38.604103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:42:38.604103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:42:38.604103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:38.604103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:42:38.604103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 597/1203] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:38.609080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b08a7-ff62-4a62-9e84-85199225b1c2 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:38.780415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b08a7-ff62-4a62-9e84-85199225b1c2 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:38.840203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:38.856309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a907e-ce24-4429-8b5f-4892c927d7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:38.856968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a907e-ce24-4429-8b5f-4892c927d7fa None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:38.857371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a907e-ce24-4429-8b5f-4892c927d7fa None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:38.857594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a907e-ce24-4429-8b5f-4892c927d7fa None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:38.858332 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a907e-ce24-4429-8b5f-4892c927d7fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:38.858643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a907e-ce24-4429-8b5f-4892c927d7fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:38.860140 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a907e-ce24-4429-8b5f-4892c927d7fa None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:38.875019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 607/1204] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:42:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:38.881003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2335a-ed46-48d0-85b5-a57bdbbe6993 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:38.968644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:39.040150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2335a-ed46-48d0-85b5-a57bdbbe6993 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:39.090234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843bbee-699c-40c7-b47a-35e4f152a113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:39.090932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843bbee-699c-40c7-b47a-35e4f152a113 None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:39.091327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843bbee-699c-40c7-b47a-35e4f152a113 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:39.091610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843bbee-699c-40c7-b47a-35e4f152a113 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:39.092330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843bbee-699c-40c7-b47a-35e4f152a113 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:39.093801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843bbee-699c-40c7-b47a-35e4f152a113 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:39.123013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 598/1205] 10.222.0.124 () {60 vars in 1137 bytes} [Mon Aug 1 16:42:38 2022] POST /identity/v3/users => generated 252 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:42:41.519751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed4a1a-5e4e-41b4-8178-49c3123864c2 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:41.520674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed4a1a-5e4e-41b4-8178-49c3123864c2 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:41.520674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed4a1a-5e4e-41b4-8178-49c3123864c2 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:41.522304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 608/1206] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:42:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:42:41.529171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3c71-413c-4179-81d0-506d9825774e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:41.529914 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3c71-413c-4179-81d0-506d9825774e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:41.529914 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3c71-413c-4179-81d0-506d9825774e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:41.554474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-c0ae3c71-413c-4179-81d0-506d9825774e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:42:41.555890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c0ae3c71-413c-4179-81d0-506d9825774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:42:41.664108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 599/1207] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:42:41 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:42:41.697780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed4a1a-5e4e-41b4-8178-49c3123864c2 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:41.869641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed4a1a-5e4e-41b4-8178-49c3123864c2 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:41.913905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a91d5a-b8c2-4db6-8234-5c752f603679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:41.914686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a91d5a-b8c2-4db6-8234-5c752f603679 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:41.915031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a91d5a-b8c2-4db6-8234-5c752f603679 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:41.915315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a91d5a-b8c2-4db6-8234-5c752f603679 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:41.928221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a91d5a-b8c2-4db6-8234-5c752f603679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d8a91d5a-b8c2-4db6-8234-5c752f603679 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:42:41.933418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:41.935880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:41.936740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 609/1208] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:42:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:41.942397 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae3c71-413c-4179-81d0-506d9825774e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:42.000370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:42.079243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae3c71-413c-4179-81d0-506d9825774e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:42.126535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e42bb9-4544-405f-86e6-4897c2eee2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:42.126535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e42bb9-4544-405f-86e6-4897c2eee2ef None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:42.126535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e42bb9-4544-405f-86e6-4897c2eee2ef None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:42.126535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e42bb9-4544-405f-86e6-4897c2eee2ef None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:42.127059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e42bb9-4544-405f-86e6-4897c2eee2ef None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:42.127059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e42bb9-4544-405f-86e6-4897c2eee2ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:42.127059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e42bb9-4544-405f-86e6-4897c2eee2ef None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:42.136857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 600/1209] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:42:41 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:42.145287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a91d5a-b8c2-4db6-8234-5c752f603679 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:42.210429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:42.280237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a91d5a-b8c2-4db6-8234-5c752f603679 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:42.324198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d630b90-4c01-4cee-8fd5-d7c6d37af669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:42.324851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d630b90-4c01-4cee-8fd5-d7c6d37af669 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:42.325130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d630b90-4c01-4cee-8fd5-d7c6d37af669 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:42.325426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d630b90-4c01-4cee-8fd5-d7c6d37af669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:42.336987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d630b90-4c01-4cee-8fd5-d7c6d37af669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:42.339070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d630b90-4c01-4cee-8fd5-d7c6d37af669 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-4d630b90-4c01-4cee-8fd5-d7c6d37af669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:42:42.356402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:42.357395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:42.358294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:42:42.358294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:42:42.358294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:42.358294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:42.362754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 610/1210] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:42.364295 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e42bb9-4544-405f-86e6-4897c2eee2ef None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:42.499347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:42.506683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e42bb9-4544-405f-86e6-4897c2eee2ef None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:42.559717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258969f-f3b2-411b-a7c9-378a734b101a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:42.560942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258969f-f3b2-411b-a7c9-378a734b101a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:42.561599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258969f-f3b2-411b-a7c9-378a734b101a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:42.562162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258969f-f3b2-411b-a7c9-378a734b101a None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:42.564419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258969f-f3b2-411b-a7c9-378a734b101a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:42.566412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258969f-f3b2-411b-a7c9-378a734b101a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:42.567817 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258969f-f3b2-411b-a7c9-378a734b101a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:42.593782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 601/1211] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:42:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:42:42.602173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d630b90-4c01-4cee-8fd5-d7c6d37af669 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:42.749680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d630b90-4c01-4cee-8fd5-d7c6d37af669 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:42.751793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:42.793427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf88ce1-a63f-4d6e-8264-a8d7b47bdf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:42.794096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf88ce1-a63f-4d6e-8264-a8d7b47bdf21 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:42.794444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf88ce1-a63f-4d6e-8264-a8d7b47bdf21 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:42.794921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf88ce1-a63f-4d6e-8264-a8d7b47bdf21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:42.805017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf88ce1-a63f-4d6e-8264-a8d7b47bdf21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:42.807649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf88ce1-a63f-4d6e-8264-a8d7b47bdf21 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-7bf88ce1-a63f-4d6e-8264-a8d7b47bdf21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:42:42.828127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:42.829243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:42.830253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:42.830253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:42.830253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:42:42.830253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:42:42.830253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:42:42.830253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:42:42.830253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:42:42.830253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:42:42.830253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:42:42.830253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:42.830253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 611/1212] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:42:42.837974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258969f-f3b2-411b-a7c9-378a734b101a None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:42.976089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258969f-f3b2-411b-a7c9-378a734b101a None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:43.020028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a4544-09d4-4522-915d-7ddbeccc4e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:43.020657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a4544-09d4-4522-915d-7ddbeccc4e30 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:43.020934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a4544-09d4-4522-915d-7ddbeccc4e30 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:43.021213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a4544-09d4-4522-915d-7ddbeccc4e30 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:43.022197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a4544-09d4-4522-915d-7ddbeccc4e30 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:43.022523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a4544-09d4-4522-915d-7ddbeccc4e30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:43.025898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a4544-09d4-4522-915d-7ddbeccc4e30 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:43.053816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 602/1213] 10.222.0.124 () {56 vars in 1148 bytes} [Mon Aug 1 16:42:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:43.055740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf88ce1-a63f-4d6e-8264-a8d7b47bdf21 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:43.195946 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf88ce1-a63f-4d6e-8264-a8d7b47bdf21 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:43.241949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb302e7-e16d-4733-ab60-fb30e1714d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:43.242599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb302e7-e16d-4733-ab60-fb30e1714d4e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:43.242889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb302e7-e16d-4733-ab60-fb30e1714d4e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:43.243216 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb302e7-e16d-4733-ab60-fb30e1714d4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:43.281159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:43.326645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb302e7-e16d-4733-ab60-fb30e1714d4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:43.328585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb302e7-e16d-4733-ab60-fb30e1714d4e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:43.467203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 612/1214] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:42:43 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:42:43.474065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a4544-09d4-4522-915d-7ddbeccc4e30 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:43.505667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:43.607896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a4544-09d4-4522-915d-7ddbeccc4e30 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:43.659167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888afe-f69c-4b06-8cb2-91430420df07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:43.660172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888afe-f69c-4b06-8cb2-91430420df07 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:43.660663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888afe-f69c-4b06-8cb2-91430420df07 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:43.661088 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888afe-f69c-4b06-8cb2-91430420df07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:43.673351 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d888afe-f69c-4b06-8cb2-91430420df07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:43.674874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d888afe-f69c-4b06-8cb2-91430420df07 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-7d888afe-f69c-4b06-8cb2-91430420df07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:42:43.691480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:43.692921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:43.694075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:42:43.694075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:42:43.694075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:43.694075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:42:43.694075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 603/1215] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:42:43.699942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb302e7-e16d-4733-ab60-fb30e1714d4e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:43.774300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:43.822255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb302e7-e16d-4733-ab60-fb30e1714d4e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:43.866150 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815f22-f094-42f7-b332-1134cbc7b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:43.866992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815f22-f094-42f7-b332-1134cbc7b14b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:43.867328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815f22-f094-42f7-b332-1134cbc7b14b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:43.867615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815f22-f094-42f7-b332-1134cbc7b14b None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:43.868306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19815f22-f094-42f7-b332-1134cbc7b14b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:43.868618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19815f22-f094-42f7-b332-1134cbc7b14b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:43.870288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19815f22-f094-42f7-b332-1134cbc7b14b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:43.886303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 613/1216] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:42:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:43.890095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888afe-f69c-4b06-8cb2-91430420df07 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:44.017750 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:44.059298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888afe-f69c-4b06-8cb2-91430420df07 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:44.099103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee176cdf-f912-4cda-8219-f0be3458f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:44.099828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee176cdf-f912-4cda-8219-f0be3458f093 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:44.100120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee176cdf-f912-4cda-8219-f0be3458f093 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:44.100379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee176cdf-f912-4cda-8219-f0be3458f093 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:44.108311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee176cdf-f912-4cda-8219-f0be3458f093 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:44.109835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee176cdf-f912-4cda-8219-f0be3458f093 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-ee176cdf-f912-4cda-8219-f0be3458f093 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:42:44.126387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:44.127815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:44.130160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:42:44.130160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:42:44.130160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:42:44.130160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:42:44.130160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:42:44.130160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:42:44.130160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:42:44.130160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:42:44.130160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 604/1217] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:42:44.138503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815f22-f094-42f7-b332-1134cbc7b14b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:44.298815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815f22-f094-42f7-b332-1134cbc7b14b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:44.330195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:44.346194 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fb017-86eb-4089-9749-e8c2620cc219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:44.346845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fb017-86eb-4089-9749-e8c2620cc219 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:44.347157 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fb017-86eb-4089-9749-e8c2620cc219 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:44.347433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fb017-86eb-4089-9749-e8c2620cc219 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:44.348242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fb017-86eb-4089-9749-e8c2620cc219 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:44.348553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fb017-86eb-4089-9749-e8c2620cc219 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:44.350043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fb017-86eb-4089-9749-e8c2620cc219 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:44.371103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 614/1218] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:44.372791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee176cdf-f912-4cda-8219-f0be3458f093 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:44.502544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee176cdf-f912-4cda-8219-f0be3458f093 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:44.536771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:44.544182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab3a46-133b-4b05-b49f-5114ebfe2fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:44.544907 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab3a46-133b-4b05-b49f-5114ebfe2fc2 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:44.545233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab3a46-133b-4b05-b49f-5114ebfe2fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:44.545656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab3a46-133b-4b05-b49f-5114ebfe2fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:44.546758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab3a46-133b-4b05-b49f-5114ebfe2fc2 None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=6deeea314be545609b0fe4dd786b3b9e) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:44.547213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab3a46-133b-4b05-b49f-5114ebfe2fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:44.548941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab3a46-133b-4b05-b49f-5114ebfe2fc2 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:44.556704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 605/1219] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:42:44 2022] GET /identity/v3/role_assignments?user.id=6deeea314be545609b0fe4dd786b3b9e&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:46.732099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187730e8-e5b0-4736-bdff-59522c426670 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:46.732727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187730e8-e5b0-4736-bdff-59522c426670 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:46.732727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187730e8-e5b0-4736-bdff-59522c426670 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:46.734157 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 615/1220] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:42:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:42:46.741905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c382749-4f03-4aa8-9c6e-2b72580c69a3 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:46.742438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c382749-4f03-4aa8-9c6e-2b72580c69a3 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:46.742573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c382749-4f03-4aa8-9c6e-2b72580c69a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:46.764847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1c382749-4f03-4aa8-9c6e-2b72580c69a3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:42:46.765992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1c382749-4f03-4aa8-9c6e-2b72580c69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:42:46.843871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 606/1221] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:42:46 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:42:46.868189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187730e8-e5b0-4736-bdff-59522c426670 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:46.996856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187730e8-e5b0-4736-bdff-59522c426670 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:47.042618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51297582-25ee-40dc-baa0-b1618f4b6a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:47.043237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297582-25ee-40dc-baa0-b1618f4b6a56 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:47.043522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297582-25ee-40dc-baa0-b1618f4b6a56 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:47.043789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297582-25ee-40dc-baa0-b1618f4b6a56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:47.054854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51297582-25ee-40dc-baa0-b1618f4b6a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-51297582-25ee-40dc-baa0-b1618f4b6a56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:42:47.059852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:47.061025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:47.061859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 616/1222] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:42:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:47.067924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c382749-4f03-4aa8-9c6e-2b72580c69a3 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:47.181223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c382749-4f03-4aa8-9c6e-2b72580c69a3 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:47.208401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:47.222162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c722601-60d2-4e3c-aca1-65c79e2ab489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:47.222837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722601-60d2-4e3c-aca1-65c79e2ab489 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:47.223146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722601-60d2-4e3c-aca1-65c79e2ab489 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:47.223485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722601-60d2-4e3c-aca1-65c79e2ab489 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:47.224360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c722601-60d2-4e3c-aca1-65c79e2ab489 None admin] RBAC: Adding query filter params (name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:47.224842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c722601-60d2-4e3c-aca1-65c79e2ab489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:47.226806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c722601-60d2-4e3c-aca1-65c79e2ab489 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:47.237759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 607/1223] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:42:47 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:47.245622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51297582-25ee-40dc-baa0-b1618f4b6a56 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:47.302683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:47.373625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51297582-25ee-40dc-baa0-b1618f4b6a56 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:47.415246 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a02a6-1d23-4e44-943d-14e83016380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:47.415967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a02a6-1d23-4e44-943d-14e83016380b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:47.416319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a02a6-1d23-4e44-943d-14e83016380b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:47.416713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a02a6-1d23-4e44-943d-14e83016380b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:47.433727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a02a6-1d23-4e44-943d-14e83016380b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:47.435414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a02a6-1d23-4e44-943d-14e83016380b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-8c7a02a6-1d23-4e44-943d-14e83016380b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:42:47.455302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:47.456429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:47.462565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:42:47.462565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:42:47.462565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:47.462565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:47.462565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 617/1224] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:47.463775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c722601-60d2-4e3c-aca1-65c79e2ab489 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:47.616346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c722601-60d2-4e3c-aca1-65c79e2ab489 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:47.661436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77aea9-d93f-4675-98c9-bf95e523c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:47.662320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77aea9-d93f-4675-98c9-bf95e523c84c None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:47.662625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77aea9-d93f-4675-98c9-bf95e523c84c None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:47.662904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77aea9-d93f-4675-98c9-bf95e523c84c None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:47.663678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77aea9-d93f-4675-98c9-bf95e523c84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:47.664200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77aea9-d93f-4675-98c9-bf95e523c84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:47.665496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77aea9-d93f-4675-98c9-bf95e523c84c None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:47.689643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 608/1225] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:42:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:47.691172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a02a6-1d23-4e44-943d-14e83016380b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:47.804228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:47.813806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a02a6-1d23-4e44-943d-14e83016380b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:47.854834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776034-d792-4fd0-aaf4-48116c24cffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:47.855442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776034-d792-4fd0-aaf4-48116c24cffa None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:47.855738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776034-d792-4fd0-aaf4-48116c24cffa None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:47.856103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776034-d792-4fd0-aaf4-48116c24cffa None admin] PATH_INFO: `/v3/users/placement` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:47.864755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2776034-d792-4fd0-aaf4-48116c24cffa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:47.866213 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2776034-d792-4fd0-aaf4-48116c24cffa None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d2776034-d792-4fd0-aaf4-48116c24cffa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:42:47.878831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:47.880085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:47.881078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:47.881078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:47.881078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:42:47.881078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:42:47.881078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:42:47.881078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:42:47.881078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:42:47.881078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:42:47.881078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:42:47.881078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:47.881078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 618/1226] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:47.886468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77aea9-d93f-4675-98c9-bf95e523c84c None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:47.951082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:48.018445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77aea9-d93f-4675-98c9-bf95e523c84c None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:48.064392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6d19f-db39-44b5-ae77-c9b4df673315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:48.065130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d19f-db39-44b5-ae77-c9b4df673315 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:48.065420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d19f-db39-44b5-ae77-c9b4df673315 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:48.065706 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d19f-db39-44b5-ae77-c9b4df673315 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:48.066796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6d19f-db39-44b5-ae77-c9b4df673315 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:48.067231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6d19f-db39-44b5-ae77-c9b4df673315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:48.068973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6d19f-db39-44b5-ae77-c9b4df673315 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:48.090627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 609/1227] 10.222.0.124 () {56 vars in 1148 bytes} [Mon Aug 1 16:42:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:48.097885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776034-d792-4fd0-aaf4-48116c24cffa None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:48.214000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776034-d792-4fd0-aaf4-48116c24cffa None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:48.255239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42430cf-44dc-4907-9f99-92fc133c2693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:48.255902 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42430cf-44dc-4907-9f99-92fc133c2693 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:48.256179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42430cf-44dc-4907-9f99-92fc133c2693 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:48.256446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42430cf-44dc-4907-9f99-92fc133c2693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:48.269509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42430cf-44dc-4907-9f99-92fc133c2693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:48.271032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42430cf-44dc-4907-9f99-92fc133c2693 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-f42430cf-44dc-4907-9f99-92fc133c2693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:42:48.286842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:48.288030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:48.289196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:42:48.289196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:42:48.289196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:48.289196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:48.289196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 619/1228] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:42:48.296272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6d19f-db39-44b5-ae77-c9b4df673315 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:48.417939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6d19f-db39-44b5-ae77-c9b4df673315 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:48.420417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:48.459393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c33970-a323-4c4a-9064-1a9a86c2f6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:48.460027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33970-a323-4c4a-9064-1a9a86c2f6c9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:48.460300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33970-a323-4c4a-9064-1a9a86c2f6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:48.460608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33970-a323-4c4a-9064-1a9a86c2f6c9 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:48.461310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c33970-a323-4c4a-9064-1a9a86c2f6c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:48.461615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c33970-a323-4c4a-9064-1a9a86c2f6c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:48.463026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c33970-a323-4c4a-9064-1a9a86c2f6c9 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:48.476620 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 610/1229] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:42:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:48.483099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42430cf-44dc-4907-9f99-92fc133c2693 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:48.496515 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:48.609869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42430cf-44dc-4907-9f99-92fc133c2693 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:48.648326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a0663-9357-426d-af70-b3f8121a4e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:48.649078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a0663-9357-426d-af70-b3f8121a4e2e None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:48.649410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a0663-9357-426d-af70-b3f8121a4e2e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:48.649702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a0663-9357-426d-af70-b3f8121a4e2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:48.659276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a0663-9357-426d-af70-b3f8121a4e2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:48.661034 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a0663-9357-426d-af70-b3f8121a4e2e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-967a0663-9357-426d-af70-b3f8121a4e2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:42:48.674451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:48.675538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:48.677315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:42:48.677315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:42:48.677315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:42:48.677315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:42:48.677315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:42:48.677315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:42:48.677315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:42:48.677315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:48.677315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 620/1230] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:42:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:48.682728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c33970-a323-4c4a-9064-1a9a86c2f6c9 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:48.803486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c33970-a323-4c4a-9064-1a9a86c2f6c9 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:48.850351 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1ba40-eb28-4b84-999d-a64fcbe0bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:48.851099 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1ba40-eb28-4b84-999d-a64fcbe0bf5a None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:48.851389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1ba40-eb28-4b84-999d-a64fcbe0bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:48.851786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1ba40-eb28-4b84-999d-a64fcbe0bf5a None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:48.852618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1ba40-eb28-4b84-999d-a64fcbe0bf5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:48.853060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1ba40-eb28-4b84-999d-a64fcbe0bf5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:48.855266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1ba40-eb28-4b84-999d-a64fcbe0bf5a None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:48.871567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 611/1231] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:42:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:48.877812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a0663-9357-426d-af70-b3f8121a4e2e None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:48.962677 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:49.005391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a0663-9357-426d-af70-b3f8121a4e2e None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:49.044922 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61683d-4ebe-4538-bdae-8c75e615fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:49.045726 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61683d-4ebe-4538-bdae-8c75e615fba0 None admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:49.046208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61683d-4ebe-4538-bdae-8c75e615fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:49.046208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61683d-4ebe-4538-bdae-8c75e615fba0 None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/6deeea314be545609b0fe4dd786b3b9e/roles/3e4fc6b2b9bb4951bc7eda99c41e5733` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:49.063747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61683d-4ebe-4538-bdae-8c75e615fba0 None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=6deeea314be545609b0fe4dd786b3b9e, role_id=3e4fc6b2b9bb4951bc7eda99c41e5733)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:49.065374 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61683d-4ebe-4538-bdae-8c75e615fba0 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:49.080889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 621/1232] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:42:48 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/6deeea314be545609b0fe4dd786b3b9e/roles/3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:42:51.254884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede3716-60f5-4a31-871b-2d93e40cf010 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:51.255562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede3716-60f5-4a31-871b-2d93e40cf010 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:51.255562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede3716-60f5-4a31-871b-2d93e40cf010 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:51.256967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 612/1233] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:42:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:42:51.270300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d4176-d185-47a5-a890-610cf4fbc372 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:51.270892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d4176-d185-47a5-a890-610cf4fbc372 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:51.271023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d4176-d185-47a5-a890-610cf4fbc372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:51.292589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-146d4176-d185-47a5-a890-610cf4fbc372 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:42:51.294471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-146d4176-d185-47a5-a890-610cf4fbc372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:42:51.376340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 622/1234] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:42:51 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:42:51.402319 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede3716-60f5-4a31-871b-2d93e40cf010 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:51.431708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:51.518758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede3716-60f5-4a31-871b-2d93e40cf010 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:51.556901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d1ea6-06e4-4592-8e62-3be185ccc8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:51.557756 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d1ea6-06e4-4592-8e62-3be185ccc8f0 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:51.558039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d1ea6-06e4-4592-8e62-3be185ccc8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:51.558415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d1ea6-06e4-4592-8e62-3be185ccc8f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:51.570510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d1ea6-06e4-4592-8e62-3be185ccc8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-168d1ea6-06e4-4592-8e62-3be185ccc8f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:42:51.576623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:51.579118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:42:51.580061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 613/1235] 10.222.0.124 () {56 vars in 1107 bytes} [Mon Aug 1 16:42:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:51.584359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d4176-d185-47a5-a890-610cf4fbc372 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:51.633595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:51.703639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d4176-d185-47a5-a890-610cf4fbc372 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:51.744731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001649c0-585a-416a-b402-da357463c246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:51.745367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001649c0-585a-416a-b402-da357463c246 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:51.745704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001649c0-585a-416a-b402-da357463c246 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:51.746131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001649c0-585a-416a-b402-da357463c246 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:51.746873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001649c0-585a-416a-b402-da357463c246 None admin] RBAC: Adding query filter params (name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:51.747202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001649c0-585a-416a-b402-da357463c246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:51.748595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001649c0-585a-416a-b402-da357463c246 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:51.758016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 623/1236] 10.222.0.124 () {56 vars in 1108 bytes} [Mon Aug 1 16:42:51 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:51.764393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d1ea6-06e4-4592-8e62-3be185ccc8f0 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:51.865085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:51.892303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d1ea6-06e4-4592-8e62-3be185ccc8f0 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:51.935260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f742f-f1d9-4dd4-bf23-b461b76beb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:51.935932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f742f-f1d9-4dd4-bf23-b461b76beb92 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:51.936215 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f742f-f1d9-4dd4-bf23-b461b76beb92 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:51.936823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f742f-f1d9-4dd4-bf23-b461b76beb92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:51.952090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f742f-f1d9-4dd4-bf23-b461b76beb92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:51.954673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f742f-f1d9-4dd4-bf23-b461b76beb92 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-076f742f-f1d9-4dd4-bf23-b461b76beb92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:42:51.973389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:51.974699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:51.975860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:42:51.975860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:42:51.975860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:51.975860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:42:51.975860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 614/1237] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:51.980691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001649c0-585a-416a-b402-da357463c246 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:52.087117 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001649c0-585a-416a-b402-da357463c246 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:52.096385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:52.127419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10499194-714d-4e48-bc55-5d8e34e06568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:52.128052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10499194-714d-4e48-bc55-5d8e34e06568 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:52.128329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10499194-714d-4e48-bc55-5d8e34e06568 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:52.128598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10499194-714d-4e48-bc55-5d8e34e06568 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:52.129327 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10499194-714d-4e48-bc55-5d8e34e06568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:52.129630 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10499194-714d-4e48-bc55-5d8e34e06568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:52.131043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10499194-714d-4e48-bc55-5d8e34e06568 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:52.144795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 624/1238] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:42:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:52.151893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f742f-f1d9-4dd4-bf23-b461b76beb92 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:52.282186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f742f-f1d9-4dd4-bf23-b461b76beb92 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:52.320832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cdfb2-1e5d-4b84-a17d-548206b1d78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:52.321473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cdfb2-1e5d-4b84-a17d-548206b1d78b None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:52.321749 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cdfb2-1e5d-4b84-a17d-548206b1d78b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:52.322018 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cdfb2-1e5d-4b84-a17d-548206b1d78b None admin] PATH_INFO: `/v3/users/placement` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:52.324864 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:52.330667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cdfb2-1e5d-4b84-a17d-548206b1d78b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:52.332247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cdfb2-1e5d-4b84-a17d-548206b1d78b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-c05cdfb2-1e5d-4b84-a17d-548206b1d78b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:42:52.344759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:52.345852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:52.346831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:52.346831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:52.346831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:42:52.346831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:42:52.346831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:42:52.346831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:42:52.346831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:42:52.346831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:42:52.346831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:42:52.346831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:42:52.346831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 615/1239] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:42:52.352587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10499194-714d-4e48-bc55-5d8e34e06568 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:52.484135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10499194-714d-4e48-bc55-5d8e34e06568 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:52.525031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2b286-c3fb-4e24-a5cf-edb8c9e9ee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:52.525755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2b286-c3fb-4e24-a5cf-edb8c9e9ee36 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:52.526048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2b286-c3fb-4e24-a5cf-edb8c9e9ee36 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:52.526327 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2b286-c3fb-4e24-a5cf-edb8c9e9ee36 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:52.527269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2b286-c3fb-4e24-a5cf-edb8c9e9ee36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:52.527659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2b286-c3fb-4e24-a5cf-edb8c9e9ee36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:52.529371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2b286-c3fb-4e24-a5cf-edb8c9e9ee36 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:52.550091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 625/1240] 10.222.0.124 () {56 vars in 1148 bytes} [Mon Aug 1 16:42:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:52.556012 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cdfb2-1e5d-4b84-a17d-548206b1d78b None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:52.684272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cdfb2-1e5d-4b84-a17d-548206b1d78b None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:52.726563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cdcc3-5d4d-4f8c-b24e-b4443c2c7b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:52.727265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdcc3-5d4d-4f8c-b24e-b4443c2c7b1f None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:52.727558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdcc3-5d4d-4f8c-b24e-b4443c2c7b1f None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:52.727838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdcc3-5d4d-4f8c-b24e-b4443c2c7b1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:52.813430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:52.821990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cdcc3-5d4d-4f8c-b24e-b4443c2c7b1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:52.823753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cdcc3-5d4d-4f8c-b24e-b4443c2c7b1f None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:52.960105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 616/1241] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:42:52 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:42:52.968902 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2b286-c3fb-4e24-a5cf-edb8c9e9ee36 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:53.015311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:53.114886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2b286-c3fb-4e24-a5cf-edb8c9e9ee36 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:53.157957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5f319-94ac-4eb7-8a72-96e62b650a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:53.158770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5f319-94ac-4eb7-8a72-96e62b650a63 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:53.159080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5f319-94ac-4eb7-8a72-96e62b650a63 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:53.159380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5f319-94ac-4eb7-8a72-96e62b650a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:53.171444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5f319-94ac-4eb7-8a72-96e62b650a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:53.173004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5f319-94ac-4eb7-8a72-96e62b650a63 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-33a5f319-94ac-4eb7-8a72-96e62b650a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:42:53.190444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:53.192281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:53.193469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:42:53.193469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:42:53.193469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:53.193469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:53.193469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 626/1242] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:53.198476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cdcc3-5d4d-4f8c-b24e-b4443c2c7b1f None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:53.319954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:53.328551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cdcc3-5d4d-4f8c-b24e-b4443c2c7b1f None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:53.379201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72455992-6d59-4f9e-96cb-ff2188bb8f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:53.379954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72455992-6d59-4f9e-96cb-ff2188bb8f45 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:53.380281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72455992-6d59-4f9e-96cb-ff2188bb8f45 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:53.380569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72455992-6d59-4f9e-96cb-ff2188bb8f45 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:53.381374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72455992-6d59-4f9e-96cb-ff2188bb8f45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:53.381713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72455992-6d59-4f9e-96cb-ff2188bb8f45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:53.383353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72455992-6d59-4f9e-96cb-ff2188bb8f45 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:53.398475 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 617/1243] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:42:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:42:53.405754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5f319-94ac-4eb7-8a72-96e62b650a63 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:53.516440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:53.542692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5f319-94ac-4eb7-8a72-96e62b650a63 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:53.595347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529fa6b-591b-409f-b822-d10523ebd1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:53.595909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fa6b-591b-409f-b822-d10523ebd1da None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:53.596309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fa6b-591b-409f-b822-d10523ebd1da None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:53.596585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fa6b-591b-409f-b822-d10523ebd1da None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:53.605201 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529fa6b-591b-409f-b822-d10523ebd1da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:53.607090 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529fa6b-591b-409f-b822-d10523ebd1da None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-d529fa6b-591b-409f-b822-d10523ebd1da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:42:53.620412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:53.621493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:53.622410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:42:53.622410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:42:53.622410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:42:53.622410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:42:53.622410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:42:53.622410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:42:53.622410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:42:53.622410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:53.622410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 627/1244] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:53.628795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72455992-6d59-4f9e-96cb-ff2188bb8f45 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:53.755455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72455992-6d59-4f9e-96cb-ff2188bb8f45 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:53.807535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f0543-8e5f-4309-88de-93960a198ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:53.808179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0543-8e5f-4309-88de-93960a198ab8 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:53.808447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0543-8e5f-4309-88de-93960a198ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:53.808730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0543-8e5f-4309-88de-93960a198ab8 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:53.809506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f0543-8e5f-4309-88de-93960a198ab8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:53.809801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f0543-8e5f-4309-88de-93960a198ab8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:53.811663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f0543-8e5f-4309-88de-93960a198ab8 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:53.825789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 618/1245] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:42:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:53.832400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529fa6b-591b-409f-b822-d10523ebd1da None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:53.969912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529fa6b-591b-409f-b822-d10523ebd1da None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:54.015626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938428fe-88f1-4036-ba71-0e7dc63501ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:54.016268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938428fe-88f1-4036-ba71-0e7dc63501ad None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:54.016691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938428fe-88f1-4036-ba71-0e7dc63501ad None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:54.016972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938428fe-88f1-4036-ba71-0e7dc63501ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:54.018141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938428fe-88f1-4036-ba71-0e7dc63501ad None admin] RBAC: Adding query filter params (role.id=3e4fc6b2b9bb4951bc7eda99c41e5733, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=6deeea314be545609b0fe4dd786b3b9e) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:54.018500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938428fe-88f1-4036-ba71-0e7dc63501ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:54.020139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938428fe-88f1-4036-ba71-0e7dc63501ad None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:54.028512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 628/1246] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:42:53 2022] GET /identity/v3/role_assignments?user.id=6deeea314be545609b0fe4dd786b3b9e&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=3e4fc6b2b9bb4951bc7eda99c41e5733 => generated 610 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:56.380525 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4863e-876c-425f-bcb3-81ef09841e9d None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:56.381130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4863e-876c-425f-bcb3-81ef09841e9d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:56.381130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4863e-876c-425f-bcb3-81ef09841e9d None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:56.382484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 619/1247] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:42:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:42:56.390834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dbddb-4d54-4308-ba21-e2dc2991ef83 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:56.391501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dbddb-4d54-4308-ba21-e2dc2991ef83 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:56.391501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dbddb-4d54-4308-ba21-e2dc2991ef83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:56.398909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:56.413952 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-532dbddb-4d54-4308-ba21-e2dc2991ef83 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:42:56.415339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-532dbddb-4d54-4308-ba21-e2dc2991ef83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:42:56.513272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 629/1248] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:42:56 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:42:56.538862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4863e-876c-425f-bcb3-81ef09841e9d None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:56.570353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:56.676410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4863e-876c-425f-bcb3-81ef09841e9d None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:56.723051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b847a2-9fe9-4b56-80bc-06615e2a92f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:56.723828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b847a2-9fe9-4b56-80bc-06615e2a92f9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:56.724765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b847a2-9fe9-4b56-80bc-06615e2a92f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:56.724765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b847a2-9fe9-4b56-80bc-06615e2a92f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:56.738975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b847a2-9fe9-4b56-80bc-06615e2a92f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-d6b847a2-9fe9-4b56-80bc-06615e2a92f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:42:56.744501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:56.745837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:42:56.747065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 620/1249] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:42:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:56.752876 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dbddb-4d54-4308-ba21-e2dc2991ef83 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:56.886642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dbddb-4d54-4308-ba21-e2dc2991ef83 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:56.924879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:56.930901 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cbfea-31fc-401c-acd4-9f3d9a1f19b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:56.931804 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cbfea-31fc-401c-acd4-9f3d9a1f19b6 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:56.932117 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cbfea-31fc-401c-acd4-9f3d9a1f19b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:56.932367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cbfea-31fc-401c-acd4-9f3d9a1f19b6 None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:56.933121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cbfea-31fc-401c-acd4-9f3d9a1f19b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:56.933583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cbfea-31fc-401c-acd4-9f3d9a1f19b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:56.934992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cbfea-31fc-401c-acd4-9f3d9a1f19b6 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:56.946679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 630/1250] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:42:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:42:56.954080 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b847a2-9fe9-4b56-80bc-06615e2a92f9 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:57.060693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:57.092858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b847a2-9fe9-4b56-80bc-06615e2a92f9 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:57.142853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62defadc-34aa-4dc3-832a-7e91e5835fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:57.144002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62defadc-34aa-4dc3-832a-7e91e5835fe3 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:57.144467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62defadc-34aa-4dc3-832a-7e91e5835fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:57.144964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62defadc-34aa-4dc3-832a-7e91e5835fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:57.161498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62defadc-34aa-4dc3-832a-7e91e5835fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:57.163141 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62defadc-34aa-4dc3-832a-7e91e5835fe3 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-62defadc-34aa-4dc3-832a-7e91e5835fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:42:57.180785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:57.182181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:57.183204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:42:57.183204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:42:57.183204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:57.183204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:42:57.183204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 621/1251] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:57.189878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cbfea-31fc-401c-acd4-9f3d9a1f19b6 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:57.329587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cbfea-31fc-401c-acd4-9f3d9a1f19b6 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:57.375304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbefadb-77fe-4505-97d6-6191d46de273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:57.375989 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbefadb-77fe-4505-97d6-6191d46de273 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:57.376303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbefadb-77fe-4505-97d6-6191d46de273 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:57.376620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbefadb-77fe-4505-97d6-6191d46de273 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:57.377508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbefadb-77fe-4505-97d6-6191d46de273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:57.377943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbefadb-77fe-4505-97d6-6191d46de273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:57.379541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbefadb-77fe-4505-97d6-6191d46de273 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:57.394570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 631/1252] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:42:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:57.400644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62defadc-34aa-4dc3-832a-7e91e5835fe3 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:57.536190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62defadc-34aa-4dc3-832a-7e91e5835fe3 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:57.571422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:57.581027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984955e-aa03-4e95-b4ef-a6d3a453e975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:57.581693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984955e-aa03-4e95-b4ef-a6d3a453e975 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:57.581966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984955e-aa03-4e95-b4ef-a6d3a453e975 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:57.582262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984955e-aa03-4e95-b4ef-a6d3a453e975 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:57.591662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984955e-aa03-4e95-b4ef-a6d3a453e975 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:57.593299 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984955e-aa03-4e95-b4ef-a6d3a453e975 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-2984955e-aa03-4e95-b4ef-a6d3a453e975 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:42:57.607173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:57.608503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:57.609688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:57.609688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:57.609688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:42:57.609688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:42:57.609688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:42:57.609688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:42:57.609688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:42:57.609688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:42:57.609688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:42:57.609688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:42:57.609688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 622/1253] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:57.614803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbefadb-77fe-4505-97d6-6191d46de273 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:57.684444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:57.741120 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbefadb-77fe-4505-97d6-6191d46de273 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:57.781753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee6014-ce0f-457f-8466-16bb974cfbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:57.782335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee6014-ce0f-457f-8466-16bb974cfbee None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:57.782620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee6014-ce0f-457f-8466-16bb974cfbee None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:57.782896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee6014-ce0f-457f-8466-16bb974cfbee None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:57.783845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee6014-ce0f-457f-8466-16bb974cfbee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:57.784050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee6014-ce0f-457f-8466-16bb974cfbee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:57.785529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee6014-ce0f-457f-8466-16bb974cfbee None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:57.806234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 632/1254] 10.222.0.124 () {56 vars in 1148 bytes} [Mon Aug 1 16:42:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:42:57.812949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984955e-aa03-4e95-b4ef-a6d3a453e975 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:57.932824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984955e-aa03-4e95-b4ef-a6d3a453e975 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:57.983172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe7050-fdd1-4a14-ad5c-cae961d02eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:57.984056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe7050-fdd1-4a14-ad5c-cae961d02eae None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:57.984642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe7050-fdd1-4a14-ad5c-cae961d02eae None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:57.984642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe7050-fdd1-4a14-ad5c-cae961d02eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:58.058463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:58.074337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe7050-fdd1-4a14-ad5c-cae961d02eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:58.080270 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe7050-fdd1-4a14-ad5c-cae961d02eae None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:58.223922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 623/1255] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:42:57 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:42:58.225638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee6014-ce0f-457f-8466-16bb974cfbee None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:58.350308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee6014-ce0f-457f-8466-16bb974cfbee None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:58.368076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:58.397571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aed276-bf85-40b2-bad6-14a95403b475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:58.398297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed276-bf85-40b2-bad6-14a95403b475 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:58.398659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed276-bf85-40b2-bad6-14a95403b475 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:58.399110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed276-bf85-40b2-bad6-14a95403b475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:58.412968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aed276-bf85-40b2-bad6-14a95403b475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:58.415448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aed276-bf85-40b2-bad6-14a95403b475 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-03aed276-bf85-40b2-bad6-14a95403b475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:42:58.437924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:58.440526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:58.441585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:42:58.441585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:42:58.441585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:42:58.441585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:58.441585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 633/1256] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:58.446089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe7050-fdd1-4a14-ad5c-cae961d02eae None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:58.566960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:58.580269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe7050-fdd1-4a14-ad5c-cae961d02eae None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:58.618509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0502b-1cc3-44be-8410-126880f3a057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:58.619427 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0502b-1cc3-44be-8410-126880f3a057 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:58.619782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0502b-1cc3-44be-8410-126880f3a057 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:58.620247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0502b-1cc3-44be-8410-126880f3a057 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:58.621007 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0502b-1cc3-44be-8410-126880f3a057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:58.621350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0502b-1cc3-44be-8410-126880f3a057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:58.623090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0502b-1cc3-44be-8410-126880f3a057 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:58.637459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 624/1257] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:42:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:58.643555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aed276-bf85-40b2-bad6-14a95403b475 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:58.761463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aed276-bf85-40b2-bad6-14a95403b475 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:58.804298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993ab4a-0079-4d3e-beda-11265ae10ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:58.804985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993ab4a-0079-4d3e-beda-11265ae10ba8 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:58.805306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993ab4a-0079-4d3e-beda-11265ae10ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:58.805595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993ab4a-0079-4d3e-beda-11265ae10ba8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:58.813545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993ab4a-0079-4d3e-beda-11265ae10ba8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:58.815035 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993ab4a-0079-4d3e-beda-11265ae10ba8 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-8993ab4a-0079-4d3e-beda-11265ae10ba8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:42:58.827587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:42:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:42:58.830296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:42:58.830296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:42:58.830296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:42:58.830296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:42:58.830296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:42:58.830296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:42:58.830296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:42:58.830296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:42:58.830296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 634/1258] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:42:58.835388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0502b-1cc3-44be-8410-126880f3a057 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:58.956877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0502b-1cc3-44be-8410-126880f3a057 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:58.999189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18b457-0c57-480d-8d26-bfba42ffaeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:58.999773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b457-0c57-480d-8d26-bfba42ffaeb2 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:59.000056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b457-0c57-480d-8d26-bfba42ffaeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:59.000332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b457-0c57-480d-8d26-bfba42ffaeb2 None admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:59.001199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b457-0c57-480d-8d26-bfba42ffaeb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:59.001508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b457-0c57-480d-8d26-bfba42ffaeb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:59.003136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b457-0c57-480d-8d26-bfba42ffaeb2 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:59.017370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 625/1259] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:42:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:42:59.024094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993ab4a-0079-4d3e-beda-11265ae10ba8 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:42:59.057971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:59.144223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993ab4a-0079-4d3e-beda-11265ae10ba8 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:42:59.184362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ebeb8-11ee-4d50-b33f-7db930d691b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:42:59.185069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ebeb8-11ee-4d50-b33f-7db930d691b5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:42:59.185373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ebeb8-11ee-4d50-b33f-7db930d691b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:42:59.185984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ebeb8-11ee-4d50-b33f-7db930d691b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:42:59.186926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ebeb8-11ee-4d50-b33f-7db930d691b5 None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=6deeea314be545609b0fe4dd786b3b9e) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:42:59.188232 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ebeb8-11ee-4d50-b33f-7db930d691b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:42:59.188868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ebeb8-11ee-4d50-b33f-7db930d691b5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:42:59.195877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 635/1260] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:42:59 2022] GET /identity/v3/role_assignments?user.id=6deeea314be545609b0fe4dd786b3b9e&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=390e487a45f74246ba84773e8760bc7c => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:01.417527 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98ca0-0d3f-439b-967f-645b5e011c80 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:01.418167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98ca0-0d3f-439b-967f-645b5e011c80 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:01.418167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98ca0-0d3f-439b-967f-645b5e011c80 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:01.419840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 626/1261] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:43:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:43:01.425974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9e97-9318-40eb-a94a-ffabf4f79c2c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:01.426670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9e97-9318-40eb-a94a-ffabf4f79c2c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:01.426670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9e97-9318-40eb-a94a-ffabf4f79c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:01.449252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-412f9e97-9318-40eb-a94a-ffabf4f79c2c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:43:01.451243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-412f9e97-9318-40eb-a94a-ffabf4f79c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:43:01.535202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 636/1262] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:43:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:43:01.558981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98ca0-0d3f-439b-967f-645b5e011c80 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:01.572382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:01.692386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98ca0-0d3f-439b-967f-645b5e011c80 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:01.731343 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732d590-5c71-43fa-9668-6d840c85fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:01.732023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732d590-5c71-43fa-9668-6d840c85fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:01.732302 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732d590-5c71-43fa-9668-6d840c85fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:01.732574 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732d590-5c71-43fa-9668-6d840c85fdf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:01.744981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732d590-5c71-43fa-9668-6d840c85fdf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-5732d590-5c71-43fa-9668-6d840c85fdf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:43:01.750189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:01.751471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:43:01.752491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:43:01.755173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 627/1263] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:01.758092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f9e97-9318-40eb-a94a-ffabf4f79c2c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:01.778269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:01.870341 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f9e97-9318-40eb-a94a-ffabf4f79c2c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:01.911343 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b088bb1-2569-4acb-9cf0-119cb850323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:01.911971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b088bb1-2569-4acb-9cf0-119cb850323f None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:01.912251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b088bb1-2569-4acb-9cf0-119cb850323f None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:01.912513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b088bb1-2569-4acb-9cf0-119cb850323f None admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:01.913237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b088bb1-2569-4acb-9cf0-119cb850323f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:01.913546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b088bb1-2569-4acb-9cf0-119cb850323f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:01.914929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b088bb1-2569-4acb-9cf0-119cb850323f None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:01.924038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 637/1264] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:43:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:01.929984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732d590-5c71-43fa-9668-6d840c85fdf7 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:02.021821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:02.057843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732d590-5c71-43fa-9668-6d840c85fdf7 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:02.094777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6ec82-ac80-4af4-bbb5-759a72da9f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:02.095451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6ec82-ac80-4af4-bbb5-759a72da9f35 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:02.095742 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6ec82-ac80-4af4-bbb5-759a72da9f35 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:02.096021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6ec82-ac80-4af4-bbb5-759a72da9f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:02.107058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6ec82-ac80-4af4-bbb5-759a72da9f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:02.108537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6ec82-ac80-4af4-bbb5-759a72da9f35 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-72d6ec82-ac80-4af4-bbb5-759a72da9f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:43:02.127507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:02.128631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:02.129728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:43:02.129728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:43:02.129728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:43:02.129728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:43:02.129728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 628/1265] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:02.136630 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b088bb1-2569-4acb-9cf0-119cb850323f None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:02.222322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:02.242288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b088bb1-2569-4acb-9cf0-119cb850323f None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:02.280385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a762e7-0830-4615-a8dd-bb369af8fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:02.280923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a762e7-0830-4615-a8dd-bb369af8fff2 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:02.281195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a762e7-0830-4615-a8dd-bb369af8fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:02.281468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a762e7-0830-4615-a8dd-bb369af8fff2 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:02.282186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a762e7-0830-4615-a8dd-bb369af8fff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:02.282494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a762e7-0830-4615-a8dd-bb369af8fff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:02.283895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a762e7-0830-4615-a8dd-bb369af8fff2 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:02.296418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 638/1266] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:43:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:02.305342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6ec82-ac80-4af4-bbb5-759a72da9f35 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:02.418279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6ec82-ac80-4af4-bbb5-759a72da9f35 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:02.441216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:02.456472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001ba62-3bd5-4454-9d0a-7e112ad82d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:02.457108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001ba62-3bd5-4454-9d0a-7e112ad82d51 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:02.457390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001ba62-3bd5-4454-9d0a-7e112ad82d51 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:02.457662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001ba62-3bd5-4454-9d0a-7e112ad82d51 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:02.467573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001ba62-3bd5-4454-9d0a-7e112ad82d51 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:02.469026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001ba62-3bd5-4454-9d0a-7e112ad82d51 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-8001ba62-3bd5-4454-9d0a-7e112ad82d51 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:43:02.481247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:02.482716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:02.484725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:02.484725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:02.484725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:43:02.484725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:43:02.484725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:43:02.484725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:43:02.484725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:43:02.484725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:43:02.484725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:43:02.484725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:43:02.484725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 629/1267] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:43:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:02.491099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a762e7-0830-4615-a8dd-bb369af8fff2 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:02.603430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a762e7-0830-4615-a8dd-bb369af8fff2 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:02.639840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b4cb-38cb-4239-95a7-aaba059ff309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:02.640467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b4cb-38cb-4239-95a7-aaba059ff309 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:02.640749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b4cb-38cb-4239-95a7-aaba059ff309 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:02.642650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b4cb-38cb-4239-95a7-aaba059ff309 None admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:02.642650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5b4cb-38cb-4239-95a7-aaba059ff309 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:02.642650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5b4cb-38cb-4239-95a7-aaba059ff309 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:02.643620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5b4cb-38cb-4239-95a7-aaba059ff309 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:02.655584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:02.668694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 639/1268] 10.222.0.124 () {56 vars in 1148 bytes} [Mon Aug 1 16:43:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:02.675661 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001ba62-3bd5-4454-9d0a-7e112ad82d51 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:02.790326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001ba62-3bd5-4454-9d0a-7e112ad82d51 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:02.826190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb1880-5ce5-4848-afc7-ce3740ee0292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:02.826878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb1880-5ce5-4848-afc7-ce3740ee0292 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:02.827187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb1880-5ce5-4848-afc7-ce3740ee0292 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:02.827460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb1880-5ce5-4848-afc7-ce3740ee0292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:02.839610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb1880-5ce5-4848-afc7-ce3740ee0292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:02.841142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb1880-5ce5-4848-afc7-ce3740ee0292 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-92bb1880-5ce5-4848-afc7-ce3740ee0292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:43:02.857658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:02.858776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:02.860400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:43:02.860400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:43:02.860400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:43:02.860400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:43:02.860400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 630/1269] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:02.867299 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b4cb-38cb-4239-95a7-aaba059ff309 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:02.990461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b4cb-38cb-4239-95a7-aaba059ff309 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:03.028700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38c335-b2c1-49c0-a472-2abaf4025382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:03.029325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38c335-b2c1-49c0-a472-2abaf4025382 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:03.029608 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38c335-b2c1-49c0-a472-2abaf4025382 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:03.029880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38c335-b2c1-49c0-a472-2abaf4025382 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:03.030592 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38c335-b2c1-49c0-a472-2abaf4025382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:03.030899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38c335-b2c1-49c0-a472-2abaf4025382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:03.032325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38c335-b2c1-49c0-a472-2abaf4025382 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:03.044886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 640/1270] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:43:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:03.053549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb1880-5ce5-4848-afc7-ce3740ee0292 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:03.093170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:03.170335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb1880-5ce5-4848-afc7-ce3740ee0292 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:03.207439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1afded-e034-4d56-9ae6-0746017170b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:03.208080 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1afded-e034-4d56-9ae6-0746017170b6 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:03.208361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1afded-e034-4d56-9ae6-0746017170b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:03.208638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1afded-e034-4d56-9ae6-0746017170b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:03.215368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1afded-e034-4d56-9ae6-0746017170b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:03.216830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1afded-e034-4d56-9ae6-0746017170b6 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-6b1afded-e034-4d56-9ae6-0746017170b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:43:03.228531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:03.229649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:03.230732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:43:03.230732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:43:03.230732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:43:03.230732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:43:03.230732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:43:03.230732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:43:03.230732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:43:03.230732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:43:03.230732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 631/1271] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:03.236454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38c335-b2c1-49c0-a472-2abaf4025382 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:03.296575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:03.344659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38c335-b2c1-49c0-a472-2abaf4025382 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:03.380496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f776c1-12cf-4425-927c-f27024bd9f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:03.381106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f776c1-12cf-4425-927c-f27024bd9f77 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:03.381387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f776c1-12cf-4425-927c-f27024bd9f77 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:03.381628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f776c1-12cf-4425-927c-f27024bd9f77 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:03.382414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f776c1-12cf-4425-927c-f27024bd9f77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:03.382737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f776c1-12cf-4425-927c-f27024bd9f77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:03.385611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f776c1-12cf-4425-927c-f27024bd9f77 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:03.399014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 641/1272] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:03.405330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1afded-e034-4d56-9ae6-0746017170b6 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:03.518928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:03.530724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1afded-e034-4d56-9ae6-0746017170b6 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:03.566429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12011553-c2f8-4396-b57d-8d5ee3291069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:03.567131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12011553-c2f8-4396-b57d-8d5ee3291069 None admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:03.567410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12011553-c2f8-4396-b57d-8d5ee3291069 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:03.567683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12011553-c2f8-4396-b57d-8d5ee3291069 None admin] PATH_INFO: `/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/6deeea314be545609b0fe4dd786b3b9e/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:03.569648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12011553-c2f8-4396-b57d-8d5ee3291069 None admin] RBAC: Authorizing `identity:create_grant(project_id=81add21b39eb44c8b974a25c04a8d06a, user_id=6deeea314be545609b0fe4dd786b3b9e, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:03.571170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12011553-c2f8-4396-b57d-8d5ee3291069 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:03.585867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 632/1273] 10.222.0.124 () {58 vars in 1444 bytes} [Mon Aug 1 16:43:03 2022] PUT /identity/v3/projects/81add21b39eb44c8b974a25c04a8d06a/users/6deeea314be545609b0fe4dd786b3b9e/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:43:05.612051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d78bd8-a86b-499d-ba15-91a9e4e01ada None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:05.612650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d78bd8-a86b-499d-ba15-91a9e4e01ada None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:05.613299 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d78bd8-a86b-499d-ba15-91a9e4e01ada None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:05.614654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 642/1274] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:43:05 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:43:05.621234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79529-999f-4b4a-9eca-36d89f6a20d6 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:05.621969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79529-999f-4b4a-9eca-36d89f6a20d6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:05.622156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79529-999f-4b4a-9eca-36d89f6a20d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:05.649731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-60f79529-999f-4b4a-9eca-36d89f6a20d6 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:43:05.650987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-60f79529-999f-4b4a-9eca-36d89f6a20d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:43:05.738131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 633/1275] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:43:05 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:43:05.764093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d78bd8-a86b-499d-ba15-91a9e4e01ada None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:05.874262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d78bd8-a86b-499d-ba15-91a9e4e01ada None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:05.893383 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:05.914047 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb9bff-9b94-4b5c-9da6-02c85bac89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:05.914864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb9bff-9b94-4b5c-9da6-02c85bac89ab None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:05.915176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb9bff-9b94-4b5c-9da6-02c85bac89ab None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:05.915455 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb9bff-9b94-4b5c-9da6-02c85bac89ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:05.926293 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb9bff-9b94-4b5c-9da6-02c85bac89ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-92eb9bff-9b94-4b5c-9da6-02c85bac89ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:43:05.931410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:05.932510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:05.933529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 643/1276] 10.222.0.124 () {56 vars in 1101 bytes} [Mon Aug 1 16:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:05.940504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79529-999f-4b4a-9eca-36d89f6a20d6 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:06.054348 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:06.086971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79529-999f-4b4a-9eca-36d89f6a20d6 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:06.134891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae49ec-3b14-46a9-8fc5-6d6ffa167cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:06.135567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae49ec-3b14-46a9-8fc5-6d6ffa167cb2 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:06.136120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae49ec-3b14-46a9-8fc5-6d6ffa167cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:06.136120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae49ec-3b14-46a9-8fc5-6d6ffa167cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:06.136901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae49ec-3b14-46a9-8fc5-6d6ffa167cb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:06.137183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae49ec-3b14-46a9-8fc5-6d6ffa167cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:06.138605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae49ec-3b14-46a9-8fc5-6d6ffa167cb2 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:06.148302 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 634/1277] 10.222.0.124 () {56 vars in 1104 bytes} [Mon Aug 1 16:43:05 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:06.154893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb9bff-9b94-4b5c-9da6-02c85bac89ab None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:06.269810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb9bff-9b94-4b5c-9da6-02c85bac89ab None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:06.309495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9037b0-6ed8-41de-ae3a-9767e047b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:06.310389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9037b0-6ed8-41de-ae3a-9767e047b641 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:06.310676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9037b0-6ed8-41de-ae3a-9767e047b641 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:06.310980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9037b0-6ed8-41de-ae3a-9767e047b641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:06.322403 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9037b0-6ed8-41de-ae3a-9767e047b641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:06.327534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9037b0-6ed8-41de-ae3a-9767e047b641 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-af9037b0-6ed8-41de-ae3a-9767e047b641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:43:06.344729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:06.345764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:06.346816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:43:06.346816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:43:06.346816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:43:06.346816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:06.346816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 644/1278] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:06.354899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae49ec-3b14-46a9-8fc5-6d6ffa167cb2 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:06.465358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae49ec-3b14-46a9-8fc5-6d6ffa167cb2 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:06.503418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3864a-8681-4a31-b547-84ebaa6d88f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:06.504373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3864a-8681-4a31-b547-84ebaa6d88f9 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:06.504373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3864a-8681-4a31-b547-84ebaa6d88f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:06.504591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3864a-8681-4a31-b547-84ebaa6d88f9 None admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:06.505301 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3864a-8681-4a31-b547-84ebaa6d88f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:06.505602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3864a-8681-4a31-b547-84ebaa6d88f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:06.507013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3864a-8681-4a31-b547-84ebaa6d88f9 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:06.519746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 635/1279] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:43:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:06.525814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9037b0-6ed8-41de-ae3a-9767e047b641 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:06.563466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:06.642870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9037b0-6ed8-41de-ae3a-9767e047b641 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:06.678149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffea1fc-e6f3-45ad-8e4c-7e3c0af104e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:06.678791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffea1fc-e6f3-45ad-8e4c-7e3c0af104e5 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:06.679097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffea1fc-e6f3-45ad-8e4c-7e3c0af104e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:06.679366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffea1fc-e6f3-45ad-8e4c-7e3c0af104e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:06.687636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffea1fc-e6f3-45ad-8e4c-7e3c0af104e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:06.689107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffea1fc-e6f3-45ad-8e4c-7e3c0af104e5 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-cffea1fc-e6f3-45ad-8e4c-7e3c0af104e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:43:06.700879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:06.702144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:06.703605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:06.703605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:06.703605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:43:06.703605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:43:06.703605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:43:06.703605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:43:06.703605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:43:06.703605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:43:06.703605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:43:06.703605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:06.703605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 645/1280] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:43:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:06.708689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3864a-8681-4a31-b547-84ebaa6d88f9 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:06.713265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:06.829827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3864a-8681-4a31-b547-84ebaa6d88f9 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:06.866727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a05681-db6f-47da-ba67-6129ed60c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:06.867480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a05681-db6f-47da-ba67-6129ed60c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:06.867967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a05681-db6f-47da-ba67-6129ed60c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:06.868385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a05681-db6f-47da-ba67-6129ed60c3a8 None admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:06.869216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a05681-db6f-47da-ba67-6129ed60c3a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:06.869520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a05681-db6f-47da-ba67-6129ed60c3a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:06.871010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a05681-db6f-47da-ba67-6129ed60c3a8 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:06.890496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 636/1281] 10.222.0.124 () {56 vars in 1148 bytes} [Mon Aug 1 16:43:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:06.896351 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffea1fc-e6f3-45ad-8e4c-7e3c0af104e5 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:07.000386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:07.012744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffea1fc-e6f3-45ad-8e4c-7e3c0af104e5 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:07.048474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fe487-c470-43a7-8f9f-ef1a7a26d7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:07.049109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fe487-c470-43a7-8f9f-ef1a7a26d7e6 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:07.049394 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fe487-c470-43a7-8f9f-ef1a7a26d7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:07.049670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fe487-c470-43a7-8f9f-ef1a7a26d7e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:07.125983 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fe487-c470-43a7-8f9f-ef1a7a26d7e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:07.127378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fe487-c470-43a7-8f9f-ef1a7a26d7e6 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:07.223610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:07.240566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 646/1282] 10.222.0.124 () {58 vars in 1287 bytes} [Mon Aug 1 16:43:06 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:43:07.247096 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a05681-db6f-47da-ba67-6129ed60c3a8 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:07.317646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:07.363854 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a05681-db6f-47da-ba67-6129ed60c3a8 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:07.400950 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754068a-e3b6-41c7-8cdc-51071fbfecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:07.401511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754068a-e3b6-41c7-8cdc-51071fbfecb8 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:07.401792 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754068a-e3b6-41c7-8cdc-51071fbfecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:07.402073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754068a-e3b6-41c7-8cdc-51071fbfecb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:07.412693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754068a-e3b6-41c7-8cdc-51071fbfecb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:07.414212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754068a-e3b6-41c7-8cdc-51071fbfecb8 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-8754068a-e3b6-41c7-8cdc-51071fbfecb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:43:07.430014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:07.431181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:07.432683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:43:07.432683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:43:07.432683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:43:07.432683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:43:07.432683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 637/1283] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:07.437531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fe487-c470-43a7-8f9f-ef1a7a26d7e6 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:07.548444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fe487-c470-43a7-8f9f-ef1a7a26d7e6 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:07.584876 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a622805-93ab-4e1a-96da-aab51ff4a4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:07.585498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a622805-93ab-4e1a-96da-aab51ff4a4e7 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:07.585781 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a622805-93ab-4e1a-96da-aab51ff4a4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:07.586081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a622805-93ab-4e1a-96da-aab51ff4a4e7 None admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:07.586814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a622805-93ab-4e1a-96da-aab51ff4a4e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:07.587152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a622805-93ab-4e1a-96da-aab51ff4a4e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:07.588490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a622805-93ab-4e1a-96da-aab51ff4a4e7 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:07.600745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 647/1284] 10.222.0.124 () {56 vars in 1114 bytes} [Mon Aug 1 16:43:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:07.606842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754068a-e3b6-41c7-8cdc-51071fbfecb8 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:07.728464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754068a-e3b6-41c7-8cdc-51071fbfecb8 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:07.752927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:07.779282 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfdfa5-7a17-4c37-9fa8-d0e9efa2a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:07.779962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfdfa5-7a17-4c37-9fa8-d0e9efa2a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:07.780243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfdfa5-7a17-4c37-9fa8-d0e9efa2a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:07.780511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfdfa5-7a17-4c37-9fa8-d0e9efa2a4c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:07.788939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfdfa5-7a17-4c37-9fa8-d0e9efa2a4c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:07.790610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfdfa5-7a17-4c37-9fa8-d0e9efa2a4c1 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application [None req-1ccfdfa5-7a17-4c37-9fa8-d0e9efa2a4c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:43:07.804738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:07.806470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:07.808110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:43:07.808110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:43:07.808110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:43:07.808110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:43:07.808110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:43:07.808110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:43:07.808110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:43:07.808110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: ERROR keystone.server.flask.application Aug 01 16:43:07.808110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 638/1285] 10.222.0.124 () {56 vars in 1116 bytes} [Mon Aug 1 16:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:07.814043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a622805-93ab-4e1a-96da-aab51ff4a4e7 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:07.874512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:07.931711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a622805-93ab-4e1a-96da-aab51ff4a4e7 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:07.975576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309e5f0-3da2-483f-b132-749e5ac09d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:07.976212 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309e5f0-3da2-483f-b132-749e5ac09d84 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:07.976641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309e5f0-3da2-483f-b132-749e5ac09d84 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:07.976926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309e5f0-3da2-483f-b132-749e5ac09d84 None admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:07.977703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309e5f0-3da2-483f-b132-749e5ac09d84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:07.978013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309e5f0-3da2-483f-b132-749e5ac09d84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:07.979580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309e5f0-3da2-483f-b132-749e5ac09d84 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:07.994026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 648/1286] 10.222.0.124 () {56 vars in 1153 bytes} [Mon Aug 1 16:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:08.000503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfdfa5-7a17-4c37-9fa8-d0e9efa2a4c1 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:08.116053 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfdfa5-7a17-4c37-9fa8-d0e9efa2a4c1 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:08.156320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ce521-19c7-4098-8c16-a523a1a89307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:08.156966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ce521-19c7-4098-8c16-a523a1a89307 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:08.157249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ce521-19c7-4098-8c16-a523a1a89307 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:08.157524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ce521-19c7-4098-8c16-a523a1a89307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:08.158341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ce521-19c7-4098-8c16-a523a1a89307 None admin] RBAC: Adding query filter params (role.id=390e487a45f74246ba84773e8760bc7c, scope.project.id=81add21b39eb44c8b974a25c04a8d06a, user.id=6deeea314be545609b0fe4dd786b3b9e) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:08.158680 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ce521-19c7-4098-8c16-a523a1a89307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:08.160229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ce521-19c7-4098-8c16-a523a1a89307 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:08.167325 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 639/1287] 10.222.0.124 () {56 vars in 1379 bytes} [Mon Aug 1 16:43:07 2022] GET /identity/v3/role_assignments?user.id=6deeea314be545609b0fe4dd786b3b9e&scope.project.id=81add21b39eb44c8b974a25c04a8d06a&role.id=390e487a45f74246ba84773e8760bc7c => generated 610 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:10.311445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b4205-4002-4f79-bae1-de2de823f7ff None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:10.312050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b4205-4002-4f79-bae1-de2de823f7ff None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:10.312172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b4205-4002-4f79-bae1-de2de823f7ff None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:10.315093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 649/1288] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:43:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:43:10.321805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4405b63-e44d-427b-b74e-9c618405c6d6 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:10.322396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4405b63-e44d-427b-b74e-9c618405c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:10.322396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4405b63-e44d-427b-b74e-9c618405c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:10.344967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-c4405b63-e44d-427b-b74e-9c618405c6d6 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:43:10.346238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c4405b63-e44d-427b-b74e-9c618405c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:43:10.389580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:10.433980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 640/1289] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:43:10 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:43:10.457794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b4205-4002-4f79-bae1-de2de823f7ff None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:10.580404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b4205-4002-4f79-bae1-de2de823f7ff None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:10.592474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:10.618349 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929a676-9a5d-43f5-aad9-85ef7e38a533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:10.619038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a676-9a5d-43f5-aad9-85ef7e38a533 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:10.619314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a676-9a5d-43f5-aad9-85ef7e38a533 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:10.619572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a676-9a5d-43f5-aad9-85ef7e38a533 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:10.620210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929a676-9a5d-43f5-aad9-85ef7e38a533 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:10.622545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929a676-9a5d-43f5-aad9-85ef7e38a533 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-6929a676-9a5d-43f5-aad9-85ef7e38a533 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:10.631988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:10.634015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:10.635539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 650/1290] 10.222.0.124 () {56 vars in 1122 bytes} [Mon Aug 1 16:43:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:10.639929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4405b63-e44d-427b-b74e-9c618405c6d6 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:10.748410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4405b63-e44d-427b-b74e-9c618405c6d6 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:10.785333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76da3b-b8b5-4b06-abe8-e51467a5a263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:10.785970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76da3b-b8b5-4b06-abe8-e51467a5a263 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:10.786254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76da3b-b8b5-4b06-abe8-e51467a5a263 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:10.786532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76da3b-b8b5-4b06-abe8-e51467a5a263 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:10.787278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76da3b-b8b5-4b06-abe8-e51467a5a263 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:10.787584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76da3b-b8b5-4b06-abe8-e51467a5a263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:10.789412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76da3b-b8b5-4b06-abe8-e51467a5a263 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:10.794806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 641/1291] 10.222.0.124 () {56 vars in 1121 bytes} [Mon Aug 1 16:43:10 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:10.802059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929a676-9a5d-43f5-aad9-85ef7e38a533 None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:10.913819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929a676-9a5d-43f5-aad9-85ef7e38a533 None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:10.953797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e2c7f-0eef-49b1-9d12-c4ae49cf8d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:10.954570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e2c7f-0eef-49b1-9d12-c4ae49cf8d4a None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:10.954877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e2c7f-0eef-49b1-9d12-c4ae49cf8d4a None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:10.955263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e2c7f-0eef-49b1-9d12-c4ae49cf8d4a None admin] PATH_INFO: `/v3/services` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:10.956154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e2c7f-0eef-49b1-9d12-c4ae49cf8d4a None admin] RBAC: Adding query filter params (type=placement) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:10.956527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e2c7f-0eef-49b1-9d12-c4ae49cf8d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:10.958217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e2c7f-0eef-49b1-9d12-c4ae49cf8d4a None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:10.964902 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 651/1292] 10.222.0.124 () {56 vars in 1121 bytes} [Mon Aug 1 16:43:10 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:13.045976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3811560-b1e4-427e-928c-20ebb23033aa None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:13.046715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3811560-b1e4-427e-928c-20ebb23033aa None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:13.046715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3811560-b1e4-427e-928c-20ebb23033aa None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:13.048126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 642/1293] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:43:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:43:13.054613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4332-165a-4a80-95c7-cb02c961c22c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:13.055225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4332-165a-4a80-95c7-cb02c961c22c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:13.055225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4332-165a-4a80-95c7-cb02c961c22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:13.076446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-e2bc4332-165a-4a80-95c7-cb02c961c22c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:43:13.077793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e2bc4332-165a-4a80-95c7-cb02c961c22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:43:13.114201 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:13.157918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 652/1294] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:43:13 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:43:13.181962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3811560-b1e4-427e-928c-20ebb23033aa None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:13.217986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:13.302515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3811560-b1e4-427e-928c-20ebb23033aa None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:13.340450 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711eb7b9-8077-48af-89e8-ea75772de09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:13.341060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eb7b9-8077-48af-89e8-ea75772de09b None admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:13.341337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eb7b9-8077-48af-89e8-ea75772de09b None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:13.341608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eb7b9-8077-48af-89e8-ea75772de09b None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:13.342327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eb7b9-8077-48af-89e8-ea75772de09b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:13.343775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eb7b9-8077-48af-89e8-ea75772de09b None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:13.363116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 643/1295] 10.222.0.124 () {60 vars in 1146 bytes} [Mon Aug 1 16:43:13 2022] POST /identity/v3/services => generated 247 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:43:15.925495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b492-5657-4b65-bd50-d19ff907f9a3 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:15.926035 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b492-5657-4b65-bd50-d19ff907f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:15.926035 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b492-5657-4b65-bd50-d19ff907f9a3 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:15.927490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 653/1296] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:43:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:43:15.934193 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678526-42bb-4ad0-8945-ce2d410d6db2 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:15.934787 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678526-42bb-4ad0-8945-ce2d410d6db2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:15.934787 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678526-42bb-4ad0-8945-ce2d410d6db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:15.961318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-98678526-42bb-4ad0-8945-ce2d410d6db2 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:43:15.963271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-98678526-42bb-4ad0-8945-ce2d410d6db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:43:16.074271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 644/1297] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:43:15 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:43:16.098513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542b492-5657-4b65-bd50-d19ff907f9a3 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:16.238676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542b492-5657-4b65-bd50-d19ff907f9a3 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:16.282921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6466a1c-176d-4116-b1c2-59a872e8142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:16.283689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6466a1c-176d-4116-b1c2-59a872e8142c None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:16.284019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6466a1c-176d-4116-b1c2-59a872e8142c None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:16.284339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6466a1c-176d-4116-b1c2-59a872e8142c None admin] PATH_INFO: `/v3/services/placement` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:16.285027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6466a1c-176d-4116-b1c2-59a872e8142c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:16.286480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6466a1c-176d-4116-b1c2-59a872e8142c None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-c6466a1c-176d-4116-b1c2-59a872e8142c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:16.297005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:16.298896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:16.300534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 654/1298] 10.222.0.124 () {56 vars in 1122 bytes} [Mon Aug 1 16:43:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:16.305104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98678526-42bb-4ad0-8945-ce2d410d6db2 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:16.326909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:16.427066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98678526-42bb-4ad0-8945-ce2d410d6db2 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:16.470228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65da3e-3c9b-41dc-a7ad-d869e958be91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:16.470880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65da3e-3c9b-41dc-a7ad-d869e958be91 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:16.471189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65da3e-3c9b-41dc-a7ad-d869e958be91 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:16.471466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65da3e-3c9b-41dc-a7ad-d869e958be91 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:16.472169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65da3e-3c9b-41dc-a7ad-d869e958be91 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:16.472468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65da3e-3c9b-41dc-a7ad-d869e958be91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:16.473897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65da3e-3c9b-41dc-a7ad-d869e958be91 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:16.480762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 645/1299] 10.222.0.124 () {56 vars in 1121 bytes} [Mon Aug 1 16:43:16 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:16.489498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6466a1c-176d-4116-b1c2-59a872e8142c None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:16.531542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:16.652639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6466a1c-176d-4116-b1c2-59a872e8142c None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:16.697711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44d78b-7150-44bd-aae1-446cfe219f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:16.698351 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44d78b-7150-44bd-aae1-446cfe219f38 None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:16.698630 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44d78b-7150-44bd-aae1-446cfe219f38 None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:16.698897 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44d78b-7150-44bd-aae1-446cfe219f38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:16.699725 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44d78b-7150-44bd-aae1-446cfe219f38 None admin] RBAC: Adding query filter params (interface=public, service_id=989dbf9b18324a99862e4cc55595a816, region_id=RegionOne) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:16.700034 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44d78b-7150-44bd-aae1-446cfe219f38 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:16.701453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44d78b-7150-44bd-aae1-446cfe219f38 None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:16.709275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 655/1300] 10.222.0.124 () {56 vars in 1256 bytes} [Mon Aug 1 16:43:16 2022] GET /identity/v3/endpoints?service_id=989dbf9b18324a99862e4cc55595a816&interface=public®ion_id=RegionOne => generated 195 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:16.716307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65da3e-3c9b-41dc-a7ad-d869e958be91 None admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:16.821015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:16.842779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65da3e-3c9b-41dc-a7ad-d869e958be91 None admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:16.885098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbfa40-1a15-4b81-b245-eeeb230dbb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:16.885742 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbfa40-1a15-4b81-b245-eeeb230dbb28 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:16.886086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbfa40-1a15-4b81-b245-eeeb230dbb28 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:16.886392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbfa40-1a15-4b81-b245-eeeb230dbb28 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:16.887167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbfa40-1a15-4b81-b245-eeeb230dbb28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:16.888561 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbfa40-1a15-4b81-b245-eeeb230dbb28 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:16.896723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 646/1301] 10.222.0.124 () {56 vars in 1092 bytes} [Mon Aug 1 16:43:16 2022] GET /identity/v3/services => generated 2201 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:43:19.111661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abbbe2-8891-40e1-babc-a777445a144e None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:19.112283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abbbe2-8891-40e1-babc-a777445a144e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:19.112283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abbbe2-8891-40e1-babc-a777445a144e None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:19.113541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 656/1302] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:43:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:43:19.120077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f4ecc-cfcb-4344-8271-9c1ae81baa74 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:19.120612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f4ecc-cfcb-4344-8271-9c1ae81baa74 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:19.120612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f4ecc-cfcb-4344-8271-9c1ae81baa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:19.141298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-4b6f4ecc-cfcb-4344-8271-9c1ae81baa74 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:43:19.142628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4b6f4ecc-cfcb-4344-8271-9c1ae81baa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:43:19.221370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 647/1303] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:43:19 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:43:19.246297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abbbe2-8891-40e1-babc-a777445a144e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:19.387806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:19.400342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abbbe2-8891-40e1-babc-a777445a144e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:19.462385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b0f73-f2da-44e4-b518-2ad045ffaa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:19.463506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b0f73-f2da-44e4-b518-2ad045ffaa5b None admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:19.463979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b0f73-f2da-44e4-b518-2ad045ffaa5b None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:19.464420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b0f73-f2da-44e4-b518-2ad045ffaa5b None admin] PATH_INFO: `/v3/services/placement` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:19.465475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b0f73-f2da-44e4-b518-2ad045ffaa5b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:19.467911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b0f73-f2da-44e4-b518-2ad045ffaa5b None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application [None req-0d0b0f73-f2da-44e4-b518-2ad045ffaa5b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:43:19.485609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:43:19.487550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application with Lock( Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: ERROR keystone.server.flask.application Aug 01 16:43:19.489509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 657/1304] 10.222.0.124 () {56 vars in 1122 bytes} [Mon Aug 1 16:43:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:43:19.497100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f4ecc-cfcb-4344-8271-9c1ae81baa74 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:19.590162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:19.631431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f4ecc-cfcb-4344-8271-9c1ae81baa74 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:19.693499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7557b7-a476-401a-8e95-2da51396cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:19.694526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7557b7-a476-401a-8e95-2da51396cf48 None admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:19.694929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7557b7-a476-401a-8e95-2da51396cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:19.695354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7557b7-a476-401a-8e95-2da51396cf48 None admin] PATH_INFO: `/v3/services` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:19.696144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7557b7-a476-401a-8e95-2da51396cf48 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:43:19.696498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7557b7-a476-401a-8e95-2da51396cf48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:19.698847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7557b7-a476-401a-8e95-2da51396cf48 None admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:19.708237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 648/1305] 10.222.0.124 () {56 vars in 1121 bytes} [Mon Aug 1 16:43:19 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:43:19.715004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b0f73-f2da-44e4-b518-2ad045ffaa5b None admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:43:19.835776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b0f73-f2da-44e4-b518-2ad045ffaa5b None admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:43:19.878646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32085e16-e65d-45e4-8299-e4717a94941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:43:19.879336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32085e16-e65d-45e4-8299-e4717a94941e None admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:43:19.879614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32085e16-e65d-45e4-8299-e4717a94941e None admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:43:19.879883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32085e16-e65d-45e4-8299-e4717a94941e None admin] PATH_INFO: `/v3/endpoints` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:43:19.880609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32085e16-e65d-45e4-8299-e4717a94941e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:43:19.882135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32085e16-e65d-45e4-8299-e4717a94941e None admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:43:19.908452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 658/1306] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:43:19 2022] POST /identity/v3/endpoints => generated 333 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:43:29.702871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=30 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:29.902891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:30.567010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ebc33-9e50-4a1f-9b43-8ed2586eec42 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:30.567552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ebc33-9e50-4a1f-9b43-8ed2586eec42 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:30.567552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ebc33-9e50-4a1f-9b43-8ed2586eec42 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:30.569225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 649/1307] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:44:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:44:30.574663 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa28b-8af9-4572-b791-8e26f995eefb None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:30.575174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa28b-8af9-4572-b791-8e26f995eefb None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:30.575262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa28b-8af9-4572-b791-8e26f995eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:30.719074 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a47fa28b-8af9-4572-b791-8e26f995eefb None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:30.720414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a47fa28b-8af9-4572-b791-8e26f995eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:30.864094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 659/1308] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:30.915955 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbc4ac-398b-466d-9d13-d4426c8a19f3 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:30.916887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbc4ac-398b-466d-9d13-d4426c8a19f3 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:30.917581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbc4ac-398b-466d-9d13-d4426c8a19f3 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:30.920765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 650/1309] 10.222.0.124 () {54 vars in 970 bytes} [Mon Aug 1 16:44:30 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:44:30.927589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95c66e-32b0-4584-9677-7e44ea48c573 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:30.927946 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95c66e-32b0-4584-9677-7e44ea48c573 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:30.928172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95c66e-32b0-4584-9677-7e44ea48c573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:31.044734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-9a95c66e-32b0-4584-9677-7e44ea48c573 None None] MFA Rules not processed for user `dcfe4d6c32064d79835c415d9fc02cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:31.046017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9a95c66e-32b0-4584-9677-7e44ea48c573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:31.072011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:31.146370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 660/1310] 10.222.0.124 () {58 vars in 1067 bytes} [Mon Aug 1 16:44:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:31.156243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbc4ac-398b-466d-9d13-d4426c8a19f3 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:44:31.158249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9efbc4ac-398b-466d-9d13-d4426c8a19f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:31.305392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbc4ac-398b-466d-9d13-d4426c8a19f3 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:44:31.401635 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0cc4d-c492-4116-b8cb-3166e99c01c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:44:31.402512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0cc4d-c492-4116-b8cb-3166e99c01c1 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:31.403178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0cc4d-c492-4116-b8cb-3166e99c01c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:31.403628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0cc4d-c492-4116-b8cb-3166e99c01c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:31.405513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-30c0cc4d-c492-4116-b8cb-3166e99c01c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:31.471401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:31.544268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0cc4d-c492-4116-b8cb-3166e99c01c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:44:31.545784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0cc4d-c492-4116-b8cb-3166e99c01c1 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:44:31.567075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 651/1311] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:44:33.992785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00262-8d6c-40c7-aada-18a8a8f07d42 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:33.993377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00262-8d6c-40c7-aada-18a8a8f07d42 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:33.993377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00262-8d6c-40c7-aada-18a8a8f07d42 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:33.994743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 661/1312] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:44:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:44:34.001360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b641b6-3162-4b73-9b7c-98e12857ab4e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:34.002030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b641b6-3162-4b73-9b7c-98e12857ab4e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:34.002030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b641b6-3162-4b73-9b7c-98e12857ab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:34.080106 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-56b641b6-3162-4b73-9b7c-98e12857ab4e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:34.081318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-56b641b6-3162-4b73-9b7c-98e12857ab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:34.184005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 652/1313] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:34.241014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc1655-4a40-4e66-afc6-e5be949c3afc None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:34.241292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc1655-4a40-4e66-afc6-e5be949c3afc None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:34.241565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc1655-4a40-4e66-afc6-e5be949c3afc None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:34.242906 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 662/1314] 10.222.0.124 () {54 vars in 970 bytes} [Mon Aug 1 16:44:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:44:34.250454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158547-a6ba-4390-ad68-77e2e41fd643 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:34.250865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158547-a6ba-4390-ad68-77e2e41fd643 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:34.251339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158547-a6ba-4390-ad68-77e2e41fd643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:34.264259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:34.344097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b0158547-a6ba-4390-ad68-77e2e41fd643 None None] MFA Rules not processed for user `dcfe4d6c32064d79835c415d9fc02cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:34.345824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b0158547-a6ba-4390-ad68-77e2e41fd643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:34.432680 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 653/1315] 10.222.0.124 () {58 vars in 1067 bytes} [Mon Aug 1 16:44:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:34.442913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc1655-4a40-4e66-afc6-e5be949c3afc None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:44:34.444561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b3fc1655-4a40-4e66-afc6-e5be949c3afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:34.582409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc1655-4a40-4e66-afc6-e5be949c3afc None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:44:34.667725 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:34.671179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc020796-1498-457f-9f66-729bd434e9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:44:34.672076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020796-1498-457f-9f66-729bd434e9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:34.672363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020796-1498-457f-9f66-729bd434e9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:34.672639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020796-1498-457f-9f66-729bd434e9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:34.675059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-cc020796-1498-457f-9f66-729bd434e9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:34.801534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc020796-1498-457f-9f66-729bd434e9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:44:34.803019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc020796-1498-457f-9f66-729bd434e9b7 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:44:34.821925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 663/1316] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:44:37.460550 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101891a-f4b6-436b-909f-dde91bc2e4dc None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:37.461183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101891a-f4b6-436b-909f-dde91bc2e4dc None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:37.461183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101891a-f4b6-436b-909f-dde91bc2e4dc None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:37.462576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 654/1317] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:44:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:44:37.469758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02375bea-4d71-48df-857c-fac2ca80c6fc None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:37.470371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02375bea-4d71-48df-857c-fac2ca80c6fc None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:37.470371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02375bea-4d71-48df-857c-fac2ca80c6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:37.554130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-02375bea-4d71-48df-857c-fac2ca80c6fc None None] MFA Rules not processed for user `640696f6e9954a98a5d477fef0c386bb`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:37.555551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-02375bea-4d71-48df-857c-fac2ca80c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:37.616185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:37.668933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 664/1318] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:44:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:37.712925 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101891a-f4b6-436b-909f-dde91bc2e4dc None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:44:37.715317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8101891a-f4b6-436b-909f-dde91bc2e4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:37.841642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101891a-f4b6-436b-909f-dde91bc2e4dc None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:44:37.844757 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:37.925047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fb23d-5395-4d7d-94a4-00d718b5cfd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:44:37.925931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fb23d-5395-4d7d-94a4-00d718b5cfd1 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:37.926229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fb23d-5395-4d7d-94a4-00d718b5cfd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:37.926505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fb23d-5395-4d7d-94a4-00d718b5cfd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:37.928560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fb9fb23d-5395-4d7d-94a4-00d718b5cfd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:38.053449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fb23d-5395-4d7d-94a4-00d718b5cfd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:44:38.054909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fb23d-5395-4d7d-94a4-00d718b5cfd1 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:44:38.073849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 655/1319] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:44:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:44:40.904909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd68ae5-7278-448b-a16b-9e2eb1f4bcd5 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:40.905525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd68ae5-7278-448b-a16b-9e2eb1f4bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:40.905525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd68ae5-7278-448b-a16b-9e2eb1f4bcd5 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:40.907404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 665/1320] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:44:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:44:40.914358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2b907-9b82-4eaf-aa74-4980291a42c3 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:40.914899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2b907-9b82-4eaf-aa74-4980291a42c3 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:40.914899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2b907-9b82-4eaf-aa74-4980291a42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:40.963743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:40.991554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-04d2b907-9b82-4eaf-aa74-4980291a42c3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:40.992803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-04d2b907-9b82-4eaf-aa74-4980291a42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:41.093703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 656/1321] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:44:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:41.139668 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd68ae5-7278-448b-a16b-9e2eb1f4bcd5 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:44:41.141290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ecd68ae5-7278-448b-a16b-9e2eb1f4bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:41.257243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd68ae5-7278-448b-a16b-9e2eb1f4bcd5 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:44:41.342117 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ff259-685a-4d0e-90f6-d52a395cbf86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:44:41.342811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff259-685a-4d0e-90f6-d52a395cbf86 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:41.343177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff259-685a-4d0e-90f6-d52a395cbf86 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:41.343490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff259-685a-4d0e-90f6-d52a395cbf86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:41.345463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0d1ff259-685a-4d0e-90f6-d52a395cbf86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:41.357211 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:41.473075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ff259-685a-4d0e-90f6-d52a395cbf86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:44:41.474504 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ff259-685a-4d0e-90f6-d52a395cbf86 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:44:41.493263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 666/1322] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:44:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:44:44.504268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54787a71-b1da-47a2-a6dc-5802e74353a0 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:44.504782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54787a71-b1da-47a2-a6dc-5802e74353a0 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:44.505320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54787a71-b1da-47a2-a6dc-5802e74353a0 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:44.506569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 657/1323] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:44:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:44:44.512528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12383aa5-cfc4-4066-a930-e91973a9e551 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:44.513050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12383aa5-cfc4-4066-a930-e91973a9e551 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:44.513134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12383aa5-cfc4-4066-a930-e91973a9e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:44.587657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-12383aa5-cfc4-4066-a930-e91973a9e551 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:44.588867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-12383aa5-cfc4-4066-a930-e91973a9e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:44.654083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:44.707497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 667/1324] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:44.746919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54787a71-b1da-47a2-a6dc-5802e74353a0 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:44:44.748697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-54787a71-b1da-47a2-a6dc-5802e74353a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:44.878679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54787a71-b1da-47a2-a6dc-5802e74353a0 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:44:44.893310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:44.961648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f88ce9-cdb1-483a-b8e5-8d3f78912618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:44:44.962122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f88ce9-cdb1-483a-b8e5-8d3f78912618 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:44.962456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f88ce9-cdb1-483a-b8e5-8d3f78912618 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:44.962801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f88ce9-cdb1-483a-b8e5-8d3f78912618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:44.964658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f4f88ce9-cdb1-483a-b8e5-8d3f78912618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:45.105627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f88ce9-cdb1-483a-b8e5-8d3f78912618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:44:45.107014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f88ce9-cdb1-483a-b8e5-8d3f78912618 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:44:45.127115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 658/1325] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:44:47.294205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae55f-c289-4f95-abd4-2b926d498c12 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:47.294884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae55f-c289-4f95-abd4-2b926d498c12 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:47.294884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae55f-c289-4f95-abd4-2b926d498c12 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:47.296429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 668/1326] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:44:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:44:47.302430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca658-ee53-4c7c-922e-eb3f78d841d8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:47.302985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca658-ee53-4c7c-922e-eb3f78d841d8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:47.303104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca658-ee53-4c7c-922e-eb3f78d841d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:47.362551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:47.385745 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-5ccca658-ee53-4c7c-922e-eb3f78d841d8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:47.387033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-5ccca658-ee53-4c7c-922e-eb3f78d841d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:47.532914 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 659/1327] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:47.574215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adae55f-c289-4f95-abd4-2b926d498c12 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:44:47.577387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1adae55f-c289-4f95-abd4-2b926d498c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:47.707760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adae55f-c289-4f95-abd4-2b926d498c12 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:44:47.795714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96091080-cbec-484a-8663-5676ea765b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:44:47.796336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96091080-cbec-484a-8663-5676ea765b09 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:47.796625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96091080-cbec-484a-8663-5676ea765b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:47.797017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96091080-cbec-484a-8663-5676ea765b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:47.798774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-96091080-cbec-484a-8663-5676ea765b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:47.819131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:47.953334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96091080-cbec-484a-8663-5676ea765b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:44:47.954812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96091080-cbec-484a-8663-5676ea765b09 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:44:47.979821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 669/1328] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:44:50.139422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95142-9f8b-488e-a385-bf27bca16bb9 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:50.140196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95142-9f8b-488e-a385-bf27bca16bb9 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:50.140196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95142-9f8b-488e-a385-bf27bca16bb9 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:50.141673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 660/1329] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:44:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:44:50.147764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab8c7-1f85-4f6e-8950-60649ad5c3e0 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:50.148329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab8c7-1f85-4f6e-8950-60649ad5c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:50.148329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab8c7-1f85-4f6e-8950-60649ad5c3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:50.250583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-288ab8c7-1f85-4f6e-8950-60649ad5c3e0 None None] MFA Rules not processed for user `640696f6e9954a98a5d477fef0c386bb`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:50.251879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-288ab8c7-1f85-4f6e-8950-60649ad5c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:50.326391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:50.366324 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 670/1330] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:44:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:50.405171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd95142-9f8b-488e-a385-bf27bca16bb9 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:44:50.406898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ecd95142-9f8b-488e-a385-bf27bca16bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:50.532870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd95142-9f8b-488e-a385-bf27bca16bb9 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:44:50.554704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:50.617327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418074a4-8a5a-45b6-8787-ef299fbf4746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:44:50.617871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418074a4-8a5a-45b6-8787-ef299fbf4746 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:50.618217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418074a4-8a5a-45b6-8787-ef299fbf4746 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:50.618460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418074a4-8a5a-45b6-8787-ef299fbf4746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:50.620505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-418074a4-8a5a-45b6-8787-ef299fbf4746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:50.770919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418074a4-8a5a-45b6-8787-ef299fbf4746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:44:50.772480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418074a4-8a5a-45b6-8787-ef299fbf4746 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:44:50.795348 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 661/1331] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:44:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:44:53.195042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319629a0-bfe8-422b-9797-337b6c17457f None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:53.195703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319629a0-bfe8-422b-9797-337b6c17457f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:53.195703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319629a0-bfe8-422b-9797-337b6c17457f None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:53.196944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 671/1332] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:44:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:44:53.203404 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80c8fa-b120-4d46-a4ed-b114e8aa0268 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:53.204741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80c8fa-b120-4d46-a4ed-b114e8aa0268 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:53.204741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80c8fa-b120-4d46-a4ed-b114e8aa0268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:53.283333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:53.286831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-2e80c8fa-b120-4d46-a4ed-b114e8aa0268 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:53.288859 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2e80c8fa-b120-4d46-a4ed-b114e8aa0268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:53.396730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 662/1333] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:53.436221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319629a0-bfe8-422b-9797-337b6c17457f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:44:53.438116 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-319629a0-bfe8-422b-9797-337b6c17457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:53.553842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319629a0-bfe8-422b-9797-337b6c17457f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:44:53.651115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf357482-a94b-44e7-8714-bcd7f8ea3ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:44:53.651744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357482-a94b-44e7-8714-bcd7f8ea3ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:53.652021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357482-a94b-44e7-8714-bcd7f8ea3ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:53.652294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357482-a94b-44e7-8714-bcd7f8ea3ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:53.653979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-cf357482-a94b-44e7-8714-bcd7f8ea3ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:53.688167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:53.779863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf357482-a94b-44e7-8714-bcd7f8ea3ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:44:53.781414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf357482-a94b-44e7-8714-bcd7f8ea3ba4 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:44:53.800563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 672/1334] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:44:55.943412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa43a04-5563-4277-8f13-cf3cc811db01 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:55.944022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa43a04-5563-4277-8f13-cf3cc811db01 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:55.944022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa43a04-5563-4277-8f13-cf3cc811db01 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:55.945388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 663/1335] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:44:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:44:55.951008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d9680-36c1-402d-b260-d85181e1e7eb None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:55.951510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d9680-36c1-402d-b260-d85181e1e7eb None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:55.951616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d9680-36c1-402d-b260-d85181e1e7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:56.027529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-823d9680-36c1-402d-b260-d85181e1e7eb None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:56.028757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-823d9680-36c1-402d-b260-d85181e1e7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:56.113001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:56.141877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 673/1336] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:56.187697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa43a04-5563-4277-8f13-cf3cc811db01 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:44:56.189278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6fa43a04-5563-4277-8f13-cf3cc811db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:56.311545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa43a04-5563-4277-8f13-cf3cc811db01 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:44:56.345477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:56.394113 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7d2a3-4e42-46c5-acba-390e68b3cdbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:44:56.394639 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d2a3-4e42-46c5-acba-390e68b3cdbb service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:56.394916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d2a3-4e42-46c5-acba-390e68b3cdbb service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:56.395287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d2a3-4e42-46c5-acba-390e68b3cdbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:56.397005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-49c7d2a3-4e42-46c5-acba-390e68b3cdbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:56.523759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7d2a3-4e42-46c5-acba-390e68b3cdbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:44:56.525225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7d2a3-4e42-46c5-acba-390e68b3cdbb service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:44:56.544493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 664/1337] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:44:59.072631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39016104-a4d3-4aa4-ae62-c24dbc5b554a None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:59.073256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39016104-a4d3-4aa4-ae62-c24dbc5b554a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:59.073256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39016104-a4d3-4aa4-ae62-c24dbc5b554a None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:59.075153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 674/1338] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:44:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:44:59.081609 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9c37-2d4e-440e-9bd8-fca16bd65c5c None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:59.082157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9c37-2d4e-440e-9bd8-fca16bd65c5c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:59.082157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9c37-2d4e-440e-9bd8-fca16bd65c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:59.152985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-8fcf9c37-2d4e-440e-9bd8-fca16bd65c5c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:44:59.154223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8fcf9c37-2d4e-440e-9bd8-fca16bd65c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:59.164643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:59.268791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 665/1339] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:44:59.308089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39016104-a4d3-4aa4-ae62-c24dbc5b554a None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:44:59.309662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-39016104-a4d3-4aa4-ae62-c24dbc5b554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:59.438710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39016104-a4d3-4aa4-ae62-c24dbc5b554a None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:44:59.521246 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be1b01-c5be-496b-9431-1cba49608926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:44:59.521874 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be1b01-c5be-496b-9431-1cba49608926 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:44:59.522150 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be1b01-c5be-496b-9431-1cba49608926 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:44:59.522419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be1b01-c5be-496b-9431-1cba49608926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:44:59.524121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e4be1b01-c5be-496b-9431-1cba49608926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:44:59.565003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:59.653875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be1b01-c5be-496b-9431-1cba49608926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:44:59.655284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be1b01-c5be-496b-9431-1cba49608926 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:44:59.677175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 675/1340] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:44:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:45:04.152771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794325c-f5cd-4e98-ac96-6363a4b71bfb None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:04.153268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794325c-f5cd-4e98-ac96-6363a4b71bfb None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:04.153396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794325c-f5cd-4e98-ac96-6363a4b71bfb None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:04.154790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 666/1341] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:04.160840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55b32-5a89-4b5a-bc1c-b3b758e1b9ae None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:04.161386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55b32-5a89-4b5a-bc1c-b3b758e1b9ae None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:04.161386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55b32-5a89-4b5a-bc1c-b3b758e1b9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:04.246059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-84c55b32-5a89-4b5a-bc1c-b3b758e1b9ae None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:04.247375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-84c55b32-5a89-4b5a-bc1c-b3b758e1b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:04.342518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:04.354921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 676/1342] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:04.394885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794325c-f5cd-4e98-ac96-6363a4b71bfb None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:04.396490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a794325c-f5cd-4e98-ac96-6363a4b71bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:04.515298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794325c-f5cd-4e98-ac96-6363a4b71bfb None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:04.556725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:04.600650 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd6f9-078b-479b-9e5e-520890cc0ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:04.601257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd6f9-078b-479b-9e5e-520890cc0ded service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:04.601540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd6f9-078b-479b-9e5e-520890cc0ded service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:04.601816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd6f9-078b-479b-9e5e-520890cc0ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:04.603625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-93cfd6f9-078b-479b-9e5e-520890cc0ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:04.743425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd6f9-078b-479b-9e5e-520890cc0ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:04.744935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd6f9-078b-479b-9e5e-520890cc0ded service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:04.775212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 667/1343] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:45:07.618523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123100-f44a-4221-8c98-b2f12d9b9f28 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:07.619190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123100-f44a-4221-8c98-b2f12d9b9f28 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:07.619190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123100-f44a-4221-8c98-b2f12d9b9f28 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:07.620501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 677/1344] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:07.626305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c09bb-f509-4467-b3b4-6f4eca8b3280 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:07.626840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c09bb-f509-4467-b3b4-6f4eca8b3280 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:07.626840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c09bb-f509-4467-b3b4-6f4eca8b3280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:07.704208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e78c09bb-f509-4467-b3b4-6f4eca8b3280 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:07.705679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e78c09bb-f509-4467-b3b4-6f4eca8b3280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:07.726741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:07.823218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 668/1345] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:45:07.861488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a123100-f44a-4221-8c98-b2f12d9b9f28 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:07.863345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1a123100-f44a-4221-8c98-b2f12d9b9f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:07.993223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a123100-f44a-4221-8c98-b2f12d9b9f28 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:08.073193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b8758-ad20-4ce7-ba6c-8af07d41f1d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:08.073728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8758-ad20-4ce7-ba6c-8af07d41f1d9 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:08.073988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8758-ad20-4ce7-ba6c-8af07d41f1d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:08.074286 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8758-ad20-4ce7-ba6c-8af07d41f1d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:08.075967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-505b8758-ad20-4ce7-ba6c-8af07d41f1d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:08.122554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:08.200045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b8758-ad20-4ce7-ba6c-8af07d41f1d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:08.201505 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b8758-ad20-4ce7-ba6c-8af07d41f1d9 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:08.224492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 678/1346] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:45:12.489129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a02c5e-c203-4a4c-b549-a24f4b316420 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:12.489129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a02c5e-c203-4a4c-b549-a24f4b316420 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:12.491108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a02c5e-c203-4a4c-b549-a24f4b316420 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:12.492813 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 669/1347] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:12 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:12.507203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53519a61-5646-4470-9ce7-6aaf0f50ae7a None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:12.507777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53519a61-5646-4470-9ce7-6aaf0f50ae7a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:12.507777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53519a61-5646-4470-9ce7-6aaf0f50ae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:12.595463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-53519a61-5646-4470-9ce7-6aaf0f50ae7a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:12.596749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-53519a61-5646-4470-9ce7-6aaf0f50ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:12.728432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:12.732865 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 679/1348] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:12.774612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a02c5e-c203-4a4c-b549-a24f4b316420 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:12.776216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a9a02c5e-c203-4a4c-b549-a24f4b316420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:12.905620 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a02c5e-c203-4a4c-b549-a24f4b316420 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:12.973682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:13.004366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedaca4-8e48-42bd-9150-a3e57c80a24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:13.005004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedaca4-8e48-42bd-9150-a3e57c80a24b service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:13.005283 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedaca4-8e48-42bd-9150-a3e57c80a24b service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:13.005559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedaca4-8e48-42bd-9150-a3e57c80a24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:13.007324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-faedaca4-8e48-42bd-9150-a3e57c80a24b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:13.160476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedaca4-8e48-42bd-9150-a3e57c80a24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:13.163411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedaca4-8e48-42bd-9150-a3e57c80a24b service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:13.190537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 670/1349] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:45:18.758276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aff043-2812-4228-aa88-efb27cfba5f0 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:18.758276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aff043-2812-4228-aa88-efb27cfba5f0 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:18.758892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aff043-2812-4228-aa88-efb27cfba5f0 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:18.761178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 680/1350] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 16:45:18 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:18.769720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01606-b8a5-4b97-8391-da32b0d6236e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:18.770574 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01606-b8a5-4b97-8391-da32b0d6236e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:18.770574 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01606-b8a5-4b97-8391-da32b0d6236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:18.956140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f4e01606-b8a5-4b97-8391-da32b0d6236e None None] MFA Rules not processed for user `6deeea314be545609b0fe4dd786b3b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:18.958493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f4e01606-b8a5-4b97-8391-da32b0d6236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:19.000395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:19.185516 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 671/1351] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 16:45:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:24.623571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134289f-2552-45d5-ad01-3246e1d268db None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:24.623571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134289f-2552-45d5-ad01-3246e1d268db None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:24.623571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134289f-2552-45d5-ad01-3246e1d268db None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:24.625072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 681/1352] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 16:45:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:24.629925 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed896-0fb8-4d20-b778-92898429fa95 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:24.630786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed896-0fb8-4d20-b778-92898429fa95 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:24.630786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed896-0fb8-4d20-b778-92898429fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:24.751070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-2a1ed896-0fb8-4d20-b778-92898429fa95 None None] MFA Rules not processed for user `6deeea314be545609b0fe4dd786b3b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:24.751070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2a1ed896-0fb8-4d20-b778-92898429fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:24.865404 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:24.932057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 672/1353] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:45:26.637447 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb76d-4a81-497f-a067-2df50f2a9583 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:26.638045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb76d-4a81-497f-a067-2df50f2a9583 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:26.638237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb76d-4a81-497f-a067-2df50f2a9583 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:26.640457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 682/1354] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 16:45:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:26.646331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a3c48-6115-48da-b8cf-93fa4cf46828 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:26.646920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a3c48-6115-48da-b8cf-93fa4cf46828 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:26.647044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a3c48-6115-48da-b8cf-93fa4cf46828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:26.742038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ad5a3c48-6115-48da-b8cf-93fa4cf46828 None None] MFA Rules not processed for user `6deeea314be545609b0fe4dd786b3b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:26.743629 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ad5a3c48-6115-48da-b8cf-93fa4cf46828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:26.896965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 673/1355] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:31.052971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3edd0-55ef-411c-ae93-a0a05d9eef90 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:31.053570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3edd0-55ef-411c-ae93-a0a05d9eef90 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:31.053670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3edd0-55ef-411c-ae93-a0a05d9eef90 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:31.055683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 683/1356] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:31.063065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfce72-cf41-4baf-a130-9d163282434a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:31.063726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfce72-cf41-4baf-a130-9d163282434a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:31.064260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfce72-cf41-4baf-a130-9d163282434a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:31.115774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:31.189882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d3bfce72-cf41-4baf-a130-9d163282434a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:31.191780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d3bfce72-cf41-4baf-a130-9d163282434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:31.382459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 674/1357] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:45:31.478069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fea33-e88d-47a0-98a3-7be2641b96cc None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:31.478355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fea33-e88d-47a0-98a3-7be2641b96cc None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:31.478523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fea33-e88d-47a0-98a3-7be2641b96cc None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:31.480233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 684/1358] 10.222.0.124 () {54 vars in 967 bytes} [Mon Aug 1 16:45:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:31.515682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23ba7-f520-4568-9649-64351d2c8929 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:31.516388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23ba7-f520-4568-9649-64351d2c8929 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:31.517194 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23ba7-f520-4568-9649-64351d2c8929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:31.670894 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6bb23ba7-f520-4568-9649-64351d2c8929 None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:31.672391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6bb23ba7-f520-4568-9649-64351d2c8929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:31.765866 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:31.883371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 675/1359] 10.222.0.124 () {58 vars in 1064 bytes} [Mon Aug 1 16:45:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:45:31.899240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fea33-e88d-47a0-98a3-7be2641b96cc None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:31.900829 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-745fea33-e88d-47a0-98a3-7be2641b96cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:32.195939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fea33-e88d-47a0-98a3-7be2641b96cc None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:32.292362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:32.347908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b426e-63de-42b1-8ce9-17fcbd0722b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:32.348744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b426e-63de-42b1-8ce9-17fcbd0722b7 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:32.349139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b426e-63de-42b1-8ce9-17fcbd0722b7 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:32.349509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b426e-63de-42b1-8ce9-17fcbd0722b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:32.351422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-137b426e-63de-42b1-8ce9-17fcbd0722b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:32.466093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b426e-63de-42b1-8ce9-17fcbd0722b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:32.467988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b426e-63de-42b1-8ce9-17fcbd0722b7 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:32.491193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 685/1360] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:45:35.031687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac6a2d-9912-4ebf-82e9-4c9276c8a458 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:35.032350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac6a2d-9912-4ebf-82e9-4c9276c8a458 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:35.032350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac6a2d-9912-4ebf-82e9-4c9276c8a458 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:35.034082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 676/1361] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:35.040787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab475-410b-462f-b2f8-ef3628b284bc None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:35.041494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab475-410b-462f-b2f8-ef3628b284bc None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:35.041584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab475-410b-462f-b2f8-ef3628b284bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:35.148572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-551ab475-410b-462f-b2f8-ef3628b284bc None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:35.150325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-551ab475-410b-462f-b2f8-ef3628b284bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:35.202480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:35.284458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 686/1362] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:35.341109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac6a2d-9912-4ebf-82e9-4c9276c8a458 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:35.345140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e1ac6a2d-9912-4ebf-82e9-4c9276c8a458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:35.698562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac6a2d-9912-4ebf-82e9-4c9276c8a458 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:35.715738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:35.921803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821fba0-950c-4758-94d6-cee7f531e257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:35.922665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821fba0-950c-4758-94d6-cee7f531e257 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:35.923072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821fba0-950c-4758-94d6-cee7f531e257 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:35.923457 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821fba0-950c-4758-94d6-cee7f531e257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:35.926666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1821fba0-950c-4758-94d6-cee7f531e257 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:36.106937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821fba0-950c-4758-94d6-cee7f531e257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:36.109981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821fba0-950c-4758-94d6-cee7f531e257 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:36.147338 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 677/1363] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:45:38.735727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b44a1-a035-4aa4-bd11-beaf6cf90db3 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:38.736559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b44a1-a035-4aa4-bd11-beaf6cf90db3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:38.736559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b44a1-a035-4aa4-bd11-beaf6cf90db3 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:38.737557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 687/1364] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:38.744092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacad7c-cec9-4740-a296-80e043886423 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:38.745077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacad7c-cec9-4740-a296-80e043886423 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:38.745514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacad7c-cec9-4740-a296-80e043886423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:38.764262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:38.842381 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-cfacad7c-cec9-4740-a296-80e043886423 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:38.844156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cfacad7c-cec9-4740-a296-80e043886423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:38.991054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 678/1365] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:45:39.049962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59abb28-f6ef-41a1-a0ad-44440bca8103 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:39.052198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59abb28-f6ef-41a1-a0ad-44440bca8103 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:39.052928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59abb28-f6ef-41a1-a0ad-44440bca8103 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:39.056387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 688/1366] 10.222.0.124 () {54 vars in 967 bytes} [Mon Aug 1 16:45:39 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:39.066161 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373fb6d-5177-42c1-8a1a-9e04d1212321 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:39.066476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373fb6d-5177-42c1-8a1a-9e04d1212321 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:39.067476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373fb6d-5177-42c1-8a1a-9e04d1212321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:39.200259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a373fb6d-5177-42c1-8a1a-9e04d1212321 None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:39.201596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a373fb6d-5177-42c1-8a1a-9e04d1212321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:39.246870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:39.350641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 679/1367] 10.222.0.124 () {58 vars in 1064 bytes} [Mon Aug 1 16:45:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:39.364950 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59abb28-f6ef-41a1-a0ad-44440bca8103 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:39.367325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d59abb28-f6ef-41a1-a0ad-44440bca8103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:39.638856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59abb28-f6ef-41a1-a0ad-44440bca8103 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:39.679777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:39.867889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ff0e-4fcd-4a9a-9323-837a1c4cbc00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:39.869878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ff0e-4fcd-4a9a-9323-837a1c4cbc00 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:39.870510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ff0e-4fcd-4a9a-9323-837a1c4cbc00 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:39.871156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ff0e-4fcd-4a9a-9323-837a1c4cbc00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:39.874561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f707ff0e-4fcd-4a9a-9323-837a1c4cbc00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:39.992530 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707ff0e-4fcd-4a9a-9323-837a1c4cbc00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:39.994740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707ff0e-4fcd-4a9a-9323-837a1c4cbc00 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:40.016289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 689/1368] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:45:41.018933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95b4a-2bf4-4105-bd8c-167f4360f918 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:41.019664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95b4a-2bf4-4105-bd8c-167f4360f918 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:41.019664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95b4a-2bf4-4105-bd8c-167f4360f918 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:41.021107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 680/1369] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:41.026684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979be48-d646-45a3-a06a-c98296745bcc None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:41.027272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979be48-d646-45a3-a06a-c98296745bcc None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:41.027386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979be48-d646-45a3-a06a-c98296745bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:41.061340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:41.103146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-7979be48-d646-45a3-a06a-c98296745bcc None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:41.105738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7979be48-d646-45a3-a06a-c98296745bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:41.219084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 690/1370] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:41.569931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330fa5-067f-4240-ba37-f48c19d13504 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:41.569931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330fa5-067f-4240-ba37-f48c19d13504 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:41.569931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330fa5-067f-4240-ba37-f48c19d13504 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:41.572835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 681/1371] 10.222.0.124 () {54 vars in 969 bytes} [Mon Aug 1 16:45:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:41.576082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7133cf-55fa-47b8-8cf5-46db190fb60b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:41.576325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7133cf-55fa-47b8-8cf5-46db190fb60b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:41.576638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7133cf-55fa-47b8-8cf5-46db190fb60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:41.661795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-5e7133cf-55fa-47b8-8cf5-46db190fb60b None None] MFA Rules not processed for user `8d0c157c2bd44a0089f5efb058be372b`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:41.663124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5e7133cf-55fa-47b8-8cf5-46db190fb60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:41.717856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:41.751126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 691/1372] 10.222.0.124 () {58 vars in 1066 bytes} [Mon Aug 1 16:45:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:45:41.758787 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98330fa5-067f-4240-ba37-f48c19d13504 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:41.760304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-98330fa5-067f-4240-ba37-f48c19d13504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:41.883950 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98330fa5-067f-4240-ba37-f48c19d13504 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:41.940871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:41.996868 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c54ad-f89f-46b7-a387-114dd81e24e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:41.998679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c54ad-f89f-46b7-a387-114dd81e24e4 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:41.998679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c54ad-f89f-46b7-a387-114dd81e24e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:41.998679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c54ad-f89f-46b7-a387-114dd81e24e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:42.000425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e31c54ad-f89f-46b7-a387-114dd81e24e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:42.126214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c54ad-f89f-46b7-a387-114dd81e24e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:42.127724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c54ad-f89f-46b7-a387-114dd81e24e4 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:42.148724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 682/1373] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:45:42.213638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97d997-eaee-4274-ad0a-9a09ad6344ed None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:42.214125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97d997-eaee-4274-ad0a-9a09ad6344ed None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:42.214357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97d997-eaee-4274-ad0a-9a09ad6344ed None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:42.219694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 692/1374] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:42 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:42.221701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c639-fa49-4d13-a197-1de2b4e61164 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:42.221980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c639-fa49-4d13-a197-1de2b4e61164 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:42.222284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c639-fa49-4d13-a197-1de2b4e61164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:42.307073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-2c05c639-fa49-4d13-a197-1de2b4e61164 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:42.308158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2c05c639-fa49-4d13-a197-1de2b4e61164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:42.335333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:42.475115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 683/1375] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:42.535998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97d997-eaee-4274-ad0a-9a09ad6344ed None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:42.537756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3b97d997-eaee-4274-ad0a-9a09ad6344ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:42.723347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97d997-eaee-4274-ad0a-9a09ad6344ed None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:42.790376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:42.876216 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4a6de-965c-430b-b92e-fd795bac3de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:42.876884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a6de-965c-430b-b92e-fd795bac3de6 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:42.877193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a6de-965c-430b-b92e-fd795bac3de6 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:42.877473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a6de-965c-430b-b92e-fd795bac3de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:42.879532 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-67d4a6de-965c-430b-b92e-fd795bac3de6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:43.020409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4a6de-965c-430b-b92e-fd795bac3de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:43.027915 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4a6de-965c-430b-b92e-fd795bac3de6 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:43.053753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 693/1376] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:45:45.379970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb38e1-327d-424d-a296-54c40ebe1b11 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:45.380722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb38e1-327d-424d-a296-54c40ebe1b11 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:45.380722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb38e1-327d-424d-a296-54c40ebe1b11 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:45.382521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 684/1377] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:45.388298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e2df9-a208-43c5-a0bb-cda7e338c8f7 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:45.388799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e2df9-a208-43c5-a0bb-cda7e338c8f7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:45.389071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e2df9-a208-43c5-a0bb-cda7e338c8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:45.465602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-603e2df9-a208-43c5-a0bb-cda7e338c8f7 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:45.466761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-603e2df9-a208-43c5-a0bb-cda7e338c8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:45.474398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:45.600740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 694/1378] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:45.651996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb38e1-327d-424d-a296-54c40ebe1b11 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:45.653636 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2ebb38e1-327d-424d-a296-54c40ebe1b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:45.826612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb38e1-327d-424d-a296-54c40ebe1b11 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:45.830728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:46.026727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a97621-a8d7-4955-a995-d8a8b230f467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:46.027902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a97621-a8d7-4955-a995-d8a8b230f467 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:46.028387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a97621-a8d7-4955-a995-d8a8b230f467 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:46.029100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a97621-a8d7-4955-a995-d8a8b230f467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:46.032714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-73a97621-a8d7-4955-a995-d8a8b230f467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:46.223777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a97621-a8d7-4955-a995-d8a8b230f467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:46.226350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a97621-a8d7-4955-a995-d8a8b230f467 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:46.280110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 685/1379] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:45:48.606924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2f65-2d2b-44ef-b988-86730271fdda None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:48.607877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2f65-2d2b-44ef-b988-86730271fdda None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:48.607877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2f65-2d2b-44ef-b988-86730271fdda None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:48.609266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 695/1380] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:48.615457 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e336f-0b93-40dd-808a-69ef84f37500 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:48.616431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e336f-0b93-40dd-808a-69ef84f37500 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:48.616431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e336f-0b93-40dd-808a-69ef84f37500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:48.630305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:48.703635 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-527e336f-0b93-40dd-808a-69ef84f37500 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:48.704946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-527e336f-0b93-40dd-808a-69ef84f37500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:48.935079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 686/1381] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:45:49.020922 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2f65-2d2b-44ef-b988-86730271fdda None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:49.025806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-22bf2f65-2d2b-44ef-b988-86730271fdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:49.333065 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:49.359797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2f65-2d2b-44ef-b988-86730271fdda None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:49.667536 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8ba7a-ed84-491d-9a0e-2fe3bfbb3f8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:49.668499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8ba7a-ed84-491d-9a0e-2fe3bfbb3f8a service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:49.668967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8ba7a-ed84-491d-9a0e-2fe3bfbb3f8a service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:49.669495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8ba7a-ed84-491d-9a0e-2fe3bfbb3f8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:49.673137 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-61d8ba7a-ed84-491d-9a0e-2fe3bfbb3f8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:49.870229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8ba7a-ed84-491d-9a0e-2fe3bfbb3f8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:49.873607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8ba7a-ed84-491d-9a0e-2fe3bfbb3f8a service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:49.893611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:49.917132 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 696/1382] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 897 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:45:52.755408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a639d1-dfe4-495f-aaf7-b0ae1cb50b27 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:52.756219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a639d1-dfe4-495f-aaf7-b0ae1cb50b27 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:52.756219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a639d1-dfe4-495f-aaf7-b0ae1cb50b27 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:52.757616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 687/1383] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:45:52.764035 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562522d-51c2-4575-9ec2-1c0d4e7e271b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:52.764954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562522d-51c2-4575-9ec2-1c0d4e7e271b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:52.765431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562522d-51c2-4575-9ec2-1c0d4e7e271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:52.847842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-6562522d-51c2-4575-9ec2-1c0d4e7e271b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:52.849116 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6562522d-51c2-4575-9ec2-1c0d4e7e271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:52.990488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 697/1384] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:45:53.056498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a639d1-dfe4-495f-aaf7-b0ae1cb50b27 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:53.058166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-47a639d1-dfe4-495f-aaf7-b0ae1cb50b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:53.177839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:53.300831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a639d1-dfe4-495f-aaf7-b0ae1cb50b27 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:53.460107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fd1b4-682c-41f2-bf81-c9be49399340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:53.460785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fd1b4-682c-41f2-bf81-c9be49399340 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:53.461077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fd1b4-682c-41f2-bf81-c9be49399340 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:53.461355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fd1b4-682c-41f2-bf81-c9be49399340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:53.463166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9e9fd1b4-682c-41f2-bf81-c9be49399340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:53.544764 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:53.616026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fd1b4-682c-41f2-bf81-c9be49399340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:53.620023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fd1b4-682c-41f2-bf81-c9be49399340 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:53.656981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 688/1385] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:45:55.883761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b7754-32d2-4b2d-b2b8-2b7b774ac86b None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:55.884419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b7754-32d2-4b2d-b2b8-2b7b774ac86b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:55.884419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b7754-32d2-4b2d-b2b8-2b7b774ac86b None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:55.885745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 698/1386] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:45:55.893352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe8551-6612-4e90-87bd-25f9cb13390f None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:55.893962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe8551-6612-4e90-87bd-25f9cb13390f None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:55.894317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe8551-6612-4e90-87bd-25f9cb13390f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:56.013092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1cfe8551-6612-4e90-87bd-25f9cb13390f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:56.014810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1cfe8551-6612-4e90-87bd-25f9cb13390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:56.190127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 689/1387] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:56.253029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b7754-32d2-4b2d-b2b8-2b7b774ac86b None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:56.254623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-749b7754-32d2-4b2d-b2b8-2b7b774ac86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:56.380875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:56.476575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b7754-32d2-4b2d-b2b8-2b7b774ac86b None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:56.641524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed506a-8da7-411f-8fad-11c9129014ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:56.642158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed506a-8da7-411f-8fad-11c9129014ef service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:56.642431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed506a-8da7-411f-8fad-11c9129014ef service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:56.642699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed506a-8da7-411f-8fad-11c9129014ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:56.644382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-16ed506a-8da7-411f-8fad-11c9129014ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:56.693069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:56.756347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed506a-8da7-411f-8fad-11c9129014ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:56.758331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed506a-8da7-411f-8fad-11c9129014ef service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:56.781359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 699/1388] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:45:58.485358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dca310-f9d4-4f2b-a16e-7db78fc3f9a1 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:58.486233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dca310-f9d4-4f2b-a16e-7db78fc3f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:58.486233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dca310-f9d4-4f2b-a16e-7db78fc3f9a1 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:58.487614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 690/1389] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:58.493523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2656-890f-4b3e-8b9d-d43116f49c9f None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:58.494053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2656-890f-4b3e-8b9d-d43116f49c9f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:58.494053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2656-890f-4b3e-8b9d-d43116f49c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:58.568557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-7b0c2656-890f-4b3e-8b9d-d43116f49c9f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:58.569795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7b0c2656-890f-4b3e-8b9d-d43116f49c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:58.685611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 700/1390] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:58.771233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c91ab0-9fcb-44b7-8a9a-6a88543364c6 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:58.771632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c91ab0-9fcb-44b7-8a9a-6a88543364c6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:58.772030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c91ab0-9fcb-44b7-8a9a-6a88543364c6 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:58.775740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 691/1391] 10.222.0.124 () {54 vars in 971 bytes} [Mon Aug 1 16:45:58 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:58.784574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141aa92-7908-44da-9727-bde50eff5a21 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:58.784940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141aa92-7908-44da-9727-bde50eff5a21 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:58.785290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141aa92-7908-44da-9727-bde50eff5a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:58.806215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:58.887073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4141aa92-7908-44da-9727-bde50eff5a21 None None] MFA Rules not processed for user `b1cabb41d38a40acb7d41c169cc90cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:58.888461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4141aa92-7908-44da-9727-bde50eff5a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:58.924040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788618-0ef7-4c91-84d3-079988a41d6b None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:58.924040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788618-0ef7-4c91-84d3-079988a41d6b None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:58.924524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788618-0ef7-4c91-84d3-079988a41d6b None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:58.926406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 692/1392] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:45:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:45:58.932254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3a9a-f743-4b5d-8873-dd84aa70dc28 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:58.932547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3a9a-f743-4b5d-8873-dd84aa70dc28 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:58.933315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3a9a-f743-4b5d-8873-dd84aa70dc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:58.975701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:59.000910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 701/1393] 10.222.0.124 () {58 vars in 1068 bytes} [Mon Aug 1 16:45:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:45:59.011664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141aa92-7908-44da-9727-bde50eff5a21 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:59.020449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141aa92-7908-44da-9727-bde50eff5a21 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:59.023616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-3e6b3a9a-f743-4b5d-8873-dd84aa70dc28 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:45:59.025234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3e6b3a9a-f743-4b5d-8873-dd84aa70dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:59.131695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a62bd-e904-4d9a-8401-548eb301e4d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1cabb41d38a40acb7d41c169cc90cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:59.132713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a62bd-e904-4d9a-8401-548eb301e4d2 service glance] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:59.133139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a62bd-e904-4d9a-8401-548eb301e4d2 service glance] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:59.133734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a62bd-e904-4d9a-8401-548eb301e4d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:59.136252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ab2a62bd-e904-4d9a-8401-548eb301e4d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:59.166017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 693/1394] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:45:59.175527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:59.213928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b3a9a-f743-4b5d-8873-dd84aa70dc28 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:45:59.215753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3e6b3a9a-f743-4b5d-8873-dd84aa70dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:59.296345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a62bd-e904-4d9a-8401-548eb301e4d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:59.297806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a62bd-e904-4d9a-8401-548eb301e4d2 service glance] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:59.322098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 702/1395] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:45:59.358311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:59.367926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b3a9a-f743-4b5d-8873-dd84aa70dc28 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:45:59.513955 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6028-c4dc-4739-97e6-0b335d7941c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:45:59.515120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6028-c4dc-4739-97e6-0b335d7941c1 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:45:59.515611 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6028-c4dc-4739-97e6-0b335d7941c1 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:45:59.516012 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6028-c4dc-4739-97e6-0b335d7941c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:45:59.519128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e93f6028-c4dc-4739-97e6-0b335d7941c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:45:59.656973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f6028-c4dc-4739-97e6-0b335d7941c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:45:59.658517 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f6028-c4dc-4739-97e6-0b335d7941c1 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:45:59.676532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:59.680562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 694/1396] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:46:00.193130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b1be-e306-45aa-b4d8-010ac4f9191b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:00.193978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b1be-e306-45aa-b4d8-010ac4f9191b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:00.193978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b1be-e306-45aa-b4d8-010ac4f9191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:00.273815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-8215b1be-e306-45aa-b4d8-010ac4f9191b None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:00.275418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8215b1be-e306-45aa-b4d8-010ac4f9191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:00.373728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:00.381437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 703/1397] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:46:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:00.437308 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452a881-10ed-4838-ae6f-edb0df23b8ea None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:00.437585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452a881-10ed-4838-ae6f-edb0df23b8ea None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:00.437867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452a881-10ed-4838-ae6f-edb0df23b8ea None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:00.439316 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 695/1398] 10.222.0.124 () {54 vars in 948 bytes} [Mon Aug 1 16:46:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:00.446846 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282ee0-3735-4683-b2d6-1f4e1729cf95 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:00.447185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282ee0-3735-4683-b2d6-1f4e1729cf95 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:00.447494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282ee0-3735-4683-b2d6-1f4e1729cf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:00.540449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-9d282ee0-3735-4683-b2d6-1f4e1729cf95 None None] MFA Rules not processed for user `7b46aa077b4147c9836b646cf42cff50`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:00.541645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9d282ee0-3735-4683-b2d6-1f4e1729cf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:00.689471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 704/1399] 10.222.0.124 () {58 vars in 1045 bytes} [Mon Aug 1 16:46:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:00.700083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452a881-10ed-4838-ae6f-edb0df23b8ea None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:00.701182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8452a881-10ed-4838-ae6f-edb0df23b8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:00.865807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452a881-10ed-4838-ae6f-edb0df23b8ea None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:00.960477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:00.983296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204ffb8-3db8-4ad9-a78a-9bd4de24122a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:00.983960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204ffb8-3db8-4ad9-a78a-9bd4de24122a service swift] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:00.984243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204ffb8-3db8-4ad9-a78a-9bd4de24122a service swift] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:00.984521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204ffb8-3db8-4ad9-a78a-9bd4de24122a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:00.986267 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1204ffb8-3db8-4ad9-a78a-9bd4de24122a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:01.079593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204ffb8-3db8-4ad9-a78a-9bd4de24122a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:01.081245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204ffb8-3db8-4ad9-a78a-9bd4de24122a service swift] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:01.091199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 696/1400] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:46:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:46:01.863982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28578ea-6b54-4b74-9773-45edcd47a5e5 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:01.864438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28578ea-6b54-4b74-9773-45edcd47a5e5 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:01.864531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28578ea-6b54-4b74-9773-45edcd47a5e5 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:01.866122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 705/1401] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:46:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:01.872207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac2cb-52df-4a08-96ec-3cec7b547f6d None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:01.873265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac2cb-52df-4a08-96ec-3cec7b547f6d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:01.874214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac2cb-52df-4a08-96ec-3cec7b547f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:01.969631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-70bac2cb-52df-4a08-96ec-3cec7b547f6d None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:01.970900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-70bac2cb-52df-4a08-96ec-3cec7b547f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:02.077368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:02.111868 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 697/1402] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:02.159870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28578ea-6b54-4b74-9773-45edcd47a5e5 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:02.162274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f28578ea-6b54-4b74-9773-45edcd47a5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:02.233999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:02.364460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28578ea-6b54-4b74-9773-45edcd47a5e5 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:02.564196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59965074-b528-4d2c-8b67-4d74430cd144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:02.564927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59965074-b528-4d2c-8b67-4d74430cd144 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:02.565279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59965074-b528-4d2c-8b67-4d74430cd144 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:02.565635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59965074-b528-4d2c-8b67-4d74430cd144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:02.567435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-59965074-b528-4d2c-8b67-4d74430cd144 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:02.586462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:02.668571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59965074-b528-4d2c-8b67-4d74430cd144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:02.670248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59965074-b528-4d2c-8b67-4d74430cd144 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:02.696291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 706/1403] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:04.810541 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c960c90-844c-45d1-aed4-0001f8dbf808 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:04.811116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c960c90-844c-45d1-aed4-0001f8dbf808 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:04.811116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c960c90-844c-45d1-aed4-0001f8dbf808 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:04.812862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 698/1404] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:46:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:04.818476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f121d-7470-4d55-b87c-116956a9e737 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:04.819382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f121d-7470-4d55-b87c-116956a9e737 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:04.819824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f121d-7470-4d55-b87c-116956a9e737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:04.901238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-d30f121d-7470-4d55-b87c-116956a9e737 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:04.902469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d30f121d-7470-4d55-b87c-116956a9e737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:05.014886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:05.025239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 707/1405] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:05.075961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c960c90-844c-45d1-aed4-0001f8dbf808 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:05.077509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0c960c90-844c-45d1-aed4-0001f8dbf808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:05.249305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c960c90-844c-45d1-aed4-0001f8dbf808 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:05.316650 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:05.395881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142a9d1-1c8f-4de1-bc31-cb890d8c40c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:05.396612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a9d1-1c8f-4de1-bc31-cb890d8c40c5 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:05.396804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a9d1-1c8f-4de1-bc31-cb890d8c40c5 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:05.397079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a9d1-1c8f-4de1-bc31-cb890d8c40c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:05.399024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-5142a9d1-1c8f-4de1-bc31-cb890d8c40c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:05.527051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142a9d1-1c8f-4de1-bc31-cb890d8c40c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:05.528815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142a9d1-1c8f-4de1-bc31-cb890d8c40c5 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:05.552903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 699/1406] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:07.793194 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f99e-7fdb-43bf-98ea-a01bf6ad0d4d None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:07.793777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f99e-7fdb-43bf-98ea-a01bf6ad0d4d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:07.793777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f99e-7fdb-43bf-98ea-a01bf6ad0d4d None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:07.795099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 708/1407] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:46:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:46:07.804227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c5ac-b61c-4665-a09f-8aa19a9d565f None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:07.804813 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c5ac-b61c-4665-a09f-8aa19a9d565f None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:07.804924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c5ac-b61c-4665-a09f-8aa19a9d565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:07.887858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-72e9c5ac-b61c-4665-a09f-8aa19a9d565f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:07.889139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-72e9c5ac-b61c-4665-a09f-8aa19a9d565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:07.909020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:08.063970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 700/1408] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:08.122105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842f99e-7fdb-43bf-98ea-a01bf6ad0d4d None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:08.123851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1842f99e-7fdb-43bf-98ea-a01bf6ad0d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:08.386905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842f99e-7fdb-43bf-98ea-a01bf6ad0d4d None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:08.546012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:08.613443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96090dc-d40f-4701-afc9-df8b9c3ef9f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:08.614131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96090dc-d40f-4701-afc9-df8b9c3ef9f4 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:08.614446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96090dc-d40f-4701-afc9-df8b9c3ef9f4 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:08.614851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96090dc-d40f-4701-afc9-df8b9c3ef9f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:08.616832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c96090dc-d40f-4701-afc9-df8b9c3ef9f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:08.754076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96090dc-d40f-4701-afc9-df8b9c3ef9f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:08.755791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96090dc-d40f-4701-afc9-df8b9c3ef9f4 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:08.778393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 709/1409] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:18.061539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=37 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:18.775932 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=65 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:25.634170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0589468-06e8-4520-98a0-eced4deae739 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:25.635013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0589468-06e8-4520-98a0-eced4deae739 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:25.635013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0589468-06e8-4520-98a0-eced4deae739 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:25.636069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 701/1410] 10.222.0.124 () {54 vars in 923 bytes} [Mon Aug 1 16:46:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:25.641831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6b2a-22c2-4b42-b9b2-62f7d4748ffe None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:25.642335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6b2a-22c2-4b42-b9b2-62f7d4748ffe None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:25.642335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6b2a-22c2-4b42-b9b2-62f7d4748ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:25.728661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-54ba6b2a-22c2-4b42-b9b2-62f7d4748ffe None None] MFA Rules not processed for user `6deeea314be545609b0fe4dd786b3b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:25.729899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-54ba6b2a-22c2-4b42-b9b2-62f7d4748ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:25.846483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 710/1411] 10.222.0.124 () {58 vars in 1020 bytes} [Mon Aug 1 16:46:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:25.863306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20163436-e216-45cc-b6d7-06f05e3df9c5 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:25.863594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20163436-e216-45cc-b6d7-06f05e3df9c5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:25.863870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20163436-e216-45cc-b6d7-06f05e3df9c5 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:25.865336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 702/1412] 10.222.0.124 () {54 vars in 923 bytes} [Mon Aug 1 16:46:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:25.871206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fcf49-a2b8-4b90-a413-c440e135c97a None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:25.871487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fcf49-a2b8-4b90-a413-c440e135c97a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:25.871783 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fcf49-a2b8-4b90-a413-c440e135c97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:25.956246 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:25.959609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-780fcf49-a2b8-4b90-a413-c440e135c97a None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:25.961490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-780fcf49-a2b8-4b90-a413-c440e135c97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:26.092594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 711/1413] 10.222.0.124 () {58 vars in 1020 bytes} [Mon Aug 1 16:46:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:28.758805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed4f6e-6e21-47dd-987d-e306e7e3b973 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:28.759753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed4f6e-6e21-47dd-987d-e306e7e3b973 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:28.759753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed4f6e-6e21-47dd-987d-e306e7e3b973 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:28.761102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:46:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:28.766819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc49444-5ee9-4bee-9b1d-4aaccc91e969 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:28.767387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc49444-5ee9-4bee-9b1d-4aaccc91e969 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:28.767552 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc49444-5ee9-4bee-9b1d-4aaccc91e969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:28.846165 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-8bc49444-5ee9-4bee-9b1d-4aaccc91e969 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:28.847542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8bc49444-5ee9-4bee-9b1d-4aaccc91e969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:28.909007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:28.959782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:29.007223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed4f6e-6e21-47dd-987d-e306e7e3b973 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:29.009605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-54ed4f6e-6e21-47dd-987d-e306e7e3b973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:29.180303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed4f6e-6e21-47dd-987d-e306e7e3b973 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:29.257235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:29.302049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3ace6-e9fa-4fb3-88ad-58ee6c20d788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:29.302556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3ace6-e9fa-4fb3-88ad-58ee6c20d788 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:29.302836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3ace6-e9fa-4fb3-88ad-58ee6c20d788 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:29.303153 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3ace6-e9fa-4fb3-88ad-58ee6c20d788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:29.304813 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6ac3ace6-e9fa-4fb3-88ad-58ee6c20d788 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:29.409416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3ace6-e9fa-4fb3-88ad-58ee6c20d788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:29.411005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3ace6-e9fa-4fb3-88ad-58ee6c20d788 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:29.432027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 704/1416] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:30.367454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42346a-fdf9-4d6f-b638-f7574abddf61 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:30.368053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42346a-fdf9-4d6f-b638-f7574abddf61 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:30.368053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42346a-fdf9-4d6f-b638-f7574abddf61 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:30.369523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:46:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:46:30.374878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1da4c-3c83-4cdf-9216-1fbe3c5ede76 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:30.375413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1da4c-3c83-4cdf-9216-1fbe3c5ede76 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:30.375413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1da4c-3c83-4cdf-9216-1fbe3c5ede76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:30.461197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-18d1da4c-3c83-4cdf-9216-1fbe3c5ede76 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:30.462439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-18d1da4c-3c83-4cdf-9216-1fbe3c5ede76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:30.491370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:30.573156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:30.728667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42346a-fdf9-4d6f-b638-f7574abddf61 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:30.730251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-cf42346a-fdf9-4d6f-b638-f7574abddf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:30.910400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42346a-fdf9-4d6f-b638-f7574abddf61 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:30.955931 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:31.038630 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ede63e-0aa4-462b-98bb-dbba6b34846b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:31.039286 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ede63e-0aa4-462b-98bb-dbba6b34846b service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:31.039566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ede63e-0aa4-462b-98bb-dbba6b34846b service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:31.039838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ede63e-0aa4-462b-98bb-dbba6b34846b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:31.041569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-85ede63e-0aa4-462b-98bb-dbba6b34846b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:31.265032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ede63e-0aa4-462b-98bb-dbba6b34846b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:31.266625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ede63e-0aa4-462b-98bb-dbba6b34846b service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:31.285353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 714/1419] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:32.229814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1513d-d06b-4163-b3bc-568d348cb824 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:32.230380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1513d-d06b-4163-b3bc-568d348cb824 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:32.230380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1513d-d06b-4163-b3bc-568d348cb824 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:32.231681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:46:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:32.238496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a60dc-8971-451f-a2dd-46242b4cb5cb None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:32.239239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a60dc-8971-451f-a2dd-46242b4cb5cb None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:32.239511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a60dc-8971-451f-a2dd-46242b4cb5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:32.310984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:32.339669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ff1a60dc-8971-451f-a2dd-46242b4cb5cb None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:32.341120 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ff1a60dc-8971-451f-a2dd-46242b4cb5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:32.485866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:32.655097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1513d-d06b-4163-b3bc-568d348cb824 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:32.657127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e9b1513d-d06b-4163-b3bc-568d348cb824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:32.830719 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1513d-d06b-4163-b3bc-568d348cb824 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:32.850232 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:32.963990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4fa58-e65a-44c8-ab11-0b88997ea95f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:32.964625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4fa58-e65a-44c8-ab11-0b88997ea95f service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:32.964902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4fa58-e65a-44c8-ab11-0b88997ea95f service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:32.965176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4fa58-e65a-44c8-ab11-0b88997ea95f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:32.967214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b9d4fa58-e65a-44c8-ab11-0b88997ea95f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:33.070322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4fa58-e65a-44c8-ab11-0b88997ea95f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:33.071972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4fa58-e65a-44c8-ab11-0b88997ea95f service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:33.095696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 707/1422] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:46:34.030433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a22bd-eb45-442c-a61e-fa3fe9e76a5b None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:34.031134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a22bd-eb45-442c-a61e-fa3fe9e76a5b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:34.031134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a22bd-eb45-442c-a61e-fa3fe9e76a5b None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:34.032407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:46:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:34.039156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c693-a2ef-4e9f-aa59-4760e63ab345 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:34.039972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c693-a2ef-4e9f-aa59-4760e63ab345 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:34.040143 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c693-a2ef-4e9f-aa59-4760e63ab345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:34.065804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:34.136436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d742c693-a2ef-4e9f-aa59-4760e63ab345 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:34.137617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d742c693-a2ef-4e9f-aa59-4760e63ab345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:34.255966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:34.426593 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a22bd-eb45-442c-a61e-fa3fe9e76a5b None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:34.429200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e81a22bd-eb45-442c-a61e-fa3fe9e76a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:34.585448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:34.631992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a22bd-eb45-442c-a61e-fa3fe9e76a5b None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:34.788822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0039d-318d-43cb-b15e-233dd7594dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:34.789473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0039d-318d-43cb-b15e-233dd7594dd1 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:34.789740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0039d-318d-43cb-b15e-233dd7594dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:34.790008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0039d-318d-43cb-b15e-233dd7594dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:34.792138 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c6d0039d-318d-43cb-b15e-233dd7594dd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:34.884730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:34.899524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0039d-318d-43cb-b15e-233dd7594dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:34.901637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0039d-318d-43cb-b15e-233dd7594dd1 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:34.920763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 717/1425] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:35.802805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d659-ca86-40ff-ba35-008e6623c4ca None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:35.803436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d659-ca86-40ff-ba35-008e6623c4ca None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:35.803436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d659-ca86-40ff-ba35-008e6623c4ca None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:35.804845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:46:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:35.810923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d68bcb-c563-484d-bede-ff31347217f9 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:35.811464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d68bcb-c563-484d-bede-ff31347217f9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:35.811464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d68bcb-c563-484d-bede-ff31347217f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:35.893472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-c9d68bcb-c563-484d-bede-ff31347217f9 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:35.894716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c9d68bcb-c563-484d-bede-ff31347217f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:36.002328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:36.165879 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10d659-ca86-40ff-ba35-008e6623c4ca None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:36.167365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ba10d659-ca86-40ff-ba35-008e6623c4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:36.268202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:36.340784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10d659-ca86-40ff-ba35-008e6623c4ca None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:36.467760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abb86e-8717-4e9f-9e48-3f6cf7c0ad09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:36.468440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abb86e-8717-4e9f-9e48-3f6cf7c0ad09 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:36.468795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abb86e-8717-4e9f-9e48-3f6cf7c0ad09 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:36.469156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abb86e-8717-4e9f-9e48-3f6cf7c0ad09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:36.470884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-68abb86e-8717-4e9f-9e48-3f6cf7c0ad09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:36.529297 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:36.577408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abb86e-8717-4e9f-9e48-3f6cf7c0ad09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:36.579069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abb86e-8717-4e9f-9e48-3f6cf7c0ad09 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:36.598893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 710/1428] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:37.434232 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194073b5-fa11-4d22-8d46-72f54613e52f None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:37.434889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194073b5-fa11-4d22-8d46-72f54613e52f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:37.434889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194073b5-fa11-4d22-8d46-72f54613e52f None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:37.436266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:46:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:37.442392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ccea-30dd-4b4d-9789-111e4916f6e7 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:37.443065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ccea-30dd-4b4d-9789-111e4916f6e7 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:37.443065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ccea-30dd-4b4d-9789-111e4916f6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:37.547253 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f8a5ccea-30dd-4b4d-9789-111e4916f6e7 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:37.548587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f8a5ccea-30dd-4b4d-9789-111e4916f6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:37.657708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:37.812284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194073b5-fa11-4d22-8d46-72f54613e52f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:37.813851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-194073b5-fa11-4d22-8d46-72f54613e52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:37.870075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:37.979306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194073b5-fa11-4d22-8d46-72f54613e52f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:38.113927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68edec-b9db-4078-8cf7-1e300bc88274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:38.114926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68edec-b9db-4078-8cf7-1e300bc88274 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:38.115456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68edec-b9db-4078-8cf7-1e300bc88274 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:38.115961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68edec-b9db-4078-8cf7-1e300bc88274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:38.119129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-bd68edec-b9db-4078-8cf7-1e300bc88274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:38.132425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:38.248254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68edec-b9db-4078-8cf7-1e300bc88274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:38.249861 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68edec-b9db-4078-8cf7-1e300bc88274 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:38.269062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 720/1431] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:39.117597 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168791c7-7dee-454c-8d50-0c1ad2bd8f8d None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:39.118802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168791c7-7dee-454c-8d50-0c1ad2bd8f8d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:39.118802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168791c7-7dee-454c-8d50-0c1ad2bd8f8d None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:39.119592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:46:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:39.125650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f4d42-ca2e-48a4-9dfe-679ce9f23978 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:39.126619 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f4d42-ca2e-48a4-9dfe-679ce9f23978 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:39.126619 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f4d42-ca2e-48a4-9dfe-679ce9f23978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:39.223351 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-9c4f4d42-ca2e-48a4-9dfe-679ce9f23978 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:39.224605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9c4f4d42-ca2e-48a4-9dfe-679ce9f23978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:39.302782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:39.336525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:46:39.496840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168791c7-7dee-454c-8d50-0c1ad2bd8f8d None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:39.499429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-168791c7-7dee-454c-8d50-0c1ad2bd8f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:39.519419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:39.667356 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168791c7-7dee-454c-8d50-0c1ad2bd8f8d None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:39.767610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:39.799101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38829be6-1ae9-4bd1-ad5f-fa982ac32118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:39.799743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38829be6-1ae9-4bd1-ad5f-fa982ac32118 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:39.800020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38829be6-1ae9-4bd1-ad5f-fa982ac32118 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:39.800293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38829be6-1ae9-4bd1-ad5f-fa982ac32118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:39.802022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-38829be6-1ae9-4bd1-ad5f-fa982ac32118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:39.936758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38829be6-1ae9-4bd1-ad5f-fa982ac32118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:39.938536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38829be6-1ae9-4bd1-ad5f-fa982ac32118 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:39.960051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 713/1434] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:40.804660 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d661f-7f24-4035-a0c1-fe4c16a14040 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:40.805280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d661f-7f24-4035-a0c1-fe4c16a14040 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:40.805280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d661f-7f24-4035-a0c1-fe4c16a14040 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:40.806570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:46:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:40.812151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075dff1-6fe7-4d56-bcd2-b562026f60be None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:40.812665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075dff1-6fe7-4d56-bcd2-b562026f60be None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:40.812761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075dff1-6fe7-4d56-bcd2-b562026f60be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:40.903454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b075dff1-6fe7-4d56-bcd2-b562026f60be None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:40.904764 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b075dff1-6fe7-4d56-bcd2-b562026f60be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:40.952430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:41.019346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:41.182218 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d661f-7f24-4035-a0c1-fe4c16a14040 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:41.184646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d24d661f-7f24-4035-a0c1-fe4c16a14040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:41.365138 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d661f-7f24-4035-a0c1-fe4c16a14040 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:41.434210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:41.516985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228cd0d-7868-42e9-90ac-47514942ffd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:41.517622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228cd0d-7868-42e9-90ac-47514942ffd4 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:41.517898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228cd0d-7868-42e9-90ac-47514942ffd4 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:41.518168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228cd0d-7868-42e9-90ac-47514942ffd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:41.519924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d228cd0d-7868-42e9-90ac-47514942ffd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:41.627558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228cd0d-7868-42e9-90ac-47514942ffd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:41.629115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228cd0d-7868-42e9-90ac-47514942ffd4 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:41.651779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 723/1437] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:42.503191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9bdfa-6dbf-428b-83e3-e8d3d3271545 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:42.503767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9bdfa-6dbf-428b-83e3-e8d3d3271545 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:42.504144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9bdfa-6dbf-428b-83e3-e8d3d3271545 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:42.506717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:46:42 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:42.515785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e530-729c-495c-97ba-cb4bd3e3caf1 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:42.516409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e530-729c-495c-97ba-cb4bd3e3caf1 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:42.516409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e530-729c-495c-97ba-cb4bd3e3caf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:42.607907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4ad4e530-729c-495c-97ba-cb4bd3e3caf1 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:42.609148 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4ad4e530-729c-495c-97ba-cb4bd3e3caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:42.611439 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:42.721189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:42.873645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9bdfa-6dbf-428b-83e3-e8d3d3271545 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:42.875263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-56a9bdfa-6dbf-428b-83e3-e8d3d3271545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:43.042896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9bdfa-6dbf-428b-83e3-e8d3d3271545 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:43.074236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:43.173690 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83ef4b-e53a-418f-a476-45babb142b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:43.174201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83ef4b-e53a-418f-a476-45babb142b20 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:43.174484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83ef4b-e53a-418f-a476-45babb142b20 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:43.174764 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83ef4b-e53a-418f-a476-45babb142b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:43.176519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3c83ef4b-e53a-418f-a476-45babb142b20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:43.292972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83ef4b-e53a-418f-a476-45babb142b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:43.295579 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83ef4b-e53a-418f-a476-45babb142b20 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:43.330762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 716/1440] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:45.371973 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea275-1c51-4dea-81a7-abdf75714f3c None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:45.372606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea275-1c51-4dea-81a7-abdf75714f3c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:45.372606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea275-1c51-4dea-81a7-abdf75714f3c None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:45.373906 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:46:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:45.379794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e867ce0-ea79-4aa0-b2c9-b40aee14cca1 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:45.380333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e867ce0-ea79-4aa0-b2c9-b40aee14cca1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:45.380333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e867ce0-ea79-4aa0-b2c9-b40aee14cca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:45.426258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:45.457785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1e867ce0-ea79-4aa0-b2c9-b40aee14cca1 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:45.459087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1e867ce0-ea79-4aa0-b2c9-b40aee14cca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:45.588314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:45.633477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea275-1c51-4dea-81a7-abdf75714f3c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:45.635096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e61ea275-1c51-4dea-81a7-abdf75714f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:45.753719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea275-1c51-4dea-81a7-abdf75714f3c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:45.791595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:45.838622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2a0c9-0b94-426a-9f4e-b89a3db06f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:45.839324 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a0c9-0b94-426a-9f4e-b89a3db06f2b service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:45.839606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a0c9-0b94-426a-9f4e-b89a3db06f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:45.839883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a0c9-0b94-426a-9f4e-b89a3db06f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:45.841565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-77b2a0c9-0b94-426a-9f4e-b89a3db06f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:45.965732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2a0c9-0b94-426a-9f4e-b89a3db06f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:45.967590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2a0c9-0b94-426a-9f4e-b89a3db06f2b service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:45.997742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 726/1443] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:48.277601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e04b0-87bb-412f-904d-50e1ae3ba06c None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:48.278203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e04b0-87bb-412f-904d-50e1ae3ba06c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:48.278203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e04b0-87bb-412f-904d-50e1ae3ba06c None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:48.279757 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:46:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:48.286674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cdb0a-7244-41f8-820f-e21bac9d633b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:48.287362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cdb0a-7244-41f8-820f-e21bac9d633b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:48.287671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cdb0a-7244-41f8-820f-e21bac9d633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:48.372666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-9b7cdb0a-7244-41f8-820f-e21bac9d633b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:48.373941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9b7cdb0a-7244-41f8-820f-e21bac9d633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:48.389670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:48.484521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:46:48.527765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e04b0-87bb-412f-904d-50e1ae3ba06c None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:48.530159 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1b8e04b0-87bb-412f-904d-50e1ae3ba06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:48.654703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e04b0-87bb-412f-904d-50e1ae3ba06c None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:48.668364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:48.751191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cf724-8b5c-46ad-9144-a23788082c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:48.751884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf724-8b5c-46ad-9144-a23788082c27 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:48.752207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf724-8b5c-46ad-9144-a23788082c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:48.752470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf724-8b5c-46ad-9144-a23788082c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:48.754363 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e79cf724-8b5c-46ad-9144-a23788082c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:48.896851 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cf724-8b5c-46ad-9144-a23788082c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:48.899536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cf724-8b5c-46ad-9144-a23788082c27 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:48.933953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 719/1446] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:51.456834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d8077-7f1e-43fa-8b7e-405102e56e47 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:51.457472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d8077-7f1e-43fa-8b7e-405102e56e47 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:51.457472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d8077-7f1e-43fa-8b7e-405102e56e47 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:51.458826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:46:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:51.475776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644b7fe-c0f5-4672-8dae-68e7784e2dac None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:51.476436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644b7fe-c0f5-4672-8dae-68e7784e2dac None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:51.476436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644b7fe-c0f5-4672-8dae-68e7784e2dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:51.532336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:51.552666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-3644b7fe-c0f5-4672-8dae-68e7784e2dac None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:51.553930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3644b7fe-c0f5-4672-8dae-68e7784e2dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:51.688114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:51.735962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d8077-7f1e-43fa-8b7e-405102e56e47 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:51.738109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-915d8077-7f1e-43fa-8b7e-405102e56e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:51.867705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d8077-7f1e-43fa-8b7e-405102e56e47 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:51.921330 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:51.961603 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320543c3-34c5-42bd-a313-edac885ce0e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:51.962226 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320543c3-34c5-42bd-a313-edac885ce0e9 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:51.962503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320543c3-34c5-42bd-a313-edac885ce0e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:51.962769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320543c3-34c5-42bd-a313-edac885ce0e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:51.964669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-320543c3-34c5-42bd-a313-edac885ce0e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:52.102685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320543c3-34c5-42bd-a313-edac885ce0e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:52.104170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320543c3-34c5-42bd-a313-edac885ce0e9 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:52.123344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 729/1449] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:54.383709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702af7-17ba-43dc-8446-71058c52d16a None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:54.384305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702af7-17ba-43dc-8446-71058c52d16a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:54.384305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702af7-17ba-43dc-8446-71058c52d16a None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:54.385934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:46:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:54.392075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b687b7-e39b-4758-8d92-d076470bc42f None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:54.392655 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b687b7-e39b-4758-8d92-d076470bc42f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:54.392655 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b687b7-e39b-4758-8d92-d076470bc42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:54.474627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-09b687b7-e39b-4758-8d92-d076470bc42f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:54.475933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-09b687b7-e39b-4758-8d92-d076470bc42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:54.500538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:54.587942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:54.628356 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12702af7-17ba-43dc-8446-71058c52d16a None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:54.629959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-12702af7-17ba-43dc-8446-71058c52d16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:54.746965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12702af7-17ba-43dc-8446-71058c52d16a None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:54.769191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:54.848167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49181ecb-0182-4fc4-ab2b-ac00881e1177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:54.848812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49181ecb-0182-4fc4-ab2b-ac00881e1177 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:54.849094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49181ecb-0182-4fc4-ab2b-ac00881e1177 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:54.849373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49181ecb-0182-4fc4-ab2b-ac00881e1177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:54.851161 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-49181ecb-0182-4fc4-ab2b-ac00881e1177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:54.973991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49181ecb-0182-4fc4-ab2b-ac00881e1177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:54.975501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49181ecb-0182-4fc4-ab2b-ac00881e1177 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:54.996786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 722/1452] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:46:57.283373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df959f19-e1a8-472a-8e2b-1ed39ba96afd None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:57.284315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df959f19-e1a8-472a-8e2b-1ed39ba96afd None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:57.284315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df959f19-e1a8-472a-8e2b-1ed39ba96afd None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:57.285554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:46:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:46:57.295865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837795-20f7-43c5-946b-2fad90a879ea None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:57.296535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837795-20f7-43c5-946b-2fad90a879ea None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:57.296535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837795-20f7-43c5-946b-2fad90a879ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:57.375730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:57.378880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ed837795-20f7-43c5-946b-2fad90a879ea None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:46:57.380751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ed837795-20f7-43c5-946b-2fad90a879ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:57.499962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:46:57.539457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df959f19-e1a8-472a-8e2b-1ed39ba96afd None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:46:57.540985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-df959f19-e1a8-472a-8e2b-1ed39ba96afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:57.667456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df959f19-e1a8-472a-8e2b-1ed39ba96afd None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:46:57.727154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:57.757785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dbbcd-01a8-48fc-85cb-cbaf41467ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:46:57.758435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dbbcd-01a8-48fc-85cb-cbaf41467ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:46:57.758711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dbbcd-01a8-48fc-85cb-cbaf41467ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:46:57.759002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dbbcd-01a8-48fc-85cb-cbaf41467ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:46:57.760849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c64dbbcd-01a8-48fc-85cb-cbaf41467ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:46:57.896269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dbbcd-01a8-48fc-85cb-cbaf41467ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:46:57.897645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dbbcd-01a8-48fc-85cb-cbaf41467ff7 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:46:57.920139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 732/1455] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:00.093026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed1c7-3225-455a-bc5b-4b8f63ce57bf None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:00.093675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed1c7-3225-455a-bc5b-4b8f63ce57bf None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:00.094015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed1c7-3225-455a-bc5b-4b8f63ce57bf None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:00.096780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:47:00 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:00.102984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc86f-a6b3-4725-9d84-61089ede1e6b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:00.103861 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc86f-a6b3-4725-9d84-61089ede1e6b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:00.103861 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc86f-a6b3-4725-9d84-61089ede1e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:00.178482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-8abdc86f-a6b3-4725-9d84-61089ede1e6b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:00.179686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8abdc86f-a6b3-4725-9d84-61089ede1e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:00.222780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:00.308023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:00.351493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ed1c7-3225-455a-bc5b-4b8f63ce57bf None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:00.353198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f67ed1c7-3225-455a-bc5b-4b8f63ce57bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:00.473885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ed1c7-3225-455a-bc5b-4b8f63ce57bf None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:00.509099 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:00.569836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd671e-542d-4244-adfc-d89d83e17ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:00.570474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd671e-542d-4244-adfc-d89d83e17ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:00.570800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd671e-542d-4244-adfc-d89d83e17ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:00.571076 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd671e-542d-4244-adfc-d89d83e17ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:00.573078 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f1dd671e-542d-4244-adfc-d89d83e17ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:00.702353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd671e-542d-4244-adfc-d89d83e17ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:00.704065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd671e-542d-4244-adfc-d89d83e17ac1 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:00.730709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 725/1458] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:02.979269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888b51e-88df-493a-a42c-e5b11a2dcd32 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:02.979900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888b51e-88df-493a-a42c-e5b11a2dcd32 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:02.980070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888b51e-88df-493a-a42c-e5b11a2dcd32 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:02.981926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:47:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:02.988085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78315-7626-4606-b410-81c0a4218cc7 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:02.988592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78315-7626-4606-b410-81c0a4218cc7 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:02.988701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78315-7626-4606-b410-81c0a4218cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:03.062877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-26d78315-7626-4606-b410-81c0a4218cc7 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:03.064186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-26d78315-7626-4606-b410-81c0a4218cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:03.074128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:03.179924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:03.220746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888b51e-88df-493a-a42c-e5b11a2dcd32 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:03.222298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0888b51e-88df-493a-a42c-e5b11a2dcd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:03.345038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888b51e-88df-493a-a42c-e5b11a2dcd32 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:03.407755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:03.429091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd5b82-022a-4529-a2a6-04a0dac88187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:03.429749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5b82-022a-4529-a2a6-04a0dac88187 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:03.430027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5b82-022a-4529-a2a6-04a0dac88187 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:03.430298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5b82-022a-4529-a2a6-04a0dac88187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:03.432081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d4bd5b82-022a-4529-a2a6-04a0dac88187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:03.556681 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd5b82-022a-4529-a2a6-04a0dac88187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:03.559361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd5b82-022a-4529-a2a6-04a0dac88187 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:03.582698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 735/1461] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:05.703606 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d0615-d79c-4001-82b5-8c8eadb491e9 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:05.704702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d0615-d79c-4001-82b5-8c8eadb491e9 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:05.704914 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d0615-d79c-4001-82b5-8c8eadb491e9 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:05.707200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:47:05 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:05.716922 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8aebd-1000-45f1-ac49-980da85b37aa None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:05.718144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8aebd-1000-45f1-ac49-980da85b37aa None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:05.718144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8aebd-1000-45f1-ac49-980da85b37aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:05.796288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-34e8aebd-1000-45f1-ac49-980da85b37aa None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:05.797469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-34e8aebd-1000-45f1-ac49-980da85b37aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:05.839393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:05.906336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:05.957037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d0615-d79c-4001-82b5-8c8eadb491e9 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:05.958614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-107d0615-d79c-4001-82b5-8c8eadb491e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:06.078042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d0615-d79c-4001-82b5-8c8eadb491e9 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:06.122246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:06.174446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf56e17-804e-45f4-a4d9-e29cb9c785be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:06.175102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf56e17-804e-45f4-a4d9-e29cb9c785be service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:06.175385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf56e17-804e-45f4-a4d9-e29cb9c785be service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:06.175660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf56e17-804e-45f4-a4d9-e29cb9c785be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:06.177508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9bf56e17-804e-45f4-a4d9-e29cb9c785be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:06.430620 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf56e17-804e-45f4-a4d9-e29cb9c785be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:06.432063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf56e17-804e-45f4-a4d9-e29cb9c785be service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:06.454241 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 728/1464] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:08.567327 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb1f87-4971-4127-b643-f41dabeef0e4 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:08.567942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb1f87-4971-4127-b643-f41dabeef0e4 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:08.567942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb1f87-4971-4127-b643-f41dabeef0e4 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:08.569247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:47:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:08.575325 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415cdd-09af-4b28-bf22-e8898b6f2b67 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:08.576133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415cdd-09af-4b28-bf22-e8898b6f2b67 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:08.576133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415cdd-09af-4b28-bf22-e8898b6f2b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:08.658843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-79415cdd-09af-4b28-bf22-e8898b6f2b67 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:08.660120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-79415cdd-09af-4b28-bf22-e8898b6f2b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:08.680767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:08.769769 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:08.810378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb1f87-4971-4127-b643-f41dabeef0e4 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:08.812013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-96eb1f87-4971-4127-b643-f41dabeef0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:08.942609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb1f87-4971-4127-b643-f41dabeef0e4 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:09.026429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:09.035634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16a7c-95ce-4a44-8001-47d685557ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:09.036279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16a7c-95ce-4a44-8001-47d685557ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:09.036563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16a7c-95ce-4a44-8001-47d685557ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:09.036860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16a7c-95ce-4a44-8001-47d685557ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:09.038514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a6f16a7c-95ce-4a44-8001-47d685557ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:09.176701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f16a7c-95ce-4a44-8001-47d685557ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:09.178186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f16a7c-95ce-4a44-8001-47d685557ef1 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:09.196753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 738/1467] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:11.264513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9635-09f8-46de-8663-2d6764ed5e6b None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:11.265124 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9635-09f8-46de-8663-2d6764ed5e6b None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:11.265124 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9635-09f8-46de-8663-2d6764ed5e6b None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:11.266442 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:47:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:11.272600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae697-8926-4539-8570-c3e375cfb8c3 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:11.273125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae697-8926-4539-8570-c3e375cfb8c3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:11.273125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae697-8926-4539-8570-c3e375cfb8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:11.364260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-213ae697-8926-4539-8570-c3e375cfb8c3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:11.365853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-213ae697-8926-4539-8570-c3e375cfb8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:11.427295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:11.490567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:11.529487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb9635-09f8-46de-8663-2d6764ed5e6b None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:11.531233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-eebb9635-09f8-46de-8663-2d6764ed5e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:11.651420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb9635-09f8-46de-8663-2d6764ed5e6b None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:11.709399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:11.745783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab064b-74eb-4fad-b9d7-fae36aaf1699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:11.746500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab064b-74eb-4fad-b9d7-fae36aaf1699 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:11.746795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab064b-74eb-4fad-b9d7-fae36aaf1699 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:11.747174 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab064b-74eb-4fad-b9d7-fae36aaf1699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:11.748986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1cab064b-74eb-4fad-b9d7-fae36aaf1699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:11.876857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab064b-74eb-4fad-b9d7-fae36aaf1699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:11.878233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab064b-74eb-4fad-b9d7-fae36aaf1699 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:11.898917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 731/1470] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:21.488695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=22 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:21.896196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=66 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:32.332663 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c54f-89b5-48fd-bc90-35fe8f55c17b None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:32.333318 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c54f-89b5-48fd-bc90-35fe8f55c17b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:32.333318 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c54f-89b5-48fd-bc90-35fe8f55c17b None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:32.334543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 740/1471] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:47:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:32.341190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3a4c2-06ce-4e45-baa4-a2d609a207f1 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:32.341709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3a4c2-06ce-4e45-baa4-a2d609a207f1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:32.342019 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3a4c2-06ce-4e45-baa4-a2d609a207f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:32.427346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a8e3a4c2-06ce-4e45-baa4-a2d609a207f1 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:32.428707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a8e3a4c2-06ce-4e45-baa4-a2d609a207f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:32.535723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 732/1472] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:32.630352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e45422-1af7-4ab3-8a2f-b5623e057766 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:32.630747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e45422-1af7-4ab3-8a2f-b5623e057766 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:32.631070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e45422-1af7-4ab3-8a2f-b5623e057766 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:32.633176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 741/1473] 10.222.0.124 () {54 vars in 971 bytes} [Mon Aug 1 16:47:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:32.638455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebeb1a-6f60-4fe8-98d8-49545af1bdbb None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:32.638925 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebeb1a-6f60-4fe8-98d8-49545af1bdbb None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:32.639072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebeb1a-6f60-4fe8-98d8-49545af1bdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:32.721724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b8ebeb1a-6f60-4fe8-98d8-49545af1bdbb None None] MFA Rules not processed for user `b1cabb41d38a40acb7d41c169cc90cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:32.722988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b8ebeb1a-6f60-4fe8-98d8-49545af1bdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:32.747354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:32.819379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 733/1474] 10.222.0.124 () {58 vars in 1068 bytes} [Mon Aug 1 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:32.828705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e45422-1af7-4ab3-8a2f-b5623e057766 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:32.830987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-33e45422-1af7-4ab3-8a2f-b5623e057766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:32.946434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e45422-1af7-4ab3-8a2f-b5623e057766 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:33.024629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ab084-40a0-4dbe-93a1-053c17556cb5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1cabb41d38a40acb7d41c169cc90cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:33.025260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab084-40a0-4dbe-93a1-053c17556cb5 service glance] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:33.025539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab084-40a0-4dbe-93a1-053c17556cb5 service glance] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:33.025809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab084-40a0-4dbe-93a1-053c17556cb5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:33.027541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3e3ab084-40a0-4dbe-93a1-053c17556cb5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:33.094376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:33.160903 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ab084-40a0-4dbe-93a1-053c17556cb5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:33.162372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ab084-40a0-4dbe-93a1-053c17556cb5 service glance] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:33.184319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 742/1475] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:35.385913 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750bc6-d3e5-4908-8809-3f21de0f0fef None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:35.386940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750bc6-d3e5-4908-8809-3f21de0f0fef None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:35.386940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750bc6-d3e5-4908-8809-3f21de0f0fef None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:35.388739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 734/1476] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:47:35 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:35.397749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a170ef-ffb5-41ea-8b0e-23b34378a3eb None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:35.398287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a170ef-ffb5-41ea-8b0e-23b34378a3eb None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:35.398287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a170ef-ffb5-41ea-8b0e-23b34378a3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:35.472496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-b1a170ef-ffb5-41ea-8b0e-23b34378a3eb None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:35.473718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b1a170ef-ffb5-41ea-8b0e-23b34378a3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:35.586296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 743/1477] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:47:35.618216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70750bc6-d3e5-4908-8809-3f21de0f0fef None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:35.619863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-70750bc6-d3e5-4908-8809-3f21de0f0fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:35.763125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70750bc6-d3e5-4908-8809-3f21de0f0fef None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:35.820785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:35.891683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416d2fc-59c1-4109-a54f-73303216aab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:35.892322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416d2fc-59c1-4109-a54f-73303216aab5 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:35.892604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416d2fc-59c1-4109-a54f-73303216aab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:35.892881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416d2fc-59c1-4109-a54f-73303216aab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:35.893595 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416d2fc-59c1-4109-a54f-73303216aab5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:35.895417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: WARNING py.warnings [None req-0416d2fc-59c1-4109-a54f-73303216aab5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:47:35.895417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: warnings.warn(msg) Aug 01 16:47:35.895417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: Aug 01 16:47:35.896622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416d2fc-59c1-4109-a54f-73303216aab5 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:35.916558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 735/1478] 10.222.0.124 () {56 vars in 1113 bytes} [Mon Aug 1 16:47:35 2022] GET /identity/v3/projects => generated 2562 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:47:38.005656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e6259-f395-48b3-b433-11926c9ff0d2 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:38.006283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e6259-f395-48b3-b433-11926c9ff0d2 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:38.006283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e6259-f395-48b3-b433-11926c9ff0d2 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:38.008081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 744/1479] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:47:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:38.020512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8463e-4aab-443f-9871-09b5246de620 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:38.021184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8463e-4aab-443f-9871-09b5246de620 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:38.021184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8463e-4aab-443f-9871-09b5246de620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:38.106315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b9d8463e-4aab-443f-9871-09b5246de620 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:38.107618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b9d8463e-4aab-443f-9871-09b5246de620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:38.231209 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 736/1480] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:38.281754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e6259-f395-48b3-b433-11926c9ff0d2 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:38.283422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b38e6259-f395-48b3-b433-11926c9ff0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:38.294870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:38.470430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e6259-f395-48b3-b433-11926c9ff0d2 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:38.565374 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:38.604193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b6f3b-aa8c-4d19-a39a-ae65fd1cb245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:38.604991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b6f3b-aa8c-4d19-a39a-ae65fd1cb245 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:38.605275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b6f3b-aa8c-4d19-a39a-ae65fd1cb245 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:38.605546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b6f3b-aa8c-4d19-a39a-ae65fd1cb245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:38.607241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8e4b6f3b-aa8c-4d19-a39a-ae65fd1cb245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:38.718282 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b6f3b-aa8c-4d19-a39a-ae65fd1cb245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:38.720464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b6f3b-aa8c-4d19-a39a-ae65fd1cb245 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:38.744883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 745/1481] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:41.148344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0efb8-ea99-40b6-a175-f79898973e1a None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:41.148966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0efb8-ea99-40b6-a175-f79898973e1a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:41.148966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0efb8-ea99-40b6-a175-f79898973e1a None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:41.150285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 737/1482] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:47:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:41.156284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91597f7-d234-4af3-9879-a49d320aaebd None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:41.156778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91597f7-d234-4af3-9879-a49d320aaebd None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:41.156889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91597f7-d234-4af3-9879-a49d320aaebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:41.241471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a91597f7-d234-4af3-9879-a49d320aaebd None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:41.242722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a91597f7-d234-4af3-9879-a49d320aaebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:41.302254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:41.361620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 746/1483] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:41.405632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0efb8-ea99-40b6-a175-f79898973e1a None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:41.407344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c5d0efb8-ea99-40b6-a175-f79898973e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:41.439221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:41.545735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0efb8-ea99-40b6-a175-f79898973e1a None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:41.630336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1262183-896d-40cf-8522-5f29c73808e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:41.631127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1262183-896d-40cf-8522-5f29c73808e3 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:41.631524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1262183-896d-40cf-8522-5f29c73808e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:41.631909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1262183-896d-40cf-8522-5f29c73808e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:41.633954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f1262183-896d-40cf-8522-5f29c73808e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:41.725401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:41.771284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1262183-896d-40cf-8522-5f29c73808e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:41.772760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1262183-896d-40cf-8522-5f29c73808e3 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:41.794559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 738/1484] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:43.927027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d3e8-06c8-4de3-8589-a41a4b5cb19c None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:43.927644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d3e8-06c8-4de3-8589-a41a4b5cb19c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:43.927644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d3e8-06c8-4de3-8589-a41a4b5cb19c None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:43.929137 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 747/1485] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:47:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:43.934441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70782-50b3-4a15-863e-45f544d1df86 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:43.934901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70782-50b3-4a15-863e-45f544d1df86 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:43.935039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70782-50b3-4a15-863e-45f544d1df86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:44.029733 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-daa70782-50b3-4a15-863e-45f544d1df86 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:44.030982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-daa70782-50b3-4a15-863e-45f544d1df86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:44.157521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 739/1486] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:44.202553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d3e8-06c8-4de3-8589-a41a4b5cb19c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:44.204262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3244d3e8-06c8-4de3-8589-a41a4b5cb19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:44.322965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d3e8-06c8-4de3-8589-a41a4b5cb19c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:44.413551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:44.415757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27900309-968e-4437-8f39-81f368ea9322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:44.416590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27900309-968e-4437-8f39-81f368ea9322 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:44.416935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27900309-968e-4437-8f39-81f368ea9322 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:44.417340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27900309-968e-4437-8f39-81f368ea9322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:44.420431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-27900309-968e-4437-8f39-81f368ea9322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:44.559347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27900309-968e-4437-8f39-81f368ea9322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:44.561009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27900309-968e-4437-8f39-81f368ea9322 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:44.584462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 748/1487] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:46.847204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050f2b7-1829-4a25-8f32-6ccbdc966939 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:46.848116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050f2b7-1829-4a25-8f32-6ccbdc966939 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:46.848116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050f2b7-1829-4a25-8f32-6ccbdc966939 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:46.850017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 740/1488] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:47:46 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:46.855608 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6c45-fdf8-42e0-be36-3c6e38b9b891 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:46.856134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6c45-fdf8-42e0-be36-3c6e38b9b891 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:46.856134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6c45-fdf8-42e0-be36-3c6e38b9b891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:46.935636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4e5c6c45-fdf8-42e0-be36-3c6e38b9b891 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:46.937198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4e5c6c45-fdf8-42e0-be36-3c6e38b9b891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:46.998207 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:47.053233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 749/1489] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:47.096384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050f2b7-1829-4a25-8f32-6ccbdc966939 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:47.097999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8050f2b7-1829-4a25-8f32-6ccbdc966939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:47.148182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:47.229073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050f2b7-1829-4a25-8f32-6ccbdc966939 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:47.319725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a4706-ec46-4232-ab38-1922b62c2382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:47.320349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a4706-ec46-4232-ab38-1922b62c2382 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:47.320636 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a4706-ec46-4232-ab38-1922b62c2382 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:47.320897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a4706-ec46-4232-ab38-1922b62c2382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:47.322544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a91a4706-ec46-4232-ab38-1922b62c2382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:47.406634 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:47.445273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a4706-ec46-4232-ab38-1922b62c2382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:47.447395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a4706-ec46-4232-ab38-1922b62c2382 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:47.471328 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 741/1490] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:49.767328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886b886-0565-4a73-bf42-6d127ad48945 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:49.767860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886b886-0565-4a73-bf42-6d127ad48945 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:49.767860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886b886-0565-4a73-bf42-6d127ad48945 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:49.769942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 750/1491] 10.222.0.124 () {54 vars in 931 bytes} [Mon Aug 1 16:47:49 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:47:49.777967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454af50-dd89-497b-9449-9acfca77a799 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:49.778444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454af50-dd89-497b-9449-9acfca77a799 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:49.778554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454af50-dd89-497b-9449-9acfca77a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:49.863317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-2454af50-dd89-497b-9449-9acfca77a799 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:47:49.864596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2454af50-dd89-497b-9449-9acfca77a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:49.974299 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 742/1492] 10.222.0.124 () {58 vars in 1028 bytes} [Mon Aug 1 16:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:47:50.017960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886b886-0565-4a73-bf42-6d127ad48945 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:47:50.019523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4886b886-0565-4a73-bf42-6d127ad48945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:50.139991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886b886-0565-4a73-bf42-6d127ad48945 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:47:50.224253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489bd4a-7b29-4079-aad7-f359f90f879b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:47:50.224907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489bd4a-7b29-4079-aad7-f359f90f879b service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:47:50.225186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489bd4a-7b29-4079-aad7-f359f90f879b service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:47:50.225455 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489bd4a-7b29-4079-aad7-f359f90f879b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:47:50.227149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7489bd4a-7b29-4079-aad7-f359f90f879b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:47:50.237358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:50.346569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489bd4a-7b29-4079-aad7-f359f90f879b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:47:50.348611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489bd4a-7b29-4079-aad7-f359f90f879b service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:47:50.367422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 751/1493] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:47:59.972459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=82 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:00.365026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=50 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:22.376928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e10c61-8c55-4eea-ab4e-5029ff6cc3b8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:22.377555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e10c61-8c55-4eea-ab4e-5029ff6cc3b8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:22.377555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e10c61-8c55-4eea-ab4e-5029ff6cc3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:22.480233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-82e10c61-8c55-4eea-ab4e-5029ff6cc3b8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:22.481611 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-82e10c61-8c55-4eea-ab4e-5029ff6cc3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:22.612250 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 743/1494] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:49:22.624680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885a15b-cd7c-40be-803e-a7f0a207b270 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:22.625284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885a15b-cd7c-40be-803e-a7f0a207b270 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:22.625284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885a15b-cd7c-40be-803e-a7f0a207b270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:22.730291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-2885a15b-cd7c-40be-803e-a7f0a207b270 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:22.731679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2885a15b-cd7c-40be-803e-a7f0a207b270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:22.864521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 752/1495] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:49:22.869926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e10c61-8c55-4eea-ab4e-5029ff6cc3b8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:22.871826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-82e10c61-8c55-4eea-ab4e-5029ff6cc3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:22.889197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e10c61-8c55-4eea-ab4e-5029ff6cc3b8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:22.958460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:22.995649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a066e87-1cbf-49e8-b9c5-3d00953c1f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:22.996395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a066e87-1cbf-49e8-b9c5-3d00953c1f8a admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:22.996669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a066e87-1cbf-49e8-b9c5-3d00953c1f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:22.996973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a066e87-1cbf-49e8-b9c5-3d00953c1f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:22.997687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a066e87-1cbf-49e8-b9c5-3d00953c1f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:22.997983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a066e87-1cbf-49e8-b9c5-3d00953c1f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:22.999152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: WARNING py.warnings [None req-4a066e87-1cbf-49e8-b9c5-3d00953c1f8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:49:22.999152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: warnings.warn(msg) Aug 01 16:49:22.999152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: Aug 01 16:49:23.000044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a066e87-1cbf-49e8-b9c5-3d00953c1f8a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:23.013026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 744/1496] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:49:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:23.021701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885a15b-cd7c-40be-803e-a7f0a207b270 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:23.031952 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885a15b-cd7c-40be-803e-a7f0a207b270 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:23.129406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:23.164664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76c6a2-4882-4c05-b81d-18274dda9ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:23.165295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c6a2-4882-4c05-b81d-18274dda9ffe admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:23.165577 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c6a2-4882-4c05-b81d-18274dda9ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:23.165853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c6a2-4882-4c05-b81d-18274dda9ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:23.166521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76c6a2-4882-4c05-b81d-18274dda9ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:23.168615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: WARNING py.warnings [None req-0b76c6a2-4882-4c05-b81d-18274dda9ffe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:49:23.168615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: warnings.warn(msg) Aug 01 16:49:23.168615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: Aug 01 16:49:23.169807 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76c6a2-4882-4c05-b81d-18274dda9ffe admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:23.230355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 753/1497] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:49:23 2022] POST /identity/v3/projects => generated 380 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:23.234994 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a066e87-1cbf-49e8-b9c5-3d00953c1f8a admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:23.236543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4a066e87-1cbf-49e8-b9c5-3d00953c1f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:23.278481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a066e87-1cbf-49e8-b9c5-3d00953c1f8a admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:23.389884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429563e-9e37-46bf-9924-5c8fcd3f09ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:23.390664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429563e-9e37-46bf-9924-5c8fcd3f09ad admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:23.390772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429563e-9e37-46bf-9924-5c8fcd3f09ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:23.391055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429563e-9e37-46bf-9924-5c8fcd3f09ad admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:23.391722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429563e-9e37-46bf-9924-5c8fcd3f09ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:23.392753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: WARNING py.warnings [None req-f429563e-9e37-46bf-9924-5c8fcd3f09ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:49:23.392753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: warnings.warn(msg) Aug 01 16:49:23.392753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: Aug 01 16:49:23.393962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429563e-9e37-46bf-9924-5c8fcd3f09ad admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:23.441273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 745/1498] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:49:23 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:23.446057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76c6a2-4882-4c05-b81d-18274dda9ffe admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:23.448076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0b76c6a2-4882-4c05-b81d-18274dda9ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:23.521623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76c6a2-4882-4c05-b81d-18274dda9ffe admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:23.615548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:23.628163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c99c45-c337-493f-ab3b-7447a32d7f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:23.628931 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c99c45-c337-493f-ab3b-7447a32d7f8f admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:23.629068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c99c45-c337-493f-ab3b-7447a32d7f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:23.629306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c99c45-c337-493f-ab3b-7447a32d7f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:23.630009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c99c45-c337-493f-ab3b-7447a32d7f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:23.631060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: WARNING py.warnings [None req-f3c99c45-c337-493f-ab3b-7447a32d7f8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:49:23.631060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: warnings.warn(msg) Aug 01 16:49:23.631060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: Aug 01 16:49:23.631996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c99c45-c337-493f-ab3b-7447a32d7f8f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:23.645649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 754/1499] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:49:23 2022] GET /identity/v3/roles => generated 1427 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:49:23.651771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429563e-9e37-46bf-9924-5c8fcd3f09ad admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:23.653323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f429563e-9e37-46bf-9924-5c8fcd3f09ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:23.665190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429563e-9e37-46bf-9924-5c8fcd3f09ad admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:23.694993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:23.782408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0c3a8-1556-49ee-8bf6-f3621791b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:23.783152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0c3a8-1556-49ee-8bf6-f3621791b0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:23.783561 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0c3a8-1556-49ee-8bf6-f3621791b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:23.783876 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0c3a8-1556-49ee-8bf6-f3621791b0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:23.784711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0c3a8-1556-49ee-8bf6-f3621791b0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:23.785845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: WARNING py.warnings [None req-b5c0c3a8-1556-49ee-8bf6-f3621791b0e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:49:23.785845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: warnings.warn(msg) Aug 01 16:49:23.785845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: Aug 01 16:49:23.786825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0c3a8-1556-49ee-8bf6-f3621791b0e4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:23.801148 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 746/1500] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:49:23 2022] GET /identity/v3/roles => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:49:23.808067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c99c45-c337-493f-ab3b-7447a32d7f8f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:23.809659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f3c99c45-c337-493f-ab3b-7447a32d7f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:23.852562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c99c45-c337-493f-ab3b-7447a32d7f8f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:23.953853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e985b94-51f6-4f19-8da9-910d1f20b6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:23.954437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e985b94-51f6-4f19-8da9-910d1f20b6a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:23.954719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e985b94-51f6-4f19-8da9-910d1f20b6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:23.954998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e985b94-51f6-4f19-8da9-910d1f20b6a1 admin admin] PATH_INFO: `/v3/projects/2f46d7c806b449e7b8ad6334e2ed7601/users/fa30ecc0b9a64c7c9e2d58c7585d44f0/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:23.985084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e985b94-51f6-4f19-8da9-910d1f20b6a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f46d7c806b449e7b8ad6334e2ed7601, user_id=fa30ecc0b9a64c7c9e2d58c7585d44f0, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:23.986310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: WARNING py.warnings [None req-5e985b94-51f6-4f19-8da9-910d1f20b6a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:49:23.986310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: warnings.warn(msg) Aug 01 16:49:23.986310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: Aug 01 16:49:23.988638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e985b94-51f6-4f19-8da9-910d1f20b6a1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:24.024644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 755/1501] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:49:23 2022] PUT /identity/v3/projects/2f46d7c806b449e7b8ad6334e2ed7601/users/fa30ecc0b9a64c7c9e2d58c7585d44f0/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:24.038758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379946ff-787c-4510-b069-5646717cdc93 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.039180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379946ff-787c-4510-b069-5646717cdc93 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.039645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379946ff-787c-4510-b069-5646717cdc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.116005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-379946ff-787c-4510-b069-5646717cdc93 None None] MFA Rules not processed for user `fa30ecc0b9a64c7c9e2d58c7585d44f0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:24.117260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-379946ff-787c-4510-b069-5646717cdc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:24.202148 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 747/1502] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:49:24.221580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91843b4-8a36-470b-a9e6-97b1920ca73e None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.221954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91843b4-8a36-470b-a9e6-97b1920ca73e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.222468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91843b4-8a36-470b-a9e6-97b1920ca73e None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.224908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 756/1503] 10.222.0.124 () {54 vars in 969 bytes} [Mon Aug 1 16:49:24 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:24.230626 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64478-229b-4d2e-bf70-9cc92e7409cd None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.230963 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64478-229b-4d2e-bf70-9cc92e7409cd None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.231248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64478-229b-4d2e-bf70-9cc92e7409cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.265502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:24.315280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-4ae64478-229b-4d2e-bf70-9cc92e7409cd None None] MFA Rules not processed for user `8d0c157c2bd44a0089f5efb058be372b`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:24.316819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4ae64478-229b-4d2e-bf70-9cc92e7409cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:24.408638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 748/1504] 10.222.0.124 () {58 vars in 1066 bytes} [Mon Aug 1 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:49:24.416740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91843b4-8a36-470b-a9e6-97b1920ca73e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:24.418610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d91843b4-8a36-470b-a9e6-97b1920ca73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:24.477902 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:24.540310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91843b4-8a36-470b-a9e6-97b1920ca73e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:24.637021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531bd6-10a7-495f-abbb-51a96637d748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:24.637780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531bd6-10a7-495f-abbb-51a96637d748 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.637881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531bd6-10a7-495f-abbb-51a96637d748 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.638166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531bd6-10a7-495f-abbb-51a96637d748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.639855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9e531bd6-10a7-495f-abbb-51a96637d748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:24.758359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e531bd6-10a7-495f-abbb-51a96637d748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:24.759846 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e531bd6-10a7-495f-abbb-51a96637d748 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:24.763796 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:24.780809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 757/1505] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:49:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:49:24.842741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaffd71-9023-41ef-a2a2-33ca85f2b447 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.843004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaffd71-9023-41ef-a2a2-33ca85f2b447 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.843310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaffd71-9023-41ef-a2a2-33ca85f2b447 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.844615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 749/1506] 10.222.0.124 () {52 vars in 835 bytes} [Mon Aug 1 16:49:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:24.848367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531bd6-10a7-495f-abbb-51a96637d748 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:24.849658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9e531bd6-10a7-495f-abbb-51a96637d748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:24.962925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531bd6-10a7-495f-abbb-51a96637d748 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:25.067757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:25.068317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.068583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.068859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] PATH_INFO: `/v3/users/fa30ecc0b9a64c7c9e2d58c7585d44f0` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.083759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa30ecc0b9a64c7c9e2d58c7585d44f0)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:25.084815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: WARNING py.warnings [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:49:25.084815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: warnings.warn(msg) Aug 01 16:49:25.084815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: Aug 01 16:49:25.086111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:25.098243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:25.158402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa30ecc0b9a64c7c9e2d58c7585d44f0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:49:25.170274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa30ecc0b9a64c7c9e2d58c7585d44f0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:49:25.186571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa30ecc0b9a64c7c9e2d58c7585d44f0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:49:25.187203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa30ecc0b9a64c7c9e2d58c7585d44f0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:49:25.187827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa30ecc0b9a64c7c9e2d58c7585d44f0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:49:25.219433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 758/1507] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:49:24 2022] DELETE /identity/v3/users/fa30ecc0b9a64c7c9e2d58c7585d44f0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:25.224023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd02079-2122-4d1b-82ae-42e9b427b533 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.224326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd02079-2122-4d1b-82ae-42e9b427b533 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.224602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd02079-2122-4d1b-82ae-42e9b427b533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.292484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-4dd02079-2122-4d1b-82ae-42e9b427b533 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:25.293736 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4dd02079-2122-4d1b-82ae-42e9b427b533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:25.392200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:25.407388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 750/1508] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:49:25.421209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:25.423164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:25.538819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a833f-94fb-4d0f-b27c-2a40f0b76de0 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:25.601688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:25.624108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6dd8c-8212-4400-9349-62f3d7023dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:25.624799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6dd8c-8212-4400-9349-62f3d7023dcc service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.625122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6dd8c-8212-4400-9349-62f3d7023dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.625436 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6dd8c-8212-4400-9349-62f3d7023dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.627183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-69a6dd8c-8212-4400-9349-62f3d7023dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:25.753021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6dd8c-8212-4400-9349-62f3d7023dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:25.754486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6dd8c-8212-4400-9349-62f3d7023dcc service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:25.779885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 759/1509] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:49:26.246390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd02079-2122-4d1b-82ae-42e9b427b533 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:26.247718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4dd02079-2122-4d1b-82ae-42e9b427b533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:26.259761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd02079-2122-4d1b-82ae-42e9b427b533 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:26.369452 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:26.370181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:26.370434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:26.370743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] PATH_INFO: `/v3/projects/2f46d7c806b449e7b8ad6334e2ed7601` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:26.387934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f46d7c806b449e7b8ad6334e2ed7601)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:26.389037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: WARNING py.warnings [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:49:26.389037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: warnings.warn(msg) Aug 01 16:49:26.389037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: Aug 01 16:49:26.390258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:26.462188 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f46d7c806b449e7b8ad6334e2ed7601', 'request_id': 'req-cba02121-8a74-4d61-bd70-ab27b7eeb24e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:49:26.478528 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f46d7c806b449e7b8ad6334e2ed7601', 'request_id': 'req-cba02121-8a74-4d61-bd70-ab27b7eeb24e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:49:26.486889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f46d7c806b449e7b8ad6334e2ed7601', 'request_id': 'req-cba02121-8a74-4d61-bd70-ab27b7eeb24e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:49:26.524393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] The token cache is being invalidate because project 2f46d7c806b449e7b8ad6334e2ed7601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:49:26.524678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:49:26.525208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-cba02121-8a74-4d61-bd70-ab27b7eeb24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:49:26.527041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 751/1510] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:49:26 2022] DELETE /identity/v3/projects/2f46d7c806b449e7b8ad6334e2ed7601 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:35.777120 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=62 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:36.522038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:16.166523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cbeeb-43f9-4c04-8301-5542ab8b9f39 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:16.167603 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cbeeb-43f9-4c04-8301-5542ab8b9f39 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:16.167884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cbeeb-43f9-4c04-8301-5542ab8b9f39 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:16.170385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:51:16 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:16.175832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7824c1-b9f2-4131-9177-f5ab2a920860 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:16.176389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7824c1-b9f2-4131-9177-f5ab2a920860 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:16.176389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7824c1-b9f2-4131-9177-f5ab2a920860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:16.266802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ca7824c1-b9f2-4131-9177-f5ab2a920860 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:16.268050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ca7824c1-b9f2-4131-9177-f5ab2a920860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:16.389292 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:51:16.567328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cbeeb-43f9-4c04-8301-5542ab8b9f39 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:16.570810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1d0cbeeb-43f9-4c04-8301-5542ab8b9f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:16.705475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cbeeb-43f9-4c04-8301-5542ab8b9f39 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:16.711426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa59d3-f626-47c3-972d-02e937541db9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:16.712094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa59d3-f626-47c3-972d-02e937541db9 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:16.712377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa59d3-f626-47c3-972d-02e937541db9 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:16.712656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa59d3-f626-47c3-972d-02e937541db9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:16.721416 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa59d3-f626-47c3-972d-02e937541db9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:16.723056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa59d3-f626-47c3-972d-02e937541db9 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:16.733851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 761/1513] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:51:17.573948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a80b71-1a38-4e9d-a75b-b945d7932c3d None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.574558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a80b71-1a38-4e9d-a75b-b945d7932c3d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.574558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a80b71-1a38-4e9d-a75b-b945d7932c3d None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.575920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:51:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:17.581836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be35c7-b449-4048-acb4-1350550deed7 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.582275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be35c7-b449-4048-acb4-1350550deed7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.582423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be35c7-b449-4048-acb4-1350550deed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.612810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-10be35c7-b449-4048-acb4-1350550deed7 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:17.614028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-10be35c7-b449-4048-acb4-1350550deed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:17.623631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:51:17.779263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a80b71-1a38-4e9d-a75b-b945d7932c3d None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:17.805113 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a80b71-1a38-4e9d-a75b-b945d7932c3d None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:17.813024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925d768-b009-4a51-93ac-511d8ab0e196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:17.813665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d768-b009-4a51-93ac-511d8ab0e196 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.813947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d768-b009-4a51-93ac-511d8ab0e196 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.814219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d768-b009-4a51-93ac-511d8ab0e196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.824676 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925d768-b009-4a51-93ac-511d8ab0e196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:17.826306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925d768-b009-4a51-93ac-511d8ab0e196 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:17.837439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 754/1516] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:51:18.423586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20825fb7-96d9-416e-b187-a2bf19b53888 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:18.423847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20825fb7-96d9-416e-b187-a2bf19b53888 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:18.424018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20825fb7-96d9-416e-b187-a2bf19b53888 None None] PATH_INFO: `/v3` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:18.425398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 763/1517] 10.222.0.134 () {54 vars in 930 bytes} [Mon Aug 1 16:51:18 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:18.433606 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f2bfe-d593-47c9-9ac0-14f022dcc613 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:18.433869 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f2bfe-d593-47c9-9ac0-14f022dcc613 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:18.434148 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f2bfe-d593-47c9-9ac0-14f022dcc613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:18.507112 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a93f2bfe-d593-47c9-9ac0-14f022dcc613 None None] MFA Rules not processed for user `6deeea314be545609b0fe4dd786b3b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:18.508390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a93f2bfe-d593-47c9-9ac0-14f022dcc613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:18.528355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:18.599883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 755/1518] 10.222.0.134 () {58 vars in 1020 bytes} [Mon Aug 1 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:51:27.606938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=56 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:28.311610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba147-5d65-4b4b-813c-1e3ef44c2a1d None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:28.311971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba147-5d65-4b4b-813c-1e3ef44c2a1d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:28.312260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba147-5d65-4b4b-813c-1e3ef44c2a1d None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:28.313647 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 764/1519] 10.222.0.124 () {54 vars in 966 bytes} [Mon Aug 1 16:51:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:51:28.319599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b910ee-b974-44f0-8bc0-9cea037b8409 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:28.320149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b910ee-b974-44f0-8bc0-9cea037b8409 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:28.320149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b910ee-b974-44f0-8bc0-9cea037b8409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:28.341298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a9b910ee-b974-44f0-8bc0-9cea037b8409 None None] MFA Rules not processed for user `6deeea314be545609b0fe4dd786b3b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:28.342544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a9b910ee-b974-44f0-8bc0-9cea037b8409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:28.352365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 756/1520] 10.222.0.124 () {58 vars in 1063 bytes} [Mon Aug 1 16:51:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:51:28.360864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba147-5d65-4b4b-813c-1e3ef44c2a1d None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:28.379233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba147-5d65-4b4b-813c-1e3ef44c2a1d None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:28.389266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f73f4-a3fe-46d0-998e-8e23ad526b89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:28.390342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f73f4-a3fe-46d0-998e-8e23ad526b89 service placement] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:28.390835 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f73f4-a3fe-46d0-998e-8e23ad526b89 service placement] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:28.391248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f73f4-a3fe-46d0-998e-8e23ad526b89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:28.400958 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f73f4-a3fe-46d0-998e-8e23ad526b89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:28.402563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f73f4-a3fe-46d0-998e-8e23ad526b89 service placement] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:28.412873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 765/1521] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:51:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:51:29.124702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca6945-eeb1-4457-8dea-6864916bd62d None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:29.124702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca6945-eeb1-4457-8dea-6864916bd62d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:29.124702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca6945-eeb1-4457-8dea-6864916bd62d None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:29.126102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:51:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:29.131231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7974-b2f8-4759-9644-92e090226713 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:29.131776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7974-b2f8-4759-9644-92e090226713 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:29.131776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7974-b2f8-4759-9644-92e090226713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:29.152685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-d67d7974-b2f8-4759-9644-92e090226713 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:29.154012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d67d7974-b2f8-4759-9644-92e090226713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:29.163060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:51:29.329657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca6945-eeb1-4457-8dea-6864916bd62d None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:29.347170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca6945-eeb1-4457-8dea-6864916bd62d None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:29.353245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91c1cc-af38-450e-968b-ca0b5e32d530 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:29.354281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91c1cc-af38-450e-968b-ca0b5e32d530 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:29.354561 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91c1cc-af38-450e-968b-ca0b5e32d530 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:29.354828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91c1cc-af38-450e-968b-ca0b5e32d530 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:29.364782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91c1cc-af38-450e-968b-ca0b5e32d530 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:29.366386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91c1cc-af38-450e-968b-ca0b5e32d530 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:29.376806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 758/1524] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:51:30.198767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9976fc-8f30-4f94-a28c-8bc17350e360 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:30.199482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9976fc-8f30-4f94-a28c-8bc17350e360 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:30.199482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9976fc-8f30-4f94-a28c-8bc17350e360 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:30.200719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:51:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:30.207481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bee19-e5c2-410d-b7ac-84b2769f5f67 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:30.207891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bee19-e5c2-410d-b7ac-84b2769f5f67 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:30.208325 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bee19-e5c2-410d-b7ac-84b2769f5f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:30.239426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-de1bee19-e5c2-410d-b7ac-84b2769f5f67 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:30.240676 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-de1bee19-e5c2-410d-b7ac-84b2769f5f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:30.250506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:51:30.411311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9976fc-8f30-4f94-a28c-8bc17350e360 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:30.431099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9976fc-8f30-4f94-a28c-8bc17350e360 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:30.437996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8632a-c7d2-4635-8816-5a5882cc692c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:30.438620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8632a-c7d2-4635-8816-5a5882cc692c service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:30.438898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8632a-c7d2-4635-8816-5a5882cc692c service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:30.439220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8632a-c7d2-4635-8816-5a5882cc692c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:30.448340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8632a-c7d2-4635-8816-5a5882cc692c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:30.449953 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8632a-c7d2-4635-8816-5a5882cc692c service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:30.461698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 768/1527] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:51:34.486344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3335df0-3819-4199-afe0-9b38cadaa4e3 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:34.486901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3335df0-3819-4199-afe0-9b38cadaa4e3 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:34.486901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3335df0-3819-4199-afe0-9b38cadaa4e3 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:34.488222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:51:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:34.494541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5ff44-2634-412b-a289-4a5068ebf66b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:34.495266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5ff44-2634-412b-a289-4a5068ebf66b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:34.495443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5ff44-2634-412b-a289-4a5068ebf66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:34.520333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a0d5ff44-2634-412b-a289-4a5068ebf66b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:34.521570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a0d5ff44-2634-412b-a289-4a5068ebf66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:34.530244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:51:34.609331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3335df0-3819-4199-afe0-9b38cadaa4e3 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:34.611340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b3335df0-3819-4199-afe0-9b38cadaa4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:34.713523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3335df0-3819-4199-afe0-9b38cadaa4e3 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:34.717820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc93674-ee37-43aa-8613-905d9282b371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:34.718440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc93674-ee37-43aa-8613-905d9282b371 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:34.718717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc93674-ee37-43aa-8613-905d9282b371 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:34.718989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc93674-ee37-43aa-8613-905d9282b371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:34.732994 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc93674-ee37-43aa-8613-905d9282b371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:34.734793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc93674-ee37-43aa-8613-905d9282b371 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:34.744761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 761/1530] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:51:36.798862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4c24e-4ba3-4074-bc39-6c02092145b8 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:36.799730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4c24e-4ba3-4074-bc39-6c02092145b8 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:36.799730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4c24e-4ba3-4074-bc39-6c02092145b8 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:36.802083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:51:36 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:36.807451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154fe8-63fc-496b-a781-16a9ac32aa52 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:36.807912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154fe8-63fc-496b-a781-16a9ac32aa52 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:36.808027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154fe8-63fc-496b-a781-16a9ac32aa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:36.830074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-78154fe8-63fc-496b-a781-16a9ac32aa52 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:36.831334 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-78154fe8-63fc-496b-a781-16a9ac32aa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:36.840098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:51:36.885174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4c24e-4ba3-4074-bc39-6c02092145b8 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:36.899657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4c24e-4ba3-4074-bc39-6c02092145b8 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:36.904098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aef51d-3c71-4ca7-bf02-7e6583d2c903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:36.904723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aef51d-3c71-4ca7-bf02-7e6583d2c903 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:36.905088 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aef51d-3c71-4ca7-bf02-7e6583d2c903 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:36.905496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aef51d-3c71-4ca7-bf02-7e6583d2c903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:36.916701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aef51d-3c71-4ca7-bf02-7e6583d2c903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:36.918157 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aef51d-3c71-4ca7-bf02-7e6583d2c903 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:36.931011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 771/1533] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:51:40.688755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac5f1-337a-46fb-bcfe-d986583cc597 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:40.689436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac5f1-337a-46fb-bcfe-d986583cc597 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:40.689436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac5f1-337a-46fb-bcfe-d986583cc597 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:40.690705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:51:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:40.698029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8d6a-b40f-461b-ad2d-62709f10c788 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:40.698788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8d6a-b40f-461b-ad2d-62709f10c788 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:40.698937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8d6a-b40f-461b-ad2d-62709f10c788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:40.721947 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-bf6a8d6a-b40f-461b-ad2d-62709f10c788 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:40.723246 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-bf6a8d6a-b40f-461b-ad2d-62709f10c788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:40.732965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:51:41.043347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac5f1-337a-46fb-bcfe-d986583cc597 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:41.046784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cf2ac5f1-337a-46fb-bcfe-d986583cc597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:41.133794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:41.148750 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac5f1-337a-46fb-bcfe-d986583cc597 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:41.152811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68810029-90d5-44c8-a305-288fc2fae465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:41.153414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810029-90d5-44c8-a305-288fc2fae465 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:41.153689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810029-90d5-44c8-a305-288fc2fae465 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:41.153959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810029-90d5-44c8-a305-288fc2fae465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:41.163916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68810029-90d5-44c8-a305-288fc2fae465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:41.165355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68810029-90d5-44c8-a305-288fc2fae465 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:41.177142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 764/1536] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:51:43.232532 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9b644-eb3d-45c0-b63b-fa7eac7ad192 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:43.233443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9b644-eb3d-45c0-b63b-fa7eac7ad192 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:43.233443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9b644-eb3d-45c0-b63b-fa7eac7ad192 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:43.235514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:51:43 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:43.244504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e443-ca2e-49cf-9974-a714407ef46a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:43.244979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e443-ca2e-49cf-9974-a714407ef46a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:43.245079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e443-ca2e-49cf-9974-a714407ef46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:43.267943 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6518e443-ca2e-49cf-9974-a714407ef46a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:43.269195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6518e443-ca2e-49cf-9974-a714407ef46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:43.278803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:51:43.591295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9b644-eb3d-45c0-b63b-fa7eac7ad192 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:43.594693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d2b9b644-eb3d-45c0-b63b-fa7eac7ad192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:43.615280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9b644-eb3d-45c0-b63b-fa7eac7ad192 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:43.619979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300f554-dd43-4f86-a5c0-24229a18c700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:43.620603 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f554-dd43-4f86-a5c0-24229a18c700 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:43.620878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f554-dd43-4f86-a5c0-24229a18c700 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:43.621148 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f554-dd43-4f86-a5c0-24229a18c700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:43.631718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f554-dd43-4f86-a5c0-24229a18c700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:43.633073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f554-dd43-4f86-a5c0-24229a18c700 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:43.643773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 774/1539] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:51:53.262700 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=11 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:53.638915 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=33 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:26.385738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959a950-8721-400d-9ea9-e5ef1067c6ae None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.388044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959a950-8721-400d-9ea9-e5ef1067c6ae None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.388335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959a950-8721-400d-9ea9-e5ef1067c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.414749 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6959a950-8721-400d-9ea9-e5ef1067c6ae None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:26.416436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6959a950-8721-400d-9ea9-e5ef1067c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:26.431234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 766/1540] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:26.441021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704caf-64b0-4700-9507-105c7262ab98 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.442071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704caf-64b0-4700-9507-105c7262ab98 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.442586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704caf-64b0-4700-9507-105c7262ab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.476689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-f0704caf-64b0-4700-9507-105c7262ab98 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:26.478360 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f0704caf-64b0-4700-9507-105c7262ab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:26.487945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 775/1541] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:26.493160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959a950-8721-400d-9ea9-e5ef1067c6ae None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:26.513772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959a950-8721-400d-9ea9-e5ef1067c6ae None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:26.523898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc393c3-b366-422e-b74a-d56c4e982364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:26.524560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc393c3-b366-422e-b74a-d56c4e982364 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.524841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc393c3-b366-422e-b74a-d56c4e982364 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.525114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc393c3-b366-422e-b74a-d56c4e982364 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.525843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc393c3-b366-422e-b74a-d56c4e982364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:26.526422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc393c3-b366-422e-b74a-d56c4e982364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:26.528152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc393c3-b366-422e-b74a-d56c4e982364 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:26.547064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 767/1542] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:53:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:26.555292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0704caf-64b0-4700-9507-105c7262ab98 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:26.568628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0704caf-64b0-4700-9507-105c7262ab98 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:26.577969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7576ebc-a78f-4414-84b3-3fbdb3a92f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:26.578626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7576ebc-a78f-4414-84b3-3fbdb3a92f9f admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.578908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7576ebc-a78f-4414-84b3-3fbdb3a92f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.579210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7576ebc-a78f-4414-84b3-3fbdb3a92f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.580170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7576ebc-a78f-4414-84b3-3fbdb3a92f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:26.582108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7576ebc-a78f-4414-84b3-3fbdb3a92f9f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:26.639681 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 776/1543] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:26 2022] POST /identity/v3/projects => generated 388 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:26.644165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc393c3-b366-422e-b74a-d56c4e982364 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:26.656146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc393c3-b366-422e-b74a-d56c4e982364 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:26.733281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d7f15-bc38-4d43-b02c-cba9d70eeee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:26.733942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d7f15-bc38-4d43-b02c-cba9d70eeee9 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.734223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d7f15-bc38-4d43-b02c-cba9d70eeee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.734499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d7f15-bc38-4d43-b02c-cba9d70eeee9 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.735225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d7f15-bc38-4d43-b02c-cba9d70eeee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:26.737188 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d7f15-bc38-4d43-b02c-cba9d70eeee9 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:26.769870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 768/1544] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:26 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:53:26.774252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7576ebc-a78f-4414-84b3-3fbdb3a92f9f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:26.786280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7576ebc-a78f-4414-84b3-3fbdb3a92f9f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:26.795530 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5cb31-d27b-471b-9642-7f2d12027509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:26.796191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5cb31-d27b-471b-9642-7f2d12027509 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.796475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5cb31-d27b-471b-9642-7f2d12027509 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.796748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5cb31-d27b-471b-9642-7f2d12027509 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.797467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5cb31-d27b-471b-9642-7f2d12027509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:26.799141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5cb31-d27b-471b-9642-7f2d12027509 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:26.814153 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 777/1545] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:26 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:26.818304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d7f15-bc38-4d43-b02c-cba9d70eeee9 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:26.832526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d7f15-bc38-4d43-b02c-cba9d70eeee9 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:26.839221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959bcd7-6cdf-4a2d-8de7-8273343147d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:26.839873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959bcd7-6cdf-4a2d-8de7-8273343147d6 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.840156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959bcd7-6cdf-4a2d-8de7-8273343147d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.840431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959bcd7-6cdf-4a2d-8de7-8273343147d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.841204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959bcd7-6cdf-4a2d-8de7-8273343147d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:26.842895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959bcd7-6cdf-4a2d-8de7-8273343147d6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:26.858329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 769/1546] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:26 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:26.862644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5cb31-d27b-471b-9642-7f2d12027509 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:26.876994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5cb31-d27b-471b-9642-7f2d12027509 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:26.883718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94f96c-c82a-4e36-a45b-c1fd90cc00d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:26.884542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94f96c-c82a-4e36-a45b-c1fd90cc00d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.884828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94f96c-c82a-4e36-a45b-c1fd90cc00d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.885107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94f96c-c82a-4e36-a45b-c1fd90cc00d3 admin admin] PATH_INFO: `/v3/projects/bb8be263b24942b79a5144739412c870/users/36ab34b69abc4a8dbe7bb0a40ad768b9/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.904784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94f96c-c82a-4e36-a45b-c1fd90cc00d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8be263b24942b79a5144739412c870, user_id=36ab34b69abc4a8dbe7bb0a40ad768b9, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:26.907672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94f96c-c82a-4e36-a45b-c1fd90cc00d3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:26.942986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 778/1547] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:26 2022] PUT /identity/v3/projects/bb8be263b24942b79a5144739412c870/users/36ab34b69abc4a8dbe7bb0a40ad768b9/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:53:26.946988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ed21-5d4b-457c-83c5-f3d91936b7be None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.946988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ed21-5d4b-457c-83c5-f3d91936b7be None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.946988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ed21-5d4b-457c-83c5-f3d91936b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.976969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6b68ed21-5d4b-457c-83c5-f3d91936b7be None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:26.978500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6b68ed21-5d4b-457c-83c5-f3d91936b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:27.072264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 770/1548] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:27.088170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94f96c-c82a-4e36-a45b-c1fd90cc00d3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:27.156263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94f96c-c82a-4e36-a45b-c1fd90cc00d3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:27.161140 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9d12a-44ad-46e4-94ae-aa8f2cff1061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:27.161810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9d12a-44ad-46e4-94ae-aa8f2cff1061 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.162091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9d12a-44ad-46e4-94ae-aa8f2cff1061 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.162523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9d12a-44ad-46e4-94ae-aa8f2cff1061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.177008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9d12a-44ad-46e4-94ae-aa8f2cff1061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:27.178505 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9d12a-44ad-46e4-94ae-aa8f2cff1061 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:27.192469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 779/1549] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:27.428740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d92b1-e2ba-48e4-8df5-9f005ea04d4f None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.429396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d92b1-e2ba-48e4-8df5-9f005ea04d4f None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.429396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d92b1-e2ba-48e4-8df5-9f005ea04d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.472181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-233d92b1-e2ba-48e4-8df5-9f005ea04d4f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:27.473763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-233d92b1-e2ba-48e4-8df5-9f005ea04d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:27.507363 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 771/1550] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:27.517003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df125b4e-a9ad-4138-a41c-8e6b7bfaa67f None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.517585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df125b4e-a9ad-4138-a41c-8e6b7bfaa67f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.517585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df125b4e-a9ad-4138-a41c-8e6b7bfaa67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.575089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-df125b4e-a9ad-4138-a41c-8e6b7bfaa67f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:27.576364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-df125b4e-a9ad-4138-a41c-8e6b7bfaa67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:27.625692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 780/1551] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:27.632566 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d92b1-e2ba-48e4-8df5-9f005ea04d4f None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:27.653942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d92b1-e2ba-48e4-8df5-9f005ea04d4f None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:27.665810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b7b87-1847-48d7-904f-2e88de46653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:27.666633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b7b87-1847-48d7-904f-2e88de46653b admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.666930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b7b87-1847-48d7-904f-2e88de46653b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.667225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b7b87-1847-48d7-904f-2e88de46653b admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.668002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b7b87-1847-48d7-904f-2e88de46653b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:27.668308 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b7b87-1847-48d7-904f-2e88de46653b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:27.669995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b7b87-1847-48d7-904f-2e88de46653b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:27.693215 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 772/1552] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:53:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:27.701471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df125b4e-a9ad-4138-a41c-8e6b7bfaa67f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:27.712894 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c757a-d3a0-49d3-8f56-5797a8187213 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.713265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c757a-d3a0-49d3-8f56-5797a8187213 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.713451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c757a-d3a0-49d3-8f56-5797a8187213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.720326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df125b4e-a9ad-4138-a41c-8e6b7bfaa67f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:27.735471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390361-0ff5-4dfe-ad15-7919f25c04b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:27.736129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390361-0ff5-4dfe-ad15-7919f25c04b1 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.736413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390361-0ff5-4dfe-ad15-7919f25c04b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.736691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390361-0ff5-4dfe-ad15-7919f25c04b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.737357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd390361-0ff5-4dfe-ad15-7919f25c04b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:27.746050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd390361-0ff5-4dfe-ad15-7919f25c04b1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:27.773369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e89c757a-d3a0-49d3-8f56-5797a8187213 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:27.773921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e89c757a-d3a0-49d3-8f56-5797a8187213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:27.795883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 773/1553] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:53:27.819554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bfac4-aba6-4bf4-a598-316fa6ccb924 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.819819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bfac4-aba6-4bf4-a598-316fa6ccb924 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.820113 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bfac4-aba6-4bf4-a598-316fa6ccb924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.854663 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 781/1554] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:27 2022] POST /identity/v3/projects => generated 358 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:27.858611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390361-0ff5-4dfe-ad15-7919f25c04b1 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:27.877441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-880bfac4-aba6-4bf4-a598-316fa6ccb924 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:27.878741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-880bfac4-aba6-4bf4-a598-316fa6ccb924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:27.961432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:28.026938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390361-0ff5-4dfe-ad15-7919f25c04b1 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.032800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddb619-4e2c-401d-b8ef-1c941d21b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.033786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddb619-4e2c-401d-b8ef-1c941d21b50b admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.034087 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddb619-4e2c-401d-b8ef-1c941d21b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.034656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 774/1555] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:28.035352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddb619-4e2c-401d-b8ef-1c941d21b50b admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.036229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd8c15-cf43-4fae-899c-0ff2be051e68 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.036368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddb619-4e2c-401d-b8ef-1c941d21b50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.036451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd8c15-cf43-4fae-899c-0ff2be051e68 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.036644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd8c15-cf43-4fae-899c-0ff2be051e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.037229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: WARNING py.warnings [None req-28ddb619-4e2c-401d-b8ef-1c941d21b50b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:53:28.037229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: warnings.warn(msg) Aug 01 16:53:28.037229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: Aug 01 16:53:28.038452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddb619-4e2c-401d-b8ef-1c941d21b50b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.049547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:28.069144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 782/1556] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:27 2022] POST /identity/v3/users => generated 280 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:28.071554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4eaf4-ef57-42a3-9169-086f5b9d4982 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.071942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4eaf4-ef57-42a3-9169-086f5b9d4982 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.072226 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4eaf4-ef57-42a3-9169-086f5b9d4982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.075445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-8cfd8c15-cf43-4fae-899c-0ff2be051e68 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:28.077383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8cfd8c15-cf43-4fae-899c-0ff2be051e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:28.091090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 775/1557] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:28.091090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d69e7-3acd-4ca5-90a5-a319b6105f70 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.091090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d69e7-3acd-4ca5-90a5-a319b6105f70 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.091090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d69e7-3acd-4ca5-90a5-a319b6105f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.098722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ceb4eaf4-ef57-42a3-9169-086f5b9d4982 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:28.100962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ceb4eaf4-ef57-42a3-9169-086f5b9d4982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:28.113160 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 783/1558] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:28.121692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb50e9-cd00-4bb2-9cbb-95e680443f57 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.121692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb50e9-cd00-4bb2-9cbb-95e680443f57 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.121692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb50e9-cd00-4bb2-9cbb-95e680443f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.129066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b17d69e7-3acd-4ca5-90a5-a319b6105f70 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:28.130632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b17d69e7-3acd-4ca5-90a5-a319b6105f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:28.138465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-3adb50e9-cd00-4bb2-9cbb-95e680443f57 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:28.139736 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3adb50e9-cd00-4bb2-9cbb-95e680443f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:28.140585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 776/1559] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:28.141814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e0e7d-0746-4f1e-9dd8-9f0c95fa5443 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.142154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e0e7d-0746-4f1e-9dd8-9f0c95fa5443 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.142383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e0e7d-0746-4f1e-9dd8-9f0c95fa5443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.163938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 784/1560] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:28.163938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb50e9-cd00-4bb2-9cbb-95e680443f57 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.164441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-9b7e0e7d-0746-4f1e-9dd8-9f0c95fa5443 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:28.165698 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9b7e0e7d-0746-4f1e-9dd8-9f0c95fa5443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:28.172445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb50e9-cd00-4bb2-9cbb-95e680443f57 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.179014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 777/1561] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:28.179014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e0e7d-0746-4f1e-9dd8-9f0c95fa5443 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.185857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177337b-afd2-4697-b6e7-fb2a61369dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.186713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e0e7d-0746-4f1e-9dd8-9f0c95fa5443 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.187159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177337b-afd2-4697-b6e7-fb2a61369dfa admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.187733 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177337b-afd2-4697-b6e7-fb2a61369dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.188229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177337b-afd2-4697-b6e7-fb2a61369dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.189337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177337b-afd2-4697-b6e7-fb2a61369dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:28.189841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177337b-afd2-4697-b6e7-fb2a61369dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.191632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: WARNING py.warnings [None req-a177337b-afd2-4697-b6e7-fb2a61369dfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:53:28.191632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: warnings.warn(msg) Aug 01 16:53:28.191632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: Aug 01 16:53:28.191895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71960e9-0a40-4f92-afae-3c7a9c074116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.192383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71960e9-0a40-4f92-afae-3c7a9c074116 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.192664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71960e9-0a40-4f92-afae-3c7a9c074116 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.192937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71960e9-0a40-4f92-afae-3c7a9c074116 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.193650 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71960e9-0a40-4f92-afae-3c7a9c074116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.193838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177337b-afd2-4697-b6e7-fb2a61369dfa admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.195371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71960e9-0a40-4f92-afae-3c7a9c074116 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.208051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 785/1562] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:28.208858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 778/1563] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:28 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:28.211160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4daa7-a854-4ba6-afa8-c1047bcc0d2e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.211614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4daa7-a854-4ba6-afa8-c1047bcc0d2e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.212136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4daa7-a854-4ba6-afa8-c1047bcc0d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.213264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ac63a-6569-457d-bb85-eb5b617fe4d7 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.213558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ac63a-6569-457d-bb85-eb5b617fe4d7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.213842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ac63a-6569-457d-bb85-eb5b617fe4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.235659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-f97ac63a-6569-457d-bb85-eb5b617fe4d7 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:28.236953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-95b4daa7-a854-4ba6-afa8-c1047bcc0d2e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:28.237744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f97ac63a-6569-457d-bb85-eb5b617fe4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:28.238143 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-95b4daa7-a854-4ba6-afa8-c1047bcc0d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:28.250434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 779/1564] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:28.250434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef52182-8933-4342-ac74-d47e3d723c38 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.250434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef52182-8933-4342-ac74-d47e3d723c38 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.250434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef52182-8933-4342-ac74-d47e3d723c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.251897 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 786/1565] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:28.253720 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076492c4-4451-4089-b0c1-30da1091619c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.254219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076492c4-4451-4089-b0c1-30da1091619c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.254576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076492c4-4451-4089-b0c1-30da1091619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.269972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-eef52182-8933-4342-ac74-d47e3d723c38 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:28.271218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-eef52182-8933-4342-ac74-d47e3d723c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:28.278920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-076492c4-4451-4089-b0c1-30da1091619c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:28.280315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 780/1566] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:28.280447 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-076492c4-4451-4089-b0c1-30da1091619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:28.284313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdc4d-aed4-4203-92db-6538aaffe315 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.284630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdc4d-aed4-4203-92db-6538aaffe315 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.284913 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdc4d-aed4-4203-92db-6538aaffe315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.291181 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 787/1567] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:28.296578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076492c4-4451-4089-b0c1-30da1091619c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.310126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-148cdc4d-aed4-4203-92db-6538aaffe315 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:28.311400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-148cdc4d-aed4-4203-92db-6538aaffe315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:28.313821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076492c4-4451-4089-b0c1-30da1091619c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.319205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3f43e-8811-44b4-b5c5-afe1af06f034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.319966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f43e-8811-44b4-b5c5-afe1af06f034 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.320453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f43e-8811-44b4-b5c5-afe1af06f034 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.320903 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f43e-8811-44b4-b5c5-afe1af06f034 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.324707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 781/1568] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:28.324890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3f43e-8811-44b4-b5c5-afe1af06f034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.324988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cdc4d-aed4-4203-92db-6538aaffe315 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.325067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3f43e-8811-44b4-b5c5-afe1af06f034 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.333548 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cdc4d-aed4-4203-92db-6538aaffe315 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.335951 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 788/1569] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:28 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:28.336706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3f43e-8811-44b4-b5c5-afe1af06f034 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.343176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09a40f-8f0e-4852-a5c8-674013d82326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.344103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09a40f-8f0e-4852-a5c8-674013d82326 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.344362 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09a40f-8f0e-4852-a5c8-674013d82326 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.344637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09a40f-8f0e-4852-a5c8-674013d82326 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.345316 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09a40f-8f0e-4852-a5c8-674013d82326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.346384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: WARNING py.warnings [None req-9b09a40f-8f0e-4852-a5c8-674013d82326 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:53:28.346384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: warnings.warn(msg) Aug 01 16:53:28.346384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: Aug 01 16:53:28.347624 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09a40f-8f0e-4852-a5c8-674013d82326 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.350823 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3f43e-8811-44b4-b5c5-afe1af06f034 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.357497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796090-de54-44f6-85b8-2692ac4a32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.358478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796090-de54-44f6-85b8-2692ac4a32e4 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.358829 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796090-de54-44f6-85b8-2692ac4a32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.359198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796090-de54-44f6-85b8-2692ac4a32e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.359870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee796090-de54-44f6-85b8-2692ac4a32e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:28.360165 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee796090-de54-44f6-85b8-2692ac4a32e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.361863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee796090-de54-44f6-85b8-2692ac4a32e4 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.385466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 789/1570] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:28.385466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796090-de54-44f6-85b8-2692ac4a32e4 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.396147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796090-de54-44f6-85b8-2692ac4a32e4 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.401615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650fe0-da04-4104-9f31-a14b93af07a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.402271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650fe0-da04-4104-9f31-a14b93af07a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.402549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650fe0-da04-4104-9f31-a14b93af07a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.403108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650fe0-da04-4104-9f31-a14b93af07a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.404020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650fe0-da04-4104-9f31-a14b93af07a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:28.404332 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650fe0-da04-4104-9f31-a14b93af07a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.406075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650fe0-da04-4104-9f31-a14b93af07a3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.407789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 782/1571] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/projects => generated 394 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:28.408507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09a40f-8f0e-4852-a5c8-674013d82326 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.432032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 790/1572] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:28.439686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650fe0-da04-4104-9f31-a14b93af07a3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.452334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650fe0-da04-4104-9f31-a14b93af07a3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.535470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09a40f-8f0e-4852-a5c8-674013d82326 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.543342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c3bfa-94a0-46d5-ad7e-756a92b0cb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.544300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c3bfa-94a0-46d5-ad7e-756a92b0cb8d admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.544587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c3bfa-94a0-46d5-ad7e-756a92b0cb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.544869 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c3bfa-94a0-46d5-ad7e-756a92b0cb8d admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.546131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c3bfa-94a0-46d5-ad7e-756a92b0cb8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:28.546615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c3bfa-94a0-46d5-ad7e-756a92b0cb8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.549376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c3bfa-94a0-46d5-ad7e-756a92b0cb8d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.558104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df4113-99be-4467-b786-92c012d084f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.558794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4113-99be-4467-b786-92c012d084f3 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.558794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4113-99be-4467-b786-92c012d084f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.558975 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4113-99be-4467-b786-92c012d084f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.559875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df4113-99be-4467-b786-92c012d084f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:28.560237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df4113-99be-4467-b786-92c012d084f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.561881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df4113-99be-4467-b786-92c012d084f3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.563088 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 783/1573] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:28.572611 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c3bfa-94a0-46d5-ad7e-756a92b0cb8d admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.586775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c3bfa-94a0-46d5-ad7e-756a92b0cb8d admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.596198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 791/1574] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:28.596198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df4113-99be-4467-b786-92c012d084f3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.596522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b07f2-ecd6-46a2-a510-d02f5fb83c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.596522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b07f2-ecd6-46a2-a510-d02f5fb83c29 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.596522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b07f2-ecd6-46a2-a510-d02f5fb83c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.596522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b07f2-ecd6-46a2-a510-d02f5fb83c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.596845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b07f2-ecd6-46a2-a510-d02f5fb83c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:28.596927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b07f2-ecd6-46a2-a510-d02f5fb83c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.599821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b07f2-ecd6-46a2-a510-d02f5fb83c29 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.603682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df4113-99be-4467-b786-92c012d084f3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.610075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4398b-5daa-4ab4-af98-d23f1497cff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.610824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4398b-5daa-4ab4-af98-d23f1497cff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.611268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4398b-5daa-4ab4-af98-d23f1497cff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.611669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4398b-5daa-4ab4-af98-d23f1497cff0 admin admin] PATH_INFO: `/v3/projects/bbef07dd13414f9fb8a7c70c509c15a9/users/40a212c3755b4da5a69d736f6f114641/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.618383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 784/1575] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:28.619775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b07f2-ecd6-46a2-a510-d02f5fb83c29 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.637034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b07f2-ecd6-46a2-a510-d02f5fb83c29 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.643603 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4398b-5daa-4ab4-af98-d23f1497cff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbef07dd13414f9fb8a7c70c509c15a9, user_id=40a212c3755b4da5a69d736f6f114641, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.646693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4398b-5daa-4ab4-af98-d23f1497cff0 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.653747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a3821-aa1a-4ca4-9a62-97b759c76ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.654420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a3821-aa1a-4ca4-9a62-97b759c76ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.654774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a3821-aa1a-4ca4-9a62-97b759c76ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.655236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a3821-aa1a-4ca4-9a62-97b759c76ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.655932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a3821-aa1a-4ca4-9a62-97b759c76ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.658084 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a3821-aa1a-4ca4-9a62-97b759c76ba0 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.664207 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 792/1576] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:28 2022] PUT /identity/v3/projects/bbef07dd13414f9fb8a7c70c509c15a9/users/40a212c3755b4da5a69d736f6f114641/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:28.665556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4398b-5daa-4ab4-af98-d23f1497cff0 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.701626 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 785/1577] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/projects => generated 382 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:28.705620 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a3821-aa1a-4ca4-9a62-97b759c76ba0 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.732581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:28.757220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:28.788186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4398b-5daa-4ab4-af98-d23f1497cff0 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.793535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a3821-aa1a-4ca4-9a62-97b759c76ba0 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.793795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30b25a-ba21-4688-8c4e-c70f4ec9166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.794384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b25a-ba21-4688-8c4e-c70f4ec9166f admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.794716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b25a-ba21-4688-8c4e-c70f4ec9166f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.795023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b25a-ba21-4688-8c4e-c70f4ec9166f admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.795708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30b25a-ba21-4688-8c4e-c70f4ec9166f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.798212 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30b25a-ba21-4688-8c4e-c70f4ec9166f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.800026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d801ab-9e01-4607-a356-f1949569ad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.801037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d801ab-9e01-4607-a356-f1949569ad26 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.801583 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d801ab-9e01-4607-a356-f1949569ad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.802017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d801ab-9e01-4607-a356-f1949569ad26 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.803625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d801ab-9e01-4607-a356-f1949569ad26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.806217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d801ab-9e01-4607-a356-f1949569ad26 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.832768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 793/1578] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:28.833772 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30b25a-ba21-4688-8c4e-c70f4ec9166f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.847415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30b25a-ba21-4688-8c4e-c70f4ec9166f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.859563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 786/1579] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/projects => generated 406 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:28.860442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcb941-84a5-45dc-a6af-dfc29dfd2d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.861025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d801ab-9e01-4607-a356-f1949569ad26 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.861190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcb941-84a5-45dc-a6af-dfc29dfd2d76 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.861524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcb941-84a5-45dc-a6af-dfc29dfd2d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.862070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcb941-84a5-45dc-a6af-dfc29dfd2d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.863481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcb941-84a5-45dc-a6af-dfc29dfd2d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.866445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcb941-84a5-45dc-a6af-dfc29dfd2d76 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.911744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 794/1580] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/projects => generated 386 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:28.912694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcb941-84a5-45dc-a6af-dfc29dfd2d76 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.945230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d801ab-9e01-4607-a356-f1949569ad26 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.017029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcb941-84a5-45dc-a6af-dfc29dfd2d76 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.022573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dbefc-a92b-4d59-8c1c-58375f91286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.024357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dbefc-a92b-4d59-8c1c-58375f91286e admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.024795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dbefc-a92b-4d59-8c1c-58375f91286e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.025201 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dbefc-a92b-4d59-8c1c-58375f91286e admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.026433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dbefc-a92b-4d59-8c1c-58375f91286e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.027226 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44885aae-c535-4a7d-b005-af15b6cd2c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.027989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44885aae-c535-4a7d-b005-af15b6cd2c8d admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.028362 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44885aae-c535-4a7d-b005-af15b6cd2c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.028664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dbefc-a92b-4d59-8c1c-58375f91286e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.028799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44885aae-c535-4a7d-b005-af15b6cd2c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.029669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44885aae-c535-4a7d-b005-af15b6cd2c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.032033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44885aae-c535-4a7d-b005-af15b6cd2c8d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.073100 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 795/1581] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/projects => generated 380 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:29.074361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 787/1582] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:28 2022] POST /identity/v3/projects => generated 374 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:29.075594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44885aae-c535-4a7d-b005-af15b6cd2c8d admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.079391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bded1-8871-4e6c-a959-f24396270a8c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.079957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bded1-8871-4e6c-a959-f24396270a8c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.080881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bded1-8871-4e6c-a959-f24396270a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.121474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-bd1bded1-8871-4e6c-a959-f24396270a8c None None] MFA Rules not processed for user `40a212c3755b4da5a69d736f6f114641`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:29.123091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-bd1bded1-8871-4e6c-a959-f24396270a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:29.187248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:29.243297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 796/1583] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:29.244353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bded1-8871-4e6c-a959-f24396270a8c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.250928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44885aae-c535-4a7d-b005-af15b6cd2c8d admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.260717 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bded1-8871-4e6c-a959-f24396270a8c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.263492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a23403-3ad4-49f6-868c-f5335a03ee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.264993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a23403-3ad4-49f6-868c-f5335a03ee18 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.265738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a23403-3ad4-49f6-868c-f5335a03ee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.266096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941f734-fb94-46e7-90da-cc94f70b9bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.266422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a23403-3ad4-49f6-868c-f5335a03ee18 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.266738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941f734-fb94-46e7-90da-cc94f70b9bbb admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.267221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941f734-fb94-46e7-90da-cc94f70b9bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.267535 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941f734-fb94-46e7-90da-cc94f70b9bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.268031 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a23403-3ad4-49f6-868c-f5335a03ee18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.268309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941f734-fb94-46e7-90da-cc94f70b9bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.269998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941f734-fb94-46e7-90da-cc94f70b9bbb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.272001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a23403-3ad4-49f6-868c-f5335a03ee18 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.282522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 797/1584] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.286646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941f734-fb94-46e7-90da-cc94f70b9bbb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.299319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941f734-fb94-46e7-90da-cc94f70b9bbb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.305394 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672350c-5b1c-4de6-b94e-b3ebc9ee5069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.306146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672350c-5b1c-4de6-b94e-b3ebc9ee5069 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.306433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672350c-5b1c-4de6-b94e-b3ebc9ee5069 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.306921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672350c-5b1c-4de6-b94e-b3ebc9ee5069 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.307674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672350c-5b1c-4de6-b94e-b3ebc9ee5069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.310745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672350c-5b1c-4de6-b94e-b3ebc9ee5069 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.324123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 788/1585] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:29 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:29.327540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a23403-3ad4-49f6-868c-f5335a03ee18 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.344557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:29.356754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 798/1586] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:29 2022] POST /identity/v3/users => generated 304 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:29.357758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672350c-5b1c-4de6-b94e-b3ebc9ee5069 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.370022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a23403-3ad4-49f6-868c-f5335a03ee18 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.372714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672350c-5b1c-4de6-b94e-b3ebc9ee5069 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.379923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0806c25-4180-4993-adaa-864a72fe2d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.380275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecb19d-e300-4472-a979-7897722d11cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.380594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806c25-4180-4993-adaa-864a72fe2d64 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.380879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806c25-4180-4993-adaa-864a72fe2d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.381155 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806c25-4180-4993-adaa-864a72fe2d64 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.381352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecb19d-e300-4472-a979-7897722d11cb admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.381859 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecb19d-e300-4472-a979-7897722d11cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.381993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0806c25-4180-4993-adaa-864a72fe2d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.382360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecb19d-e300-4472-a979-7897722d11cb admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.385256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecb19d-e300-4472-a979-7897722d11cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.385414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0806c25-4180-4993-adaa-864a72fe2d64 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.387828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecb19d-e300-4472-a979-7897722d11cb admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.413018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 799/1587] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:29 2022] POST /identity/v3/users => generated 291 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:29.413725 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0806c25-4180-4993-adaa-864a72fe2d64 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.426240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0806c25-4180-4993-adaa-864a72fe2d64 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.432708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba52f1c-4151-4a48-b041-de1202ed8deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.433734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba52f1c-4151-4a48-b041-de1202ed8deb admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.433734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba52f1c-4151-4a48-b041-de1202ed8deb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.433944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba52f1c-4151-4a48-b041-de1202ed8deb admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.434555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba52f1c-4151-4a48-b041-de1202ed8deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.434920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 789/1588] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:29 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:29.435890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecb19d-e300-4472-a979-7897722d11cb admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.436567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba52f1c-4151-4a48-b041-de1202ed8deb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.449153 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecb19d-e300-4472-a979-7897722d11cb admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.454716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1546f6-87df-4468-ab41-7fe43828ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.455455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1546f6-87df-4468-ab41-7fe43828ce57 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.455755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1546f6-87df-4468-ab41-7fe43828ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.456036 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1546f6-87df-4468-ab41-7fe43828ce57 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.456724 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1546f6-87df-4468-ab41-7fe43828ce57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.458822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1546f6-87df-4468-ab41-7fe43828ce57 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.466614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 800/1589] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:29 2022] POST /identity/v3/users => generated 288 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:29.466614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba52f1c-4151-4a48-b041-de1202ed8deb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.480585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba52f1c-4151-4a48-b041-de1202ed8deb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.487378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b9359-1c59-458e-b44b-c48f46672011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.488380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b9359-1c59-458e-b44b-c48f46672011 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.489002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b9359-1c59-458e-b44b-c48f46672011 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.489290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b9359-1c59-458e-b44b-c48f46672011 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.490284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b9359-1c59-458e-b44b-c48f46672011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.492504 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b9359-1c59-458e-b44b-c48f46672011 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.498373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 790/1590] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:29 2022] POST /identity/v3/projects => generated 358 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:29.499381 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1546f6-87df-4468-ab41-7fe43828ce57 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.559431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 801/1591] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.559431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b9359-1c59-458e-b44b-c48f46672011 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.559431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b9359-1c59-458e-b44b-c48f46672011 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.619412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1546f6-87df-4468-ab41-7fe43828ce57 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.622345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c4ff9-3003-4608-9a1e-9a00dfd58bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.624398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c4ff9-3003-4608-9a1e-9a00dfd58bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.624682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c4ff9-3003-4608-9a1e-9a00dfd58bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.624938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d84db5-fccd-4c38-9a02-ca68bf42c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.625100 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c4ff9-3003-4608-9a1e-9a00dfd58bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.625782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84db5-fccd-4c38-9a02-ca68bf42c628 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.625907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c4ff9-3003-4608-9a1e-9a00dfd58bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.626243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84db5-fccd-4c38-9a02-ca68bf42c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.627584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d84db5-fccd-4c38-9a02-ca68bf42c628 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.627979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d84db5-fccd-4c38-9a02-ca68bf42c628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.628486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c4ff9-3003-4608-9a1e-9a00dfd58bd2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.630246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d84db5-fccd-4c38-9a02-ca68bf42c628 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.642556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 802/1592] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.643538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c4ff9-3003-4608-9a1e-9a00dfd58bd2 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.645857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 791/1593] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.646476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d84db5-fccd-4c38-9a02-ca68bf42c628 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.658803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d84db5-fccd-4c38-9a02-ca68bf42c628 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.666264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c4ff9-3003-4608-9a1e-9a00dfd58bd2 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.669844 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97e873-7198-4b35-b062-badacd8a946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.670377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97e873-7198-4b35-b062-badacd8a946a admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.670779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97e873-7198-4b35-b062-badacd8a946a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.671322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97e873-7198-4b35-b062-badacd8a946a admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.672463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611889b7-058a-4642-a8d4-c91eae331f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.673225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611889b7-058a-4642-a8d4-c91eae331f1c admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.673609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611889b7-058a-4642-a8d4-c91eae331f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.673708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97e873-7198-4b35-b062-badacd8a946a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.674055 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611889b7-058a-4642-a8d4-c91eae331f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.675111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611889b7-058a-4642-a8d4-c91eae331f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.676015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97e873-7198-4b35-b062-badacd8a946a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.676823 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611889b7-058a-4642-a8d4-c91eae331f1c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.695686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 803/1594] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.696600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611889b7-058a-4642-a8d4-c91eae331f1c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.696794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 792/1595] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.698828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97e873-7198-4b35-b062-badacd8a946a admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.708336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611889b7-058a-4642-a8d4-c91eae331f1c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.717909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b9e8-8819-4341-8bd6-f87423143f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.718721 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b9e8-8819-4341-8bd6-f87423143f7c admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.719053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b9e8-8819-4341-8bd6-f87423143f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.719329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b9e8-8819-4341-8bd6-f87423143f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.720064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0b9e8-8819-4341-8bd6-f87423143f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.721625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97e873-7198-4b35-b062-badacd8a946a admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.721739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0b9e8-8819-4341-8bd6-f87423143f7c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.727714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff4e3f-3431-4407-ab25-38916ca13e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.728478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4e3f-3431-4407-ab25-38916ca13e66 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.728970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4e3f-3431-4407-ab25-38916ca13e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.729322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4e3f-3431-4407-ab25-38916ca13e66 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.730360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff4e3f-3431-4407-ab25-38916ca13e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.733075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff4e3f-3431-4407-ab25-38916ca13e66 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.733291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 804/1596] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.734151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b9e8-8819-4341-8bd6-f87423143f7c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.745939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b9e8-8819-4341-8bd6-f87423143f7c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.751330 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090934e1-b82e-4732-a961-ca799ae6bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.751987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090934e1-b82e-4732-a961-ca799ae6bd73 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.752329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090934e1-b82e-4732-a961-ca799ae6bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.752546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090934e1-b82e-4732-a961-ca799ae6bd73 admin admin] PATH_INFO: `/v3/projects/7a976b4e2c5847b395755325c8c85ee9/users/8ef71e3a38c245d5a008368c23e701d7/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.764327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 793/1597] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:29 2022] POST /identity/v3/users => generated 286 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:29.765672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff4e3f-3431-4407-ab25-38916ca13e66 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.771300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090934e1-b82e-4732-a961-ca799ae6bd73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a976b4e2c5847b395755325c8c85ee9, user_id=8ef71e3a38c245d5a008368c23e701d7, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.775075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090934e1-b82e-4732-a961-ca799ae6bd73 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.781501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff4e3f-3431-4407-ab25-38916ca13e66 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.790558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78575feb-c221-413d-b18d-1cc978db6459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.791513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78575feb-c221-413d-b18d-1cc978db6459 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.792030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78575feb-c221-413d-b18d-1cc978db6459 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.792030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78575feb-c221-413d-b18d-1cc978db6459 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.792773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78575feb-c221-413d-b18d-1cc978db6459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.794783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78575feb-c221-413d-b18d-1cc978db6459 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.797898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 805/1598] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:29 2022] PUT /identity/v3/projects/7a976b4e2c5847b395755325c8c85ee9/users/8ef71e3a38c245d5a008368c23e701d7/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:29.799020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090934e1-b82e-4732-a961-ca799ae6bd73 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.812781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 794/1599] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.817413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78575feb-c221-413d-b18d-1cc978db6459 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.828969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78575feb-c221-413d-b18d-1cc978db6459 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.885692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090934e1-b82e-4732-a961-ca799ae6bd73 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.890112 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:29.891518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3046e37-a94c-4a58-9d28-a2c54a2b6e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.892447 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3046e37-a94c-4a58-9d28-a2c54a2b6e0c admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.892761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3046e37-a94c-4a58-9d28-a2c54a2b6e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.893151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3046e37-a94c-4a58-9d28-a2c54a2b6e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.894083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3046e37-a94c-4a58-9d28-a2c54a2b6e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.896269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3046e37-a94c-4a58-9d28-a2c54a2b6e0c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.899308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:29.910381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 806/1600] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.912183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b0947-c313-4ecc-9526-7ae574b31d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.912753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0947-c313-4ecc-9526-7ae574b31d6b admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.913046 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0947-c313-4ecc-9526-7ae574b31d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.913327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0947-c313-4ecc-9526-7ae574b31d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.914191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b0947-c313-4ecc-9526-7ae574b31d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.916024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3046e37-a94c-4a58-9d28-a2c54a2b6e0c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.916230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b0947-c313-4ecc-9526-7ae574b31d6b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.928434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3046e37-a94c-4a58-9d28-a2c54a2b6e0c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.933115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 795/1601] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.933115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b0947-c313-4ecc-9526-7ae574b31d6b admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.938806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61724625-90d5-4769-a09f-624ef7e6af40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.939646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724625-90d5-4769-a09f-624ef7e6af40 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.939938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724625-90d5-4769-a09f-624ef7e6af40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.940255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724625-90d5-4769-a09f-624ef7e6af40 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.940945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61724625-90d5-4769-a09f-624ef7e6af40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.944249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61724625-90d5-4769-a09f-624ef7e6af40 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.957272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b0947-c313-4ecc-9526-7ae574b31d6b admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.963259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 807/1602] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.963259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61724625-90d5-4769-a09f-624ef7e6af40 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:29.967385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95365376-c0da-4b81-95d3-73e55d2ea7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.969688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365376-c0da-4b81-95d3-73e55d2ea7aa admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.970102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365376-c0da-4b81-95d3-73e55d2ea7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.970458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365376-c0da-4b81-95d3-73e55d2ea7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.971649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95365376-c0da-4b81-95d3-73e55d2ea7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.973463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95365376-c0da-4b81-95d3-73e55d2ea7aa admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.973742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61724625-90d5-4769-a09f-624ef7e6af40 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:29.981430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded65ac-898e-4123-90c5-90be99660ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:29.982086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded65ac-898e-4123-90c5-90be99660ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.982376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded65ac-898e-4123-90c5-90be99660ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.982862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded65ac-898e-4123-90c5-90be99660ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:29.983645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded65ac-898e-4123-90c5-90be99660ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:29.985346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded65ac-898e-4123-90c5-90be99660ef1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:29.988429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 796/1603] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:29.991216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089a2c8-54ca-46fa-9c63-87450bad20e9 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:29.991524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089a2c8-54ca-46fa-9c63-87450bad20e9 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:29.991956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089a2c8-54ca-46fa-9c63-87450bad20e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.002553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 808/1604] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:29 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:30.002553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded65ac-898e-4123-90c5-90be99660ef1 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:30.012385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded65ac-898e-4123-90c5-90be99660ef1 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:30.013883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a089a2c8-54ca-46fa-9c63-87450bad20e9 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:30.015259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a089a2c8-54ca-46fa-9c63-87450bad20e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:30.017217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65824bc1-5e7a-4669-b384-8d867a7fd555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:30.019874 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824bc1-5e7a-4669-b384-8d867a7fd555 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.020392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824bc1-5e7a-4669-b384-8d867a7fd555 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.020674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824bc1-5e7a-4669-b384-8d867a7fd555 admin admin] PATH_INFO: `/v3/projects/86eb85ae29bd4fff8d2a52a188dbf391/users/1971dc5053ec46229e7b37b1f39143da/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.024479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 797/1605] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:30.025407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089a2c8-54ca-46fa-9c63-87450bad20e9 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:30.036765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089a2c8-54ca-46fa-9c63-87450bad20e9 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:30.048221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940a49f-4edb-407b-8187-f69d7aec65ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:30.049822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a49f-4edb-407b-8187-f69d7aec65ff admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.050291 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a49f-4edb-407b-8187-f69d7aec65ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.050573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a49f-4edb-407b-8187-f69d7aec65ff admin admin] PATH_INFO: `/v3/projects/54c72ca6a81f401087f4c9fb722b29ca/users/05a831f4e1dd406bbd0713c675432fcb/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.050714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65824bc1-5e7a-4669-b384-8d867a7fd555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86eb85ae29bd4fff8d2a52a188dbf391, user_id=1971dc5053ec46229e7b37b1f39143da, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:30.053473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65824bc1-5e7a-4669-b384-8d867a7fd555 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:30.072539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 809/1606] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:29 2022] PUT /identity/v3/projects/86eb85ae29bd4fff8d2a52a188dbf391/users/1971dc5053ec46229e7b37b1f39143da/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:30.073341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940a49f-4edb-407b-8187-f69d7aec65ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c72ca6a81f401087f4c9fb722b29ca, user_id=05a831f4e1dd406bbd0713c675432fcb, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:30.074019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65824bc1-5e7a-4669-b384-8d867a7fd555 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:30.074524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: WARNING py.warnings [None req-8940a49f-4edb-407b-8187-f69d7aec65ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:53:30.074524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: warnings.warn(msg) Aug 01 16:53:30.074524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: Aug 01 16:53:30.077033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940a49f-4edb-407b-8187-f69d7aec65ff admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:30.101116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 798/1607] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:30 2022] PUT /identity/v3/projects/54c72ca6a81f401087f4c9fb722b29ca/users/05a831f4e1dd406bbd0713c675432fcb/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:30.103001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940a49f-4edb-407b-8187-f69d7aec65ff admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:30.200793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65824bc1-5e7a-4669-b384-8d867a7fd555 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:30.220135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940a49f-4edb-407b-8187-f69d7aec65ff admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:30.226155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4f3f1-a0d6-47b0-a336-64b525cf644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:30.226911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7764b-f711-444c-973e-788849b90db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:30.227421 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f3f1-a0d6-47b0-a336-64b525cf644f admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.227848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f3f1-a0d6-47b0-a336-64b525cf644f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.228258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f3f1-a0d6-47b0-a336-64b525cf644f admin admin] PATH_INFO: `/v3/projects/217c7ddebb90443d992223bcb4e2173f/users/61cdaecc25284225bb05bf978fe037bb/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.228368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7764b-f711-444c-973e-788849b90db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.228682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7764b-f711-444c-973e-788849b90db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.229122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7764b-f711-444c-973e-788849b90db9 admin admin] PATH_INFO: `/v3/projects/0e436c6c21474648a2c116e96cb303b0/users/329a85e5f5e9446c80dc45cafd329108/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.249449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4f3f1-a0d6-47b0-a336-64b525cf644f admin admin] RBAC: Authorizing `identity:create_grant(project_id=217c7ddebb90443d992223bcb4e2173f, user_id=61cdaecc25284225bb05bf978fe037bb, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:30.253069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4f3f1-a0d6-47b0-a336-64b525cf644f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:30.253669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7764b-f711-444c-973e-788849b90db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e436c6c21474648a2c116e96cb303b0, user_id=329a85e5f5e9446c80dc45cafd329108, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:30.258027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7764b-f711-444c-973e-788849b90db9 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:30.276627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 799/1608] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:30 2022] PUT /identity/v3/projects/217c7ddebb90443d992223bcb4e2173f/users/61cdaecc25284225bb05bf978fe037bb/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:30.277630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4f3f1-a0d6-47b0-a336-64b525cf644f admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:30.279301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 810/1609] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:30 2022] PUT /identity/v3/projects/0e436c6c21474648a2c116e96cb303b0/users/329a85e5f5e9446c80dc45cafd329108/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:30.280651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7764b-f711-444c-973e-788849b90db9 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:30.389285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7764b-f711-444c-973e-788849b90db9 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:30.396725 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef242fda-5019-45d2-a82e-8068e0ed2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:30.397800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef242fda-5019-45d2-a82e-8068e0ed2db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.398183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef242fda-5019-45d2-a82e-8068e0ed2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.398666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef242fda-5019-45d2-a82e-8068e0ed2db6 admin admin] PATH_INFO: `/v3/projects/ddcc779928e04490b7f438011fffeee2/users/4728063a0a454fb0a1ef25ce96b32cb0/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.411082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4f3f1-a0d6-47b0-a336-64b525cf644f admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:30.417262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3fbc4-2999-45cb-877b-504f5ab5e0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:30.417976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3fbc4-2999-45cb-877b-504f5ab5e0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.418312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3fbc4-2999-45cb-877b-504f5ab5e0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.418600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3fbc4-2999-45cb-877b-504f5ab5e0fd admin admin] PATH_INFO: `/v3/projects/9a6b68f77a3d4e51aef9d943010ce062/users/5d24d2ae92ae490da4d250aac2e060c0/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.437669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef242fda-5019-45d2-a82e-8068e0ed2db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcc779928e04490b7f438011fffeee2, user_id=4728063a0a454fb0a1ef25ce96b32cb0, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:30.442479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef242fda-5019-45d2-a82e-8068e0ed2db6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:30.446154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3fbc4-2999-45cb-877b-504f5ab5e0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6b68f77a3d4e51aef9d943010ce062, user_id=5d24d2ae92ae490da4d250aac2e060c0, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:30.463931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3fbc4-2999-45cb-877b-504f5ab5e0fd admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:30.471202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 811/1610] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:30 2022] PUT /identity/v3/projects/ddcc779928e04490b7f438011fffeee2/users/4728063a0a454fb0a1ef25ce96b32cb0/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:30.472174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef242fda-5019-45d2-a82e-8068e0ed2db6 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:30.475342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ef242fda-5019-45d2-a82e-8068e0ed2db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:30.490767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 800/1611] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:30 2022] PUT /identity/v3/projects/9a6b68f77a3d4e51aef9d943010ce062/users/5d24d2ae92ae490da4d250aac2e060c0/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:30.492491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd24486-0e8c-46b6-b70e-fd94cb360957 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.492912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd24486-0e8c-46b6-b70e-fd94cb360957 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.493411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd24486-0e8c-46b6-b70e-fd94cb360957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.516251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:30.520247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:30.561818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-3fd24486-0e8c-46b6-b70e-fd94cb360957 None None] MFA Rules not processed for user `1971dc5053ec46229e7b37b1f39143da`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:30.563339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3fd24486-0e8c-46b6-b70e-fd94cb360957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:30.575113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef242fda-5019-45d2-a82e-8068e0ed2db6 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:30.639781 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b7e98-7bbc-4951-ba7b-76a9bf93e9c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:30.640656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7e98-7bbc-4951-ba7b-76a9bf93e9c7 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.640779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7e98-7bbc-4951-ba7b-76a9bf93e9c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.641003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7e98-7bbc-4951-ba7b-76a9bf93e9c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.656235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 801/1612] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:30.657837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d0ca1-e478-479a-ad62-fa8aa41b176a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.658238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d0ca1-e478-479a-ad62-fa8aa41b176a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.659202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d0ca1-e478-479a-ad62-fa8aa41b176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.725544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b7e98-7bbc-4951-ba7b-76a9bf93e9c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:30.727293 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b7e98-7bbc-4951-ba7b-76a9bf93e9c7 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:30.734183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-043d0ca1-e478-479a-ad62-fa8aa41b176a None None] MFA Rules not processed for user `05a831f4e1dd406bbd0713c675432fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:30.736023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-043d0ca1-e478-479a-ad62-fa8aa41b176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:30.752883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 812/1613] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:30.754465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54115e-4966-4a81-a312-c17702e418fd None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.758457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54115e-4966-4a81-a312-c17702e418fd None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.758801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54115e-4966-4a81-a312-c17702e418fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.808310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4e54115e-4966-4a81-a312-c17702e418fd None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:30.812935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4e54115e-4966-4a81-a312-c17702e418fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:30.837880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 802/1614] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:30.841527 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881518c-73bc-4406-89be-de93684d84fa None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.841527 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881518c-73bc-4406-89be-de93684d84fa None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.841527 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881518c-73bc-4406-89be-de93684d84fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.842225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 813/1615] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:30.843745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54115e-4966-4a81-a312-c17702e418fd None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:30.860204 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54115e-4966-4a81-a312-c17702e418fd None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:30.868131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5080b3-102a-465b-97b8-c7be9de7f41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:30.869481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5080b3-102a-465b-97b8-c7be9de7f41c admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.870032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5080b3-102a-465b-97b8-c7be9de7f41c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.870291 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d881518c-73bc-4406-89be-de93684d84fa None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:30.870694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5080b3-102a-465b-97b8-c7be9de7f41c admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.872046 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5080b3-102a-465b-97b8-c7be9de7f41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:30.873363 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d881518c-73bc-4406-89be-de93684d84fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:30.876029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5080b3-102a-465b-97b8-c7be9de7f41c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:30.895588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 814/1616] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:30 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:30.896014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 803/1617] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:30.897928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4560ef-13a5-460e-a0c0-8326b83b5472 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.898102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881518c-73bc-4406-89be-de93684d84fa None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:30.898868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4560ef-13a5-460e-a0c0-8326b83b5472 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.899465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4560ef-13a5-460e-a0c0-8326b83b5472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.923959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881518c-73bc-4406-89be-de93684d84fa None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:30.930448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea27b4-2598-4ed6-8143-41fea036581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:30.931454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea27b4-2598-4ed6-8143-41fea036581c admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.932011 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea27b4-2598-4ed6-8143-41fea036581c admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.932394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea27b4-2598-4ed6-8143-41fea036581c admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.933190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea27b4-2598-4ed6-8143-41fea036581c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:30.935477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea27b4-2598-4ed6-8143-41fea036581c admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:30.963275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ea4560ef-13a5-460e-a0c0-8326b83b5472 None None] MFA Rules not processed for user `5d24d2ae92ae490da4d250aac2e060c0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:30.965648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ea4560ef-13a5-460e-a0c0-8326b83b5472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:30.984107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 804/1618] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:30 2022] POST /identity/v3/projects => generated 404 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:30.987871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea27b4-2598-4ed6-8143-41fea036581c admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:31.153312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:31.175297 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea27b4-2598-4ed6-8143-41fea036581c admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:31.181401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 815/1619] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:31.185451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a7c7-6a82-4473-aa9f-86a7c73245af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:31.188344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd16bb-331a-48e7-86bf-0c171aaccc23 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.189259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a7c7-6a82-4473-aa9f-86a7c73245af service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.189613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a7c7-6a82-4473-aa9f-86a7c73245af service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.189957 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a7c7-6a82-4473-aa9f-86a7c73245af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.191073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd16bb-331a-48e7-86bf-0c171aaccc23 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.191932 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd16bb-331a-48e7-86bf-0c171aaccc23 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.195417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 816/1620] 10.222.0.124 () {54 vars in 967 bytes} [Mon Aug 1 16:53:31 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:31.197225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd16bb-331a-48e7-86bf-0c171aaccc23 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:31.214410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:31.376115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9a7c7-6a82-4473-aa9f-86a7c73245af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:31.383107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9a7c7-6a82-4473-aa9f-86a7c73245af service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:31.390268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd16bb-331a-48e7-86bf-0c171aaccc23 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:31.401358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba2dc-092d-4969-9259-c58dcd28f580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:31.402303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba2dc-092d-4969-9259-c58dcd28f580 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.403707 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba2dc-092d-4969-9259-c58dcd28f580 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.404099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba2dc-092d-4969-9259-c58dcd28f580 admin admin] PATH_INFO: `/v3/projects/ddcc779928e04490b7f438011fffeee2/users/4728063a0a454fb0a1ef25ce96b32cb0/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.408824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcba2dc-092d-4969-9259-c58dcd28f580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcc779928e04490b7f438011fffeee2, user_id=4728063a0a454fb0a1ef25ce96b32cb0, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:31.409469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 805/1621] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:31.410503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a7c7-6a82-4473-aa9f-86a7c73245af service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:31.418991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcba2dc-092d-4969-9259-c58dcd28f580 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:31.431395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a7c7-6a82-4473-aa9f-86a7c73245af service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:31.441724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 817/1622] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:31 2022] PUT /identity/v3/projects/ddcc779928e04490b7f438011fffeee2/users/4728063a0a454fb0a1ef25ce96b32cb0/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:31.445548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba2dc-092d-4969-9259-c58dcd28f580 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:31.524832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba2dc-092d-4969-9259-c58dcd28f580 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:31.530318 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90a96c-511e-4438-81c1-81485519bd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:31.531376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90a96c-511e-4438-81c1-81485519bd3d admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.531762 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90a96c-511e-4438-81c1-81485519bd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.532177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90a96c-511e-4438-81c1-81485519bd3d admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.533331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90a96c-511e-4438-81c1-81485519bd3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:31.536350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90a96c-511e-4438-81c1-81485519bd3d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:31.563827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 818/1623] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:31 2022] POST /identity/v3/users => generated 309 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:31.565900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800be62-8b62-4527-bda4-a2561e196f70 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.566298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800be62-8b62-4527-bda4-a2561e196f70 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.566705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800be62-8b62-4527-bda4-a2561e196f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.623931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21de52-9c13-481e-a14e-060ef58681fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:31.624866 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21de52-9c13-481e-a14e-060ef58681fe service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.625385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21de52-9c13-481e-a14e-060ef58681fe service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.625853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21de52-9c13-481e-a14e-060ef58681fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.642372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a800be62-8b62-4527-bda4-a2561e196f70 None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:31.646210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21de52-9c13-481e-a14e-060ef58681fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:31.646907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a800be62-8b62-4527-bda4-a2561e196f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:31.649211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21de52-9c13-481e-a14e-060ef58681fe service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:31.677515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 806/1624] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:31.681564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3103dbf-f95e-4618-8c51-0d0c18c0eaf1 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.681860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3103dbf-f95e-4618-8c51-0d0c18c0eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.682139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3103dbf-f95e-4618-8c51-0d0c18c0eaf1 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.684997 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 807/1625] 10.222.0.124 () {54 vars in 967 bytes} [Mon Aug 1 16:53:31 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:31.688988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43a2f8-899a-49a7-8f05-04f34a2ee82c None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.691891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43a2f8-899a-49a7-8f05-04f34a2ee82c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.692220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43a2f8-899a-49a7-8f05-04f34a2ee82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.756541 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-0c43a2f8-899a-49a7-8f05-04f34a2ee82c None None] MFA Rules not processed for user `4728063a0a454fb0a1ef25ce96b32cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:31.760347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0c43a2f8-899a-49a7-8f05-04f34a2ee82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:31.804525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:31.817926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 819/1626] 10.222.0.124 () {58 vars in 1064 bytes} [Mon Aug 1 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:31.819381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800be62-8b62-4527-bda4-a2561e196f70 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:31.832617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800be62-8b62-4527-bda4-a2561e196f70 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:31.840611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9888c-2e26-4049-b9d4-d4f9bd5ff6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:31.842319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9888c-2e26-4049-b9d4-d4f9bd5ff6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.842319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9888c-2e26-4049-b9d4-d4f9bd5ff6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.843300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9888c-2e26-4049-b9d4-d4f9bd5ff6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.843823 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9888c-2e26-4049-b9d4-d4f9bd5ff6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:31.845826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9888c-2e26-4049-b9d4-d4f9bd5ff6f0 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:31.864109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 820/1627] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:31 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:31.865904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92c3d1-dc86-4f69-a2bb-cca806f0b4ad None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.868885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92c3d1-dc86-4f69-a2bb-cca806f0b4ad None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.869304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92c3d1-dc86-4f69-a2bb-cca806f0b4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.893034 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-1b92c3d1-dc86-4f69-a2bb-cca806f0b4ad None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:31.894534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1b92c3d1-dc86-4f69-a2bb-cca806f0b4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:31.906387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 808/1628] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:31.911989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43a2f8-899a-49a7-8f05-04f34a2ee82c None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:31.928218 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 821/1629] 10.222.0.124 () {58 vars in 1064 bytes} [Mon Aug 1 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:31.929482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92c3d1-dc86-4f69-a2bb-cca806f0b4ad None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:31.939753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43a2f8-899a-49a7-8f05-04f34a2ee82c None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:31.951816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436f495-6770-4a5d-a961-43658e2bf38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:31.952468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436f495-6770-4a5d-a961-43658e2bf38b service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.952749 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436f495-6770-4a5d-a961-43658e2bf38b service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.953025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436f495-6770-4a5d-a961-43658e2bf38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.954060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92c3d1-dc86-4f69-a2bb-cca806f0b4ad None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:31.959288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0a0fa-ba90-408c-91b8-e66445ff801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:31.960430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0a0fa-ba90-408c-91b8-e66445ff801f admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.961183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0a0fa-ba90-408c-91b8-e66445ff801f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.961761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0a0fa-ba90-408c-91b8-e66445ff801f admin admin] PATH_INFO: `/v3/projects/fd75bba8b4424b9cbac75506ceb5c538/users/9094ad864f7d4328b84239dee8959873/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.984736 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0a0fa-ba90-408c-91b8-e66445ff801f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd75bba8b4424b9cbac75506ceb5c538, user_id=9094ad864f7d4328b84239dee8959873, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:31.989868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0a0fa-ba90-408c-91b8-e66445ff801f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:31.993400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:32.018170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 822/1630] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:31 2022] PUT /identity/v3/projects/fd75bba8b4424b9cbac75506ceb5c538/users/9094ad864f7d4328b84239dee8959873/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:32.019676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0a0fa-ba90-408c-91b8-e66445ff801f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:32.042568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436f495-6770-4a5d-a961-43658e2bf38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:32.044419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436f495-6770-4a5d-a961-43658e2bf38b service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:32.101183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 809/1631] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:32.104521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436f495-6770-4a5d-a961-43658e2bf38b service nova] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:32.157337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436f495-6770-4a5d-a961-43658e2bf38b service nova] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:32.213312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0a0fa-ba90-408c-91b8-e66445ff801f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:32.223769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81f5b4-9725-47c7-a2ea-c2cc19ee5fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:32.228923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81f5b4-9725-47c7-a2ea-c2cc19ee5fba service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:32.231237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81f5b4-9725-47c7-a2ea-c2cc19ee5fba service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:32.231377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81f5b4-9725-47c7-a2ea-c2cc19ee5fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:32.380889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18840356-f545-4b4d-bd0e-7986ad848760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:32.381935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840356-f545-4b4d-bd0e-7986ad848760 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:32.382682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840356-f545-4b4d-bd0e-7986ad848760 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:32.383270 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840356-f545-4b4d-bd0e-7986ad848760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:32.419203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81f5b4-9725-47c7-a2ea-c2cc19ee5fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:32.426192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81f5b4-9725-47c7-a2ea-c2cc19ee5fba service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:32.469275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 823/1632] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:32.478642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81f5b4-9725-47c7-a2ea-c2cc19ee5fba service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:32.542383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18840356-f545-4b4d-bd0e-7986ad848760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:32.546457 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18840356-f545-4b4d-bd0e-7986ad848760 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:32.578061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 810/1633] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:32.699170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18840356-f545-4b4d-bd0e-7986ad848760 service nova] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:32.701834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81f5b4-9725-47c7-a2ea-c2cc19ee5fba service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:32.718753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69b324-3782-4018-bfff-34e2172212d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:32.719538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69b324-3782-4018-bfff-34e2172212d9 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:32.719826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69b324-3782-4018-bfff-34e2172212d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:32.720104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69b324-3782-4018-bfff-34e2172212d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:32.720425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18840356-f545-4b4d-bd0e-7986ad848760 service nova] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:32.720823 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69b324-3782-4018-bfff-34e2172212d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:32.727263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69b324-3782-4018-bfff-34e2172212d9 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:32.744033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98513a2f-cf01-4a84-9a46-7f321cd5926b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:32.744915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98513a2f-cf01-4a84-9a46-7f321cd5926b service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:32.750084 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98513a2f-cf01-4a84-9a46-7f321cd5926b service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:32.751417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98513a2f-cf01-4a84-9a46-7f321cd5926b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:32.752808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 824/1634] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:32 2022] GET /identity/v3/roles => generated 1427 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:32.753893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69b324-3782-4018-bfff-34e2172212d9 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:32.771127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:32.782866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69b324-3782-4018-bfff-34e2172212d9 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:32.790426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d009a9-1583-4992-88ed-e57dfeadff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:32.791579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d009a9-1583-4992-88ed-e57dfeadff80 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:32.792045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d009a9-1583-4992-88ed-e57dfeadff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:32.792522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d009a9-1583-4992-88ed-e57dfeadff80 admin admin] PATH_INFO: `/v3/projects/fd75bba8b4424b9cbac75506ceb5c538/users/9094ad864f7d4328b84239dee8959873/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:32.796136 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d009a9-1583-4992-88ed-e57dfeadff80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd75bba8b4424b9cbac75506ceb5c538, user_id=9094ad864f7d4328b84239dee8959873, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:32.799278 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d009a9-1583-4992-88ed-e57dfeadff80 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:32.815126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 825/1635] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:32 2022] PUT /identity/v3/projects/fd75bba8b4424b9cbac75506ceb5c538/users/9094ad864f7d4328b84239dee8959873/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:32.827482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e813d-8d4c-4d6f-bf48-4e8b43a7cd46 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:32.827949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e813d-8d4c-4d6f-bf48-4e8b43a7cd46 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:32.828809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e813d-8d4c-4d6f-bf48-4e8b43a7cd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:32.898509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98513a2f-cf01-4a84-9a46-7f321cd5926b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:32.900298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98513a2f-cf01-4a84-9a46-7f321cd5926b service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:32.918247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-603e813d-8d4c-4d6f-bf48-4e8b43a7cd46 None None] MFA Rules not processed for user `9094ad864f7d4328b84239dee8959873`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:32.922345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-603e813d-8d4c-4d6f-bf48-4e8b43a7cd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:32.922837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 811/1636] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:53:32.924411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231217-4c06-4bdd-9609-5a9206aaeb20 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:32.926536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231217-4c06-4bdd-9609-5a9206aaeb20 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:32.926536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231217-4c06-4bdd-9609-5a9206aaeb20 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:32.930026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 812/1637] 10.222.0.124 () {54 vars in 917 bytes} [Mon Aug 1 16:53:32 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:32.938102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676452-c917-431e-9efe-82b6172a1de4 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:32.938499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676452-c917-431e-9efe-82b6172a1de4 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:32.938845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb676452-c917-431e-9efe-82b6172a1de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:32.969170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:32.985484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-bb676452-c917-431e-9efe-82b6172a1de4 None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:32.988072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-bb676452-c917-431e-9efe-82b6172a1de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:33.131871 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 826/1638] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:32 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:33.142992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e813d-8d4c-4d6f-bf48-4e8b43a7cd46 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:33.171761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 813/1639] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:53:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:53:33.278875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e813d-8d4c-4d6f-bf48-4e8b43a7cd46 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:33.291503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a3c7e-ffa1-49d8-a17e-c5b3a3c999dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:33.292679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3c7e-ffa1-49d8-a17e-c5b3a3c999dd service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:33.293109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3c7e-ffa1-49d8-a17e-c5b3a3c999dd service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:33.294554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3c7e-ffa1-49d8-a17e-c5b3a3c999dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:33.329107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a3c7e-ffa1-49d8-a17e-c5b3a3c999dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:33.330777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a3c7e-ffa1-49d8-a17e-c5b3a3c999dd service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:33.353575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff3dd6-cc1e-418b-ac84-6bce9d17a7ad None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:33.354041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff3dd6-cc1e-418b-ac84-6bce9d17a7ad None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:33.355684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff3dd6-cc1e-418b-ac84-6bce9d17a7ad None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:33.361918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 814/1640] 10.222.0.124 () {54 vars in 917 bytes} [Mon Aug 1 16:53:33 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:53:33.362146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 827/1641] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:33 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:53:33.384920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cf8e7-d024-4105-9896-cf9a526fbc5c None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:33.385314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cf8e7-d024-4105-9896-cf9a526fbc5c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:33.385596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cf8e7-d024-4105-9896-cf9a526fbc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:33.447063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ec4cf8e7-d024-4105-9896-cf9a526fbc5c None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:33.450977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ec4cf8e7-d024-4105-9896-cf9a526fbc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:33.477121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 815/1642] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:53:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:33.487821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a3c7e-ffa1-49d8-a17e-c5b3a3c999dd service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:33.503771 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a3c7e-ffa1-49d8-a17e-c5b3a3c999dd service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:33.515228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435fc02-4ad1-415d-bb2f-636a0306adc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:33.516279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fc02-4ad1-415d-bb2f-636a0306adc5 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:33.516778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fc02-4ad1-415d-bb2f-636a0306adc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:33.517254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fc02-4ad1-415d-bb2f-636a0306adc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:33.536337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435fc02-4ad1-415d-bb2f-636a0306adc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:33.544314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435fc02-4ad1-415d-bb2f-636a0306adc5 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:33.579030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 828/1643] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:33.642526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cf8e7-d024-4105-9896-cf9a526fbc5c None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:33.659028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cf8e7-d024-4105-9896-cf9a526fbc5c None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:33.667336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe93e-0fcb-409d-93e0-fd61d04a1aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:33.669429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe93e-0fcb-409d-93e0-fd61d04a1aec service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:33.669889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe93e-0fcb-409d-93e0-fd61d04a1aec service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:33.670384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe93e-0fcb-409d-93e0-fd61d04a1aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:33.703073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe93e-0fcb-409d-93e0-fd61d04a1aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:33.705512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe93e-0fcb-409d-93e0-fd61d04a1aec service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:33.732168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 816/1644] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:34.372363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435fc02-4ad1-415d-bb2f-636a0306adc5 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:34.467710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe93e-0fcb-409d-93e0-fd61d04a1aec service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:34.610093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435fc02-4ad1-415d-bb2f-636a0306adc5 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:34.619907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f291f32-6fc9-400c-8c39-e9cf9d258a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:34.620600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f291f32-6fc9-400c-8c39-e9cf9d258a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:34.620878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f291f32-6fc9-400c-8c39-e9cf9d258a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:34.621148 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f291f32-6fc9-400c-8c39-e9cf9d258a45 admin admin] PATH_INFO: `/v3/users/1971dc5053ec46229e7b37b1f39143da` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:34.622629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f291f32-6fc9-400c-8c39-e9cf9d258a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1971dc5053ec46229e7b37b1f39143da)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:34.625400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f291f32-6fc9-400c-8c39-e9cf9d258a45 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:34.645315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:34.754773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe93e-0fcb-409d-93e0-fd61d04a1aec service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:34.783561 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:34.784470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:34.785224 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:34.788056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] PATH_INFO: `/v3/users/5d24d2ae92ae490da4d250aac2e060c0` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:34.796037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d24d2ae92ae490da4d250aac2e060c0)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:34.799593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: WARNING py.warnings [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:53:34.799593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: warnings.warn(msg) Aug 01 16:53:34.799593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: Aug 01 16:53:34.801444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:34.815904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-9f291f32-6fc9-400c-8c39-e9cf9d258a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1971dc5053ec46229e7b37b1f39143da'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:34.837506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-9f291f32-6fc9-400c-8c39-e9cf9d258a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1971dc5053ec46229e7b37b1f39143da'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:34.853143 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-9f291f32-6fc9-400c-8c39-e9cf9d258a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1971dc5053ec46229e7b37b1f39143da'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:34.854989 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-9f291f32-6fc9-400c-8c39-e9cf9d258a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1971dc5053ec46229e7b37b1f39143da'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:34.857685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-9f291f32-6fc9-400c-8c39-e9cf9d258a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1971dc5053ec46229e7b37b1f39143da'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:34.915426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 829/1645] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:53:34 2022] DELETE /identity/v3/users/1971dc5053ec46229e7b37b1f39143da => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:34.918475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fce6-a255-4a91-bd27-ecd30ee45ea6 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:34.918889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fce6-a255-4a91-bd27-ecd30ee45ea6 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:34.919289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fce6-a255-4a91-bd27-ecd30ee45ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:35.028004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-aa58fce6-a255-4a91-bd27-ecd30ee45ea6 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:35.033031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-aa58fce6-a255-4a91-bd27-ecd30ee45ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:35.118775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d24d2ae92ae490da4d250aac2e060c0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:35.120552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d24d2ae92ae490da4d250aac2e060c0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:35.205627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d24d2ae92ae490da4d250aac2e060c0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:35.206762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d24d2ae92ae490da4d250aac2e060c0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:35.255538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d24d2ae92ae490da4d250aac2e060c0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:35.280403 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:35.287301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 830/1646] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:35.300303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 817/1647] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:53:34 2022] DELETE /identity/v3/users/5d24d2ae92ae490da4d250aac2e060c0 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:35.306149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec33b-9754-4c3e-9472-3003cd634325 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:35.306853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec33b-9754-4c3e-9472-3003cd634325 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:35.307794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec33b-9754-4c3e-9472-3003cd634325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:35.341011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-9ecec33b-9754-4c3e-9472-3003cd634325 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:35.342700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9ecec33b-9754-4c3e-9472-3003cd634325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:35.350083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:35.355138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:35.539459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 831/1648] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:35.553107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ee525-ac0f-43f9-9701-8e90e2346a82 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:35.564032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2cbd-8c95-45d2-9078-1faa6602503b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:35.564665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2cbd-8c95-45d2-9078-1faa6602503b service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:35.564947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2cbd-8c95-45d2-9078-1faa6602503b service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:35.565224 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2cbd-8c95-45d2-9078-1faa6602503b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:35.592280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2cbd-8c95-45d2-9078-1faa6602503b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:35.593763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2cbd-8c95-45d2-9078-1faa6602503b service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:35.619547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 818/1649] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:53:35.630714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec33b-9754-4c3e-9472-3003cd634325 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:35.691186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec33b-9754-4c3e-9472-3003cd634325 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:35.746574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba2c8e-0a84-482a-b4ba-e676799daa0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:35.747839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba2c8e-0a84-482a-b4ba-e676799daa0a service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:35.748352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba2c8e-0a84-482a-b4ba-e676799daa0a service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:35.748854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba2c8e-0a84-482a-b4ba-e676799daa0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:35.822524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba2c8e-0a84-482a-b4ba-e676799daa0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:35.825984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba2c8e-0a84-482a-b4ba-e676799daa0a service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:35.885116 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 832/1650] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:36.686776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c099f-a902-4ea1-93df-40b37d0f9f80 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:36.687508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c099f-a902-4ea1-93df-40b37d0f9f80 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:36.687508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c099f-a902-4ea1-93df-40b37d0f9f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:36.761717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f39c099f-a902-4ea1-93df-40b37d0f9f80 None None] MFA Rules not processed for user `36ab34b69abc4a8dbe7bb0a40ad768b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:36.763181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f39c099f-a902-4ea1-93df-40b37d0f9f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:36.863743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 819/1651] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:36.882272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba2c8e-0a84-482a-b4ba-e676799daa0a service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:36.884067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f8ba2c8e-0a84-482a-b4ba-e676799daa0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:36.926144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:37.082729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba2c8e-0a84-482a-b4ba-e676799daa0a service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:37.095929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174a945-db0b-4689-b0bf-74f0ce244c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:37.096703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a945-db0b-4689-b0bf-74f0ce244c6d service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:37.096986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a945-db0b-4689-b0bf-74f0ce244c6d service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:37.097414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174a945-db0b-4689-b0bf-74f0ce244c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:37.120741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174a945-db0b-4689-b0bf-74f0ce244c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:37.122565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174a945-db0b-4689-b0bf-74f0ce244c6d service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:37.142030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 833/1652] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:37.662026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c099f-a902-4ea1-93df-40b37d0f9f80 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:37.665439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f39c099f-a902-4ea1-93df-40b37d0f9f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:37.697481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c099f-a902-4ea1-93df-40b37d0f9f80 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:37.704056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174a945-db0b-4689-b0bf-74f0ce244c6d service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:37.705764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f174a945-db0b-4689-b0bf-74f0ce244c6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:37.714435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:37.715149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:37.715430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:37.715703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] PATH_INFO: `/v3/projects/86eb85ae29bd4fff8d2a52a188dbf391` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:37.719601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86eb85ae29bd4fff8d2a52a188dbf391)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:37.747313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:37.751556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174a945-db0b-4689-b0bf-74f0ce244c6d service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:37.779607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:37.782334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:37.782593 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:37.782875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] PATH_INFO: `/v3/projects/9a6b68f77a3d4e51aef9d943010ce062` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:37.791603 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6b68f77a3d4e51aef9d943010ce062)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:37.798845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: WARNING py.warnings [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:53:37.798845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: warnings.warn(msg) Aug 01 16:53:37.798845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: Aug 01 16:53:37.800177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:37.899800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86eb85ae29bd4fff8d2a52a188dbf391', 'request_id': 'req-d563c688-cf86-47a3-9949-0e967e5ace37'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:37.909511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86eb85ae29bd4fff8d2a52a188dbf391', 'request_id': 'req-d563c688-cf86-47a3-9949-0e967e5ace37'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:37.918037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86eb85ae29bd4fff8d2a52a188dbf391', 'request_id': 'req-d563c688-cf86-47a3-9949-0e967e5ace37'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:37.951813 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] The token cache is being invalidate because project 86eb85ae29bd4fff8d2a52a188dbf391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:53:37.953169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:37.955222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:37.962295 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 820/1653] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:53:37 2022] DELETE /identity/v3/projects/86eb85ae29bd4fff8d2a52a188dbf391 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:37.964603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:37.967878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:37.990077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6b68f77a3d4e51aef9d943010ce062', 'request_id': 'req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:38.006505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:38.011482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6b68f77a3d4e51aef9d943010ce062', 'request_id': 'req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:38.028481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6b68f77a3d4e51aef9d943010ce062', 'request_id': 'req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:38.091189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] The token cache is being invalidate because project 9a6b68f77a3d4e51aef9d943010ce062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:53:38.091380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:38.092736 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6cdf14eb-fc34-4e74-8820-d3e48a82e2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:38.098350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 834/1654] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:53:37 2022] DELETE /identity/v3/projects/9a6b68f77a3d4e51aef9d943010ce062 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:53:38.105648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50450351-62c2-4651-add4-81e3b1c5bb82 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:38.107166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50450351-62c2-4651-add4-81e3b1c5bb82 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:38.109259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50450351-62c2-4651-add4-81e3b1c5bb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:38.159962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563c688-cf86-47a3-9949-0e967e5ace37 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:38.177218 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-50450351-62c2-4651-add4-81e3b1c5bb82 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:38.197459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-50450351-62c2-4651-add4-81e3b1c5bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:38.356899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:38.357920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:38.357920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:38.358103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] PATH_INFO: `/v3/users/9094ad864f7d4328b84239dee8959873` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:38.359846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9094ad864f7d4328b84239dee8959873)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:38.361692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:38.416816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 835/1655] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:38.426169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579e466-8960-453e-bcca-b311ab696101 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:38.426534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579e466-8960-453e-bcca-b311ab696101 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:38.426883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579e466-8960-453e-bcca-b311ab696101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:38.499912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9094ad864f7d4328b84239dee8959873'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:38.504771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9094ad864f7d4328b84239dee8959873'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:38.510712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-5579e466-8960-453e-bcca-b311ab696101 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:38.513666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5579e466-8960-453e-bcca-b311ab696101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:38.528786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9094ad864f7d4328b84239dee8959873'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:38.529530 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9094ad864f7d4328b84239dee8959873'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:38.540244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 836/1656] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:38.545122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579e466-8960-453e-bcca-b311ab696101 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:38.549088 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9094ad864f7d4328b84239dee8959873'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:38.560014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579e466-8960-453e-bcca-b311ab696101 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:38.569863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 821/1657] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:53:37 2022] DELETE /identity/v3/users/9094ad864f7d4328b84239dee8959873 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:38.583222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af42688-fe71-4e10-9405-81c18a56b9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:38.584040 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af42688-fe71-4e10-9405-81c18a56b9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:38.584322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af42688-fe71-4e10-9405-81c18a56b9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:38.586184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af42688-fe71-4e10-9405-81c18a56b9c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:38.587043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af42688-fe71-4e10-9405-81c18a56b9c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:38.587453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af42688-fe71-4e10-9405-81c18a56b9c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:38.589583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af42688-fe71-4e10-9405-81c18a56b9c6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:38.620113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:38.634720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:38.636018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 837/1658] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:53:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:53:38.636167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:38.761896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:38.815602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a7c9-e433-4e45-a0bd-9062e8d2408f admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:38.826036 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae553f3-a984-4f05-9653-69739df1b57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:38.833926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae553f3-a984-4f05-9653-69739df1b57e admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:38.834326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae553f3-a984-4f05-9653-69739df1b57e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:38.835180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae553f3-a984-4f05-9653-69739df1b57e admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:38.836097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae553f3-a984-4f05-9653-69739df1b57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:38.839714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae553f3-a984-4f05-9653-69739df1b57e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:38.917554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af42688-fe71-4e10-9405-81c18a56b9c6 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:38.941007 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 822/1659] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:38 2022] POST /identity/v3/projects => generated 378 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:38.944360 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af42688-fe71-4e10-9405-81c18a56b9c6 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:39.052679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac4f7d-034e-413c-afb2-5b5f9ce41097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:39.054328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4f7d-034e-413c-afb2-5b5f9ce41097 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:39.054885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4f7d-034e-413c-afb2-5b5f9ce41097 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:39.055357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4f7d-034e-413c-afb2-5b5f9ce41097 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:39.056638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac4f7d-034e-413c-afb2-5b5f9ce41097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:39.065503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac4f7d-034e-413c-afb2-5b5f9ce41097 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:39.108522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae553f3-a984-4f05-9653-69739df1b57e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:39.123089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 838/1660] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:38 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:39.125119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae553f3-a984-4f05-9653-69739df1b57e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:39.131053 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386dc641-f3e0-4685-b897-bd282541e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:39.131856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dc641-f3e0-4685-b897-bd282541e958 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:39.132138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dc641-f3e0-4685-b897-bd282541e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:39.132410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dc641-f3e0-4685-b897-bd282541e958 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:39.133229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386dc641-f3e0-4685-b897-bd282541e958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:39.135039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386dc641-f3e0-4685-b897-bd282541e958 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:39.159438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac4f7d-034e-413c-afb2-5b5f9ce41097 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:39.186795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 823/1661] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:39 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:39.191638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac4f7d-034e-413c-afb2-5b5f9ce41097 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:39.198502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c206c41-3112-4d3d-8e97-2076a2b887e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:39.199479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c206c41-3112-4d3d-8e97-2076a2b887e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:39.200308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c206c41-3112-4d3d-8e97-2076a2b887e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:39.201146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c206c41-3112-4d3d-8e97-2076a2b887e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:39.202099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c206c41-3112-4d3d-8e97-2076a2b887e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:39.203995 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c206c41-3112-4d3d-8e97-2076a2b887e8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:39.229380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 839/1662] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:39 2022] GET /identity/v3/roles => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:53:39.229560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386dc641-f3e0-4685-b897-bd282541e958 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:39.249751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386dc641-f3e0-4685-b897-bd282541e958 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:39.271183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e35df9-b5cb-4541-a9fd-e3621cdadae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:39.271902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e35df9-b5cb-4541-a9fd-e3621cdadae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:39.272185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e35df9-b5cb-4541-a9fd-e3621cdadae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:39.272464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e35df9-b5cb-4541-a9fd-e3621cdadae7 admin admin] PATH_INFO: `/v3/projects/3f020f33476c4a5791c238298b68ab92/users/488d882b31d6445c817380c2fd5bf572/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:39.310181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e35df9-b5cb-4541-a9fd-e3621cdadae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f020f33476c4a5791c238298b68ab92, user_id=488d882b31d6445c817380c2fd5bf572, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:39.313624 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e35df9-b5cb-4541-a9fd-e3621cdadae7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:39.346519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 824/1663] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:39 2022] PUT /identity/v3/projects/3f020f33476c4a5791c238298b68ab92/users/488d882b31d6445c817380c2fd5bf572/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:39.360920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc494f-7cff-4c9a-94ec-3827ed65daca None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:39.361234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc494f-7cff-4c9a-94ec-3827ed65daca None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:39.361492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc494f-7cff-4c9a-94ec-3827ed65daca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:39.402409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-0ecc494f-7cff-4c9a-94ec-3827ed65daca None None] MFA Rules not processed for user `488d882b31d6445c817380c2fd5bf572`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:39.403768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0ecc494f-7cff-4c9a-94ec-3827ed65daca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:39.506361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 840/1664] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:39.507324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e35df9-b5cb-4541-a9fd-e3621cdadae7 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:39.653520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e35df9-b5cb-4541-a9fd-e3621cdadae7 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:39.683235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92412de-c9fb-4a3c-b8a3-69855c3284f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:39.683975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92412de-c9fb-4a3c-b8a3-69855c3284f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:39.684178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92412de-c9fb-4a3c-b8a3-69855c3284f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:39.685061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92412de-c9fb-4a3c-b8a3-69855c3284f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:39.685337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92412de-c9fb-4a3c-b8a3-69855c3284f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:39.689192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92412de-c9fb-4a3c-b8a3-69855c3284f6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:39.763704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 825/1665] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:39 2022] POST /identity/v3/projects => generated 376 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:53:39.766370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc494f-7cff-4c9a-94ec-3827ed65daca None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:39.788045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc494f-7cff-4c9a-94ec-3827ed65daca None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:39.959375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce403996-2ecc-4671-bc0c-1b7a53508ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:39.960370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce403996-2ecc-4671-bc0c-1b7a53508ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:39.960652 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce403996-2ecc-4671-bc0c-1b7a53508ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:39.961223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce403996-2ecc-4671-bc0c-1b7a53508ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:39.968222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce403996-2ecc-4671-bc0c-1b7a53508ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:39.976935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce403996-2ecc-4671-bc0c-1b7a53508ec7 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:40.017426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:40.029187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 841/1666] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:39 2022] POST /identity/v3/users => generated 295 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:40.033038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92412de-c9fb-4a3c-b8a3-69855c3284f6 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:40.048005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92412de-c9fb-4a3c-b8a3-69855c3284f6 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:40.060264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0a8af-8f14-4346-8c24-af6f6f204687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:40.061136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0a8af-8f14-4346-8c24-af6f6f204687 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:40.061550 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0a8af-8f14-4346-8c24-af6f6f204687 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:40.061966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0a8af-8f14-4346-8c24-af6f6f204687 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:40.063174 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0a8af-8f14-4346-8c24-af6f6f204687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:40.065897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0a8af-8f14-4346-8c24-af6f6f204687 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:40.082870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 826/1667] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:40 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:40.086121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce403996-2ecc-4671-bc0c-1b7a53508ec7 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:40.102814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce403996-2ecc-4671-bc0c-1b7a53508ec7 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:40.116950 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f126a2-600a-4c4e-ac8d-e98286bd6d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:40.117970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f126a2-600a-4c4e-ac8d-e98286bd6d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:40.118572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f126a2-600a-4c4e-ac8d-e98286bd6d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:40.119006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f126a2-600a-4c4e-ac8d-e98286bd6d56 admin admin] PATH_INFO: `/v3/projects/ff20eb03896c48f788208c4af8912588/users/9a0202542ac4408da9ee8a566dd14755/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:40.138182 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f126a2-600a-4c4e-ac8d-e98286bd6d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff20eb03896c48f788208c4af8912588, user_id=9a0202542ac4408da9ee8a566dd14755, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:40.143397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f126a2-600a-4c4e-ac8d-e98286bd6d56 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:40.163472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 842/1668] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:40 2022] PUT /identity/v3/projects/ff20eb03896c48f788208c4af8912588/users/9a0202542ac4408da9ee8a566dd14755/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:40.168219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0a8af-8f14-4346-8c24-af6f6f204687 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:40.180241 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0a8af-8f14-4346-8c24-af6f6f204687 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:40.266610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fcedb-b185-48aa-81ee-210de7b3b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:40.267535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fcedb-b185-48aa-81ee-210de7b3b8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:40.267950 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fcedb-b185-48aa-81ee-210de7b3b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:40.268823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fcedb-b185-48aa-81ee-210de7b3b8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:40.269711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fcedb-b185-48aa-81ee-210de7b3b8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:40.272585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fcedb-b185-48aa-81ee-210de7b3b8c5 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:40.279899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:40.290991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f126a2-600a-4c4e-ac8d-e98286bd6d56 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:40.293868 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 827/1669] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:40 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:40.311093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f126a2-600a-4c4e-ac8d-e98286bd6d56 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:40.323384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4e734-8028-410a-b040-92a81f169af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:40.324103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4e734-8028-410a-b040-92a81f169af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:40.324379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4e734-8028-410a-b040-92a81f169af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:40.324653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4e734-8028-410a-b040-92a81f169af5 admin admin] PATH_INFO: `/v3/projects/ff20eb03896c48f788208c4af8912588/users/9a0202542ac4408da9ee8a566dd14755/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:40.327217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4e734-8028-410a-b040-92a81f169af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff20eb03896c48f788208c4af8912588, user_id=9a0202542ac4408da9ee8a566dd14755, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:40.330309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4e734-8028-410a-b040-92a81f169af5 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:40.365317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 843/1670] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:40 2022] PUT /identity/v3/projects/ff20eb03896c48f788208c4af8912588/users/9a0202542ac4408da9ee8a566dd14755/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:40.369042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c8c8-e484-4bfc-8d58-05d2e2e9c22d None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:40.369042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c8c8-e484-4bfc-8d58-05d2e2e9c22d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:40.369042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c8c8-e484-4bfc-8d58-05d2e2e9c22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:40.426576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4e734-8028-410a-b040-92a81f169af5 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:40.438941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-eea4e734-8028-410a-b040-92a81f169af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:40.485282 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-62b4c8c8-e484-4bfc-8d58-05d2e2e9c22d None None] MFA Rules not processed for user `9a0202542ac4408da9ee8a566dd14755`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:40.493287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-62b4c8c8-e484-4bfc-8d58-05d2e2e9c22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:40.703000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 828/1671] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:40.703201 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4e734-8028-410a-b040-92a81f169af5 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:40.715474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4c8c8-e484-4bfc-8d58-05d2e2e9c22d None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:40.717232 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-62b4c8c8-e484-4bfc-8d58-05d2e2e9c22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:40.728106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:40.728968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:40.729264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:40.729547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] PATH_INFO: `/v3/projects/fd75bba8b4424b9cbac75506ceb5c538` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:40.734643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd75bba8b4424b9cbac75506ceb5c538)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:40.738821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:40.809627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4c8c8-e484-4bfc-8d58-05d2e2e9c22d None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:40.821719 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5388892-5ec2-4a0f-9117-071d647b62ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:40.822824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388892-5ec2-4a0f-9117-071d647b62ba service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:40.823417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388892-5ec2-4a0f-9117-071d647b62ba service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:40.824202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388892-5ec2-4a0f-9117-071d647b62ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:40.858521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd75bba8b4424b9cbac75506ceb5c538', 'request_id': 'req-874c064a-ef7f-48f9-bef2-11e133814285'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:40.874225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd75bba8b4424b9cbac75506ceb5c538', 'request_id': 'req-874c064a-ef7f-48f9-bef2-11e133814285'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:40.882746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd75bba8b4424b9cbac75506ceb5c538', 'request_id': 'req-874c064a-ef7f-48f9-bef2-11e133814285'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:40.922255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] The token cache is being invalidate because project fd75bba8b4424b9cbac75506ceb5c538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:53:40.922761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:40.924901 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-874c064a-ef7f-48f9-bef2-11e133814285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:40.931698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 844/1672] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:53:40 2022] DELETE /identity/v3/projects/fd75bba8b4424b9cbac75506ceb5c538 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:40.934452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420176c3-d7d9-4a2a-96b4-a5ae018c67f5 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:40.934797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420176c3-d7d9-4a2a-96b4-a5ae018c67f5 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:40.935106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420176c3-d7d9-4a2a-96b4-a5ae018c67f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:40.980969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-420176c3-d7d9-4a2a-96b4-a5ae018c67f5 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:40.982292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-420176c3-d7d9-4a2a-96b4-a5ae018c67f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:41.071875 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5388892-5ec2-4a0f-9117-071d647b62ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:41.087258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5388892-5ec2-4a0f-9117-071d647b62ba service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:41.139478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:41.178722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 829/1673] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:41.199388 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 845/1674] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:41.208534 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3faa1-e8d1-456e-86c5-004cee318ef8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:41.208769 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3faa1-e8d1-456e-86c5-004cee318ef8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:41.215463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3faa1-e8d1-456e-86c5-004cee318ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:41.281795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-c8e3faa1-e8d1-456e-86c5-004cee318ef8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:41.281795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c8e3faa1-e8d1-456e-86c5-004cee318ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:41.318472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 830/1675] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:41.323014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420176c3-d7d9-4a2a-96b4-a5ae018c67f5 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:41.348121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420176c3-d7d9-4a2a-96b4-a5ae018c67f5 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:41.366601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117ed8b-2733-4be7-b280-9bec0800de89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:41.367699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117ed8b-2733-4be7-b280-9bec0800de89 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:41.368378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117ed8b-2733-4be7-b280-9bec0800de89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:41.373926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117ed8b-2733-4be7-b280-9bec0800de89 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:41.375969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117ed8b-2733-4be7-b280-9bec0800de89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:41.377019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117ed8b-2733-4be7-b280-9bec0800de89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:41.381125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117ed8b-2733-4be7-b280-9bec0800de89 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:41.443334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 846/1676] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:53:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:41.444137 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3faa1-e8d1-456e-86c5-004cee318ef8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:41.460893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3faa1-e8d1-456e-86c5-004cee318ef8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:41.478673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54d111-608c-4e09-b840-f71bebb9914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:41.479924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d111-608c-4e09-b840-f71bebb9914f admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:41.480390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d111-608c-4e09-b840-f71bebb9914f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:41.481973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d111-608c-4e09-b840-f71bebb9914f admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:41.483209 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54d111-608c-4e09-b840-f71bebb9914f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:41.487255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54d111-608c-4e09-b840-f71bebb9914f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:41.561368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 831/1677] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:41 2022] POST /identity/v3/projects => generated 364 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:53:41.565723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117ed8b-2733-4be7-b280-9bec0800de89 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:41.581534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117ed8b-2733-4be7-b280-9bec0800de89 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:41.748242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1db8e-4f6a-46d4-8916-b353132efb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:41.748242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1db8e-4f6a-46d4-8916-b353132efb5d admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:41.748242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1db8e-4f6a-46d4-8916-b353132efb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:41.748242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1db8e-4f6a-46d4-8916-b353132efb5d admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:41.748528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1db8e-4f6a-46d4-8916-b353132efb5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:41.748528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1db8e-4f6a-46d4-8916-b353132efb5d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:41.798677 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 847/1678] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:41 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:41.802711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54d111-608c-4e09-b840-f71bebb9914f admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:41.839953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54d111-608c-4e09-b840-f71bebb9914f admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:41.848156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056d782-6bc9-4135-b592-a5e75b1f195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:41.848866 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056d782-6bc9-4135-b592-a5e75b1f195e admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:41.849153 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056d782-6bc9-4135-b592-a5e75b1f195e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:41.851044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056d782-6bc9-4135-b592-a5e75b1f195e admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:41.855667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056d782-6bc9-4135-b592-a5e75b1f195e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:41.862461 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056d782-6bc9-4135-b592-a5e75b1f195e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:41.897200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:41.942491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 832/1679] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:41 2022] GET /identity/v3/roles => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:41.947173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1db8e-4f6a-46d4-8916-b353132efb5d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:41.964814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1db8e-4f6a-46d4-8916-b353132efb5d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:41.979580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db624aa-0bfa-4cf1-82b9-9db5ea86c61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:41.980525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db624aa-0bfa-4cf1-82b9-9db5ea86c61a admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:41.982629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db624aa-0bfa-4cf1-82b9-9db5ea86c61a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:41.982999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db624aa-0bfa-4cf1-82b9-9db5ea86c61a admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:41.983902 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db624aa-0bfa-4cf1-82b9-9db5ea86c61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:41.985715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db624aa-0bfa-4cf1-82b9-9db5ea86c61a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:42.027523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 848/1680] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:41 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:42.029468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056d782-6bc9-4135-b592-a5e75b1f195e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:42.048592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056d782-6bc9-4135-b592-a5e75b1f195e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:42.058465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a1e2b-4025-49dd-b6f7-2fb4f53f41b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:42.059366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1e2b-4025-49dd-b6f7-2fb4f53f41b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:42.059747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1e2b-4025-49dd-b6f7-2fb4f53f41b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:42.060157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1e2b-4025-49dd-b6f7-2fb4f53f41b4 admin admin] PATH_INFO: `/v3/projects/5d6cc4bd9ede4fad818e7511a75d9438/users/60574f322c2b4f7cb4913c970646127d/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:42.096664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a1e2b-4025-49dd-b6f7-2fb4f53f41b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6cc4bd9ede4fad818e7511a75d9438, user_id=60574f322c2b4f7cb4913c970646127d, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:42.099819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a1e2b-4025-49dd-b6f7-2fb4f53f41b4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:42.140892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 833/1681] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:42 2022] PUT /identity/v3/projects/5d6cc4bd9ede4fad818e7511a75d9438/users/60574f322c2b4f7cb4913c970646127d/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:42.151944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58565e-9c8d-4ff3-ae60-fbd99b17cd63 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:42.152562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58565e-9c8d-4ff3-ae60-fbd99b17cd63 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:42.152750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58565e-9c8d-4ff3-ae60-fbd99b17cd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:42.201489 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-6d58565e-9c8d-4ff3-ae60-fbd99b17cd63 None None] MFA Rules not processed for user `60574f322c2b4f7cb4913c970646127d`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:42.202972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6d58565e-9c8d-4ff3-ae60-fbd99b17cd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:42.331945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 849/1682] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:42.333710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a1e2b-4025-49dd-b6f7-2fb4f53f41b4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:42.489388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a1e2b-4025-49dd-b6f7-2fb4f53f41b4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:42.524222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9fa2a-80e8-4813-a168-e00e39262cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:42.524918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9fa2a-80e8-4813-a168-e00e39262cbf admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:42.525164 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9fa2a-80e8-4813-a168-e00e39262cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:42.525443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9fa2a-80e8-4813-a168-e00e39262cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:42.530297 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9fa2a-80e8-4813-a168-e00e39262cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:42.540287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9fa2a-80e8-4813-a168-e00e39262cbf admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:42.622000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 834/1683] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:42 2022] POST /identity/v3/projects => generated 366 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:42.623857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58565e-9c8d-4ff3-ae60-fbd99b17cd63 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:42.640464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58565e-9c8d-4ff3-ae60-fbd99b17cd63 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:42.771126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:42.801708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f9f4e-f396-4325-8aab-76b621b3ac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:42.803510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9f4e-f396-4325-8aab-76b621b3ac42 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:42.803812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9f4e-f396-4325-8aab-76b621b3ac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:42.804109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9f4e-f396-4325-8aab-76b621b3ac42 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:42.804792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f9f4e-f396-4325-8aab-76b621b3ac42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:42.809846 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f9f4e-f396-4325-8aab-76b621b3ac42 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:42.857699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 850/1684] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:42 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:42.861704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9fa2a-80e8-4813-a168-e00e39262cbf admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:42.875569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9fa2a-80e8-4813-a168-e00e39262cbf admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:42.888205 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07b28-4d23-44f7-b786-d002cac27fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:42.888900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07b28-4d23-44f7-b786-d002cac27fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:42.889184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07b28-4d23-44f7-b786-d002cac27fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:42.889499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07b28-4d23-44f7-b786-d002cac27fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:42.890411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d07b28-4d23-44f7-b786-d002cac27fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:42.892081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d07b28-4d23-44f7-b786-d002cac27fb7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:42.918512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 835/1685] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:42 2022] GET /identity/v3/roles => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:42.922869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f9f4e-f396-4325-8aab-76b621b3ac42 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:42.937636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f9f4e-f396-4325-8aab-76b621b3ac42 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:42.962649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520afb3-b7c7-4e5d-abc6-288a7dcb07e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:42.967028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520afb3-b7c7-4e5d-abc6-288a7dcb07e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:42.967281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520afb3-b7c7-4e5d-abc6-288a7dcb07e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:42.967563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520afb3-b7c7-4e5d-abc6-288a7dcb07e0 admin admin] PATH_INFO: `/v3/projects/54a2135234214bbcba074a5f7dce4fdf/users/ebe525da81574dd98c525c20b0e42fa6/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:43.043932 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520afb3-b7c7-4e5d-abc6-288a7dcb07e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a2135234214bbcba074a5f7dce4fdf, user_id=ebe525da81574dd98c525c20b0e42fa6, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:43.049583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520afb3-b7c7-4e5d-abc6-288a7dcb07e0 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:43.114602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 851/1686] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:42 2022] PUT /identity/v3/projects/54a2135234214bbcba074a5f7dce4fdf/users/ebe525da81574dd98c525c20b0e42fa6/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:53:43.118836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07b28-4d23-44f7-b786-d002cac27fb7 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:43.138409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520afb3-b7c7-4e5d-abc6-288a7dcb07e0 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:43.139802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07b28-4d23-44f7-b786-d002cac27fb7 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:43.140664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8520afb3-b7c7-4e5d-abc6-288a7dcb07e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:43.298929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f42d6d-50fd-40c1-9605-aebbcb6e40bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:43.300645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f42d6d-50fd-40c1-9605-aebbcb6e40bf admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:43.301556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f42d6d-50fd-40c1-9605-aebbcb6e40bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:43.302826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f42d6d-50fd-40c1-9605-aebbcb6e40bf admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:43.304479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f42d6d-50fd-40c1-9605-aebbcb6e40bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:43.309611 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f42d6d-50fd-40c1-9605-aebbcb6e40bf admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:43.338851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520afb3-b7c7-4e5d-abc6-288a7dcb07e0 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:43.346000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 836/1687] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:43 2022] GET /identity/v3/roles => generated 1427 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:43.346186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb106ce-d6ea-43a9-bc24-84ab3c60ffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:43.346757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb106ce-d6ea-43a9-bc24-84ab3c60ffe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:43.347074 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb106ce-d6ea-43a9-bc24-84ab3c60ffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:43.347358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb106ce-d6ea-43a9-bc24-84ab3c60ffe2 admin admin] PATH_INFO: `/v3/users/05a831f4e1dd406bbd0713c675432fcb` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:43.348320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f42d6d-50fd-40c1-9605-aebbcb6e40bf admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:43.353563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb106ce-d6ea-43a9-bc24-84ab3c60ffe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a831f4e1dd406bbd0713c675432fcb)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:43.367026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb106ce-d6ea-43a9-bc24-84ab3c60ffe2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:43.373807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f42d6d-50fd-40c1-9605-aebbcb6e40bf admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:43.387795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d459430-7c63-4edf-8e39-427da75f146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:43.388743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d459430-7c63-4edf-8e39-427da75f146a admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:43.389158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d459430-7c63-4edf-8e39-427da75f146a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:43.389566 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d459430-7c63-4edf-8e39-427da75f146a admin admin] PATH_INFO: `/v3/projects/54a2135234214bbcba074a5f7dce4fdf/users/ebe525da81574dd98c525c20b0e42fa6/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:43.394801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d459430-7c63-4edf-8e39-427da75f146a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a2135234214bbcba074a5f7dce4fdf, user_id=ebe525da81574dd98c525c20b0e42fa6, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:43.398530 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d459430-7c63-4edf-8e39-427da75f146a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:43.421128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 837/1688] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:43 2022] PUT /identity/v3/projects/54a2135234214bbcba074a5f7dce4fdf/users/ebe525da81574dd98c525c20b0e42fa6/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:43.441407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994cfb8-e23f-4d99-8230-ddc8f3ef1880 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:43.441746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994cfb8-e23f-4d99-8230-ddc8f3ef1880 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:43.441964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994cfb8-e23f-4d99-8230-ddc8f3ef1880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:43.527953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a994cfb8-e23f-4d99-8230-ddc8f3ef1880 None None] MFA Rules not processed for user `ebe525da81574dd98c525c20b0e42fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:43.528844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-4bb106ce-d6ea-43a9-bc24-84ab3c60ffe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a831f4e1dd406bbd0713c675432fcb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:43.529791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a994cfb8-e23f-4d99-8230-ddc8f3ef1880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:43.547295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-4bb106ce-d6ea-43a9-bc24-84ab3c60ffe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a831f4e1dd406bbd0713c675432fcb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:43.567269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:43.568858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-4bb106ce-d6ea-43a9-bc24-84ab3c60ffe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a831f4e1dd406bbd0713c675432fcb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:43.569644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-4bb106ce-d6ea-43a9-bc24-84ab3c60ffe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a831f4e1dd406bbd0713c675432fcb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:43.574658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-4bb106ce-d6ea-43a9-bc24-84ab3c60ffe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a831f4e1dd406bbd0713c675432fcb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:43.616221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 852/1689] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:53:43 2022] DELETE /identity/v3/users/05a831f4e1dd406bbd0713c675432fcb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:43.619422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff3403-22a8-41fd-b3f3-3f69c8571cf3 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:43.619422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff3403-22a8-41fd-b3f3-3f69c8571cf3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:43.619422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff3403-22a8-41fd-b3f3-3f69c8571cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:43.707344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-eeff3403-22a8-41fd-b3f3-3f69c8571cf3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:43.709355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-eeff3403-22a8-41fd-b3f3-3f69c8571cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:43.742920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 838/1690] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:43.755482 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994cfb8-e23f-4d99-8230-ddc8f3ef1880 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:43.758065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a994cfb8-e23f-4d99-8230-ddc8f3ef1880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:43.814113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:43.941135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 853/1691] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:43.978768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff3403-22a8-41fd-b3f3-3f69c8571cf3 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:43.981061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-eeff3403-22a8-41fd-b3f3-3f69c8571cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:43.995197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994cfb8-e23f-4d99-8230-ddc8f3ef1880 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:44.133673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c67dd9-c2b0-41f2-ae01-37d8abc4465a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:44.134173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c67dd9-c2b0-41f2-ae01-37d8abc4465a service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:44.135132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c67dd9-c2b0-41f2-ae01-37d8abc4465a service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:44.135416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c67dd9-c2b0-41f2-ae01-37d8abc4465a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:44.137421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff3403-22a8-41fd-b3f3-3f69c8571cf3 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:44.145287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02f68e-6b90-4f1b-9908-7cf3e4f12601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:44.148697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02f68e-6b90-4f1b-9908-7cf3e4f12601 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:44.148697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02f68e-6b90-4f1b-9908-7cf3e4f12601 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:44.148697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02f68e-6b90-4f1b-9908-7cf3e4f12601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:44.174146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02f68e-6b90-4f1b-9908-7cf3e4f12601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:44.177813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02f68e-6b90-4f1b-9908-7cf3e4f12601 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:44.204601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 854/1692] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:44.259283 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c67dd9-c2b0-41f2-ae01-37d8abc4465a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:44.261497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c67dd9-c2b0-41f2-ae01-37d8abc4465a service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:44.331772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 839/1693] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:53:44.512775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02f68e-6b90-4f1b-9908-7cf3e4f12601 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:44.541478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02f68e-6b90-4f1b-9908-7cf3e4f12601 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:44.557637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cf9d6-ce84-41e6-aab4-ddfeca78d9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:44.559795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cf9d6-ce84-41e6-aab4-ddfeca78d9fb service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:44.561599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cf9d6-ce84-41e6-aab4-ddfeca78d9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:44.562038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cf9d6-ce84-41e6-aab4-ddfeca78d9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:44.569270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-830cf9d6-ce84-41e6-aab4-ddfeca78d9fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:44.717154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c67dd9-c2b0-41f2-ae01-37d8abc4465a service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:44.723479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-81c67dd9-c2b0-41f2-ae01-37d8abc4465a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:44.747982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cf9d6-ce84-41e6-aab4-ddfeca78d9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:44.748587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c67dd9-c2b0-41f2-ae01-37d8abc4465a service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:44.749956 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cf9d6-ce84-41e6-aab4-ddfeca78d9fb service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:44.768946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1f682-de90-4ead-957c-2fa767554a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:44.769897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1f682-de90-4ead-957c-2fa767554a1b service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:44.770321 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1f682-de90-4ead-957c-2fa767554a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:44.770869 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1f682-de90-4ead-957c-2fa767554a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:44.778573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 855/1694] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:44.781151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-07c1f682-de90-4ead-957c-2fa767554a1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:44.858151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:44.962398 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1f682-de90-4ead-957c-2fa767554a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:44.967642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1f682-de90-4ead-957c-2fa767554a1b service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:45.019339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 840/1695] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:46.168199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cf9d6-ce84-41e6-aab4-ddfeca78d9fb service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:46.170317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-830cf9d6-ce84-41e6-aab4-ddfeca78d9fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:46.208061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cf9d6-ce84-41e6-aab4-ddfeca78d9fb service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:46.229964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:46.230729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:46.233729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:46.234019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] PATH_INFO: `/v3/projects/54c72ca6a81f401087f4c9fb722b29ca` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:46.239544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c72ca6a81f401087f4c9fb722b29ca)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:46.248320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:46.415492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c72ca6a81f401087f4c9fb722b29ca', 'request_id': 'req-78ad9297-e0c9-4be8-85fd-279a2339ae77'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:46.443187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c72ca6a81f401087f4c9fb722b29ca', 'request_id': 'req-78ad9297-e0c9-4be8-85fd-279a2339ae77'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:46.454298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c72ca6a81f401087f4c9fb722b29ca', 'request_id': 'req-78ad9297-e0c9-4be8-85fd-279a2339ae77'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:46.458371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:46.480285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] The token cache is being invalidate because project 54c72ca6a81f401087f4c9fb722b29ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:53:46.480794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:46.481940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-78ad9297-e0c9-4be8-85fd-279a2339ae77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:46.489238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 856/1696] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:53:46 2022] DELETE /identity/v3/projects/54c72ca6a81f401087f4c9fb722b29ca => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:46.491632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1659f1e-cf25-4414-b576-4505b9317b1a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:46.492104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1659f1e-cf25-4414-b576-4505b9317b1a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:46.492188 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1659f1e-cf25-4414-b576-4505b9317b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:46.553511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d1659f1e-cf25-4414-b576-4505b9317b1a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:46.565402 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d1659f1e-cf25-4414-b576-4505b9317b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:46.588396 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4d2e-9701-40f6-a38d-ca60af7e11a9 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:46.588686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4d2e-9701-40f6-a38d-ca60af7e11a9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:46.588962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4d2e-9701-40f6-a38d-ca60af7e11a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:46.655189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-22be4d2e-9701-40f6-a38d-ca60af7e11a9 None None] MFA Rules not processed for user `329a85e5f5e9446c80dc45cafd329108`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:46.656513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-22be4d2e-9701-40f6-a38d-ca60af7e11a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:46.733235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 841/1697] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:53:46.741414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ea9de-6adb-451d-b9be-92d21f5bd328 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:46.741908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ea9de-6adb-451d-b9be-92d21f5bd328 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:46.742329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ea9de-6adb-451d-b9be-92d21f5bd328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:46.787462 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a19ea9de-6adb-451d-b9be-92d21f5bd328 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:46.788713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a19ea9de-6adb-451d-b9be-92d21f5bd328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:46.811476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 842/1698] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:46.813264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ea9de-6adb-451d-b9be-92d21f5bd328 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:46.835537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ea9de-6adb-451d-b9be-92d21f5bd328 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:46.847719 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505183e6-d9ea-4703-9b7a-0121d087be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:46.848506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505183e6-d9ea-4703-9b7a-0121d087be79 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:46.848666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505183e6-d9ea-4703-9b7a-0121d087be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:46.848944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505183e6-d9ea-4703-9b7a-0121d087be79 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:46.849675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505183e6-d9ea-4703-9b7a-0121d087be79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:46.850036 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505183e6-d9ea-4703-9b7a-0121d087be79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:46.858503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505183e6-d9ea-4703-9b7a-0121d087be79 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:46.890887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 843/1699] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:53:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:46.900409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505183e6-d9ea-4703-9b7a-0121d087be79 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:46.907267 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 857/1700] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:53:46.920761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505183e6-d9ea-4703-9b7a-0121d087be79 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:46.923186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be4d2e-9701-40f6-a38d-ca60af7e11a9 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:46.925957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-22be4d2e-9701-40f6-a38d-ca60af7e11a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:46.942327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325f052-079f-48f4-905c-42ece5632197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:46.945118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325f052-079f-48f4-905c-42ece5632197 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:46.945578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325f052-079f-48f4-905c-42ece5632197 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:46.948040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325f052-079f-48f4-905c-42ece5632197 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:46.949017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325f052-079f-48f4-905c-42ece5632197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:46.951192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325f052-079f-48f4-905c-42ece5632197 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:47.044727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 844/1701] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:46 2022] POST /identity/v3/projects => generated 388 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:47.048851 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325f052-079f-48f4-905c-42ece5632197 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:47.124643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be4d2e-9701-40f6-a38d-ca60af7e11a9 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:47.241470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325f052-079f-48f4-905c-42ece5632197 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:47.254730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd1aff-f732-4602-8cc6-c0458b481f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:47.256101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1aff-f732-4602-8cc6-c0458b481f20 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:47.257000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1aff-f732-4602-8cc6-c0458b481f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:47.257845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1aff-f732-4602-8cc6-c0458b481f20 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:47.260137 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd1aff-f732-4602-8cc6-c0458b481f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:47.264220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd1aff-f732-4602-8cc6-c0458b481f20 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:47.268776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30add70-e660-44f3-8560-9b92d247b49a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:47.269449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30add70-e660-44f3-8560-9b92d247b49a service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:47.270084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30add70-e660-44f3-8560-9b92d247b49a service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:47.270830 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30add70-e660-44f3-8560-9b92d247b49a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:47.321562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 845/1702] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:47 2022] POST /identity/v3/users => generated 295 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:53:47.325310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd1aff-f732-4602-8cc6-c0458b481f20 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:47.339128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:47.353481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd1aff-f732-4602-8cc6-c0458b481f20 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:47.362747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9ec68-6b0d-4275-aaf6-a74df0969486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:47.364129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9ec68-6b0d-4275-aaf6-a74df0969486 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:47.364617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9ec68-6b0d-4275-aaf6-a74df0969486 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:47.364729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9ec68-6b0d-4275-aaf6-a74df0969486 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:47.365438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9ec68-6b0d-4275-aaf6-a74df0969486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:47.367102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9ec68-6b0d-4275-aaf6-a74df0969486 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:47.368938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:47.388122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 846/1703] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:47 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:47.392753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9ec68-6b0d-4275-aaf6-a74df0969486 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:47.413518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9ec68-6b0d-4275-aaf6-a74df0969486 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:47.418866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30add70-e660-44f3-8560-9b92d247b49a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:47.420521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30add70-e660-44f3-8560-9b92d247b49a service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:47.433807 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 858/1704] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:47.453577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda590d-b4fd-4621-a3e9-c738625a04fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:47.455518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda590d-b4fd-4621-a3e9-c738625a04fb admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:47.455748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda590d-b4fd-4621-a3e9-c738625a04fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:47.455944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda590d-b4fd-4621-a3e9-c738625a04fb admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:47.456734 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda590d-b4fd-4621-a3e9-c738625a04fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:47.458661 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda590d-b4fd-4621-a3e9-c738625a04fb admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:47.501823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 847/1705] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:47 2022] GET /identity/v3/roles => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:47.506006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30add70-e660-44f3-8560-9b92d247b49a service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:47.518472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30add70-e660-44f3-8560-9b92d247b49a service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:47.533195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03803e2d-294a-428c-8113-092f787ee87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:47.533402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03803e2d-294a-428c-8113-092f787ee87d admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:47.535684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03803e2d-294a-428c-8113-092f787ee87d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:47.535684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03803e2d-294a-428c-8113-092f787ee87d admin admin] PATH_INFO: `/v3/projects/4a9010f20d2b463ca3cd27b944b58877/users/0c36cc83d9894d01954b507dad99205f/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:47.577329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03803e2d-294a-428c-8113-092f787ee87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9010f20d2b463ca3cd27b944b58877, user_id=0c36cc83d9894d01954b507dad99205f, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:47.590246 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03803e2d-294a-428c-8113-092f787ee87d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:47.622736 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 859/1706] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:47 2022] PUT /identity/v3/projects/4a9010f20d2b463ca3cd27b944b58877/users/0c36cc83d9894d01954b507dad99205f/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:47.637235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd024a1-d548-4d63-8d10-d09e50a472d5 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:47.637539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd024a1-d548-4d63-8d10-d09e50a472d5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:47.637825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd024a1-d548-4d63-8d10-d09e50a472d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:47.689882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ffd024a1-d548-4d63-8d10-d09e50a472d5 None None] MFA Rules not processed for user `0c36cc83d9894d01954b507dad99205f`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:47.691937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ffd024a1-d548-4d63-8d10-d09e50a472d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:47.905877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 848/1707] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:47.911356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03803e2d-294a-428c-8113-092f787ee87d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:48.054472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03803e2d-294a-428c-8113-092f787ee87d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:48.060494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc9ea3-b1b0-49ac-9088-c395dbf6035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:48.061258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc9ea3-b1b0-49ac-9088-c395dbf6035a admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:48.061435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc9ea3-b1b0-49ac-9088-c395dbf6035a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:48.061731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc9ea3-b1b0-49ac-9088-c395dbf6035a admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:48.062520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc9ea3-b1b0-49ac-9088-c395dbf6035a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:48.064911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc9ea3-b1b0-49ac-9088-c395dbf6035a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:48.120721 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 860/1708] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:47 2022] POST /identity/v3/projects => generated 386 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:48.125714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd024a1-d548-4d63-8d10-d09e50a472d5 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:48.141308 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd024a1-d548-4d63-8d10-d09e50a472d5 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:48.295289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddd220-f11a-4968-b29c-92d8e51d3ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:48.296153 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddd220-f11a-4968-b29c-92d8e51d3ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:48.296571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddd220-f11a-4968-b29c-92d8e51d3ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:48.296983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddd220-f11a-4968-b29c-92d8e51d3ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:48.297853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddd220-f11a-4968-b29c-92d8e51d3ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:48.307808 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddd220-f11a-4968-b29c-92d8e51d3ce0 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:48.359189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 849/1709] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:48 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:48.382943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc9ea3-b1b0-49ac-9088-c395dbf6035a admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:48.440653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc9ea3-b1b0-49ac-9088-c395dbf6035a admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:48.464161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46e688-16cb-4a01-ae43-72f3be1260a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:48.473561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46e688-16cb-4a01-ae43-72f3be1260a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:48.475720 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46e688-16cb-4a01-ae43-72f3be1260a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:48.476239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46e688-16cb-4a01-ae43-72f3be1260a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:48.487203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46e688-16cb-4a01-ae43-72f3be1260a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:48.494243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46e688-16cb-4a01-ae43-72f3be1260a4 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:48.549359 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddd220-f11a-4968-b29c-92d8e51d3ce0 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:48.551568 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 861/1710] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:48 2022] GET /identity/v3/roles => generated 1427 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:48.565466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddd220-f11a-4968-b29c-92d8e51d3ce0 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:48.576562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3529cf-97d4-4b2a-bef8-0df3f1b473b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:48.577391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3529cf-97d4-4b2a-bef8-0df3f1b473b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:48.578596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3529cf-97d4-4b2a-bef8-0df3f1b473b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:48.578876 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3529cf-97d4-4b2a-bef8-0df3f1b473b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:48.582573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3529cf-97d4-4b2a-bef8-0df3f1b473b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:48.585519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3529cf-97d4-4b2a-bef8-0df3f1b473b7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:48.612222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 850/1711] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:48 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:48.613986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46e688-16cb-4a01-ae43-72f3be1260a4 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:48.626012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46e688-16cb-4a01-ae43-72f3be1260a4 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:48.632027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae0dda-cbec-4181-a995-76d2f38d83a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:48.633332 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae0dda-cbec-4181-a995-76d2f38d83a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:48.633940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae0dda-cbec-4181-a995-76d2f38d83a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:48.634425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae0dda-cbec-4181-a995-76d2f38d83a7 admin admin] PATH_INFO: `/v3/projects/70a8a2afc3644957afeca6f15fe46d3a/users/b5755c1db3ff4d02a8fbfbdd2328718c/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:48.660764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae0dda-cbec-4181-a995-76d2f38d83a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a8a2afc3644957afeca6f15fe46d3a, user_id=b5755c1db3ff4d02a8fbfbdd2328718c, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:48.667715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae0dda-cbec-4181-a995-76d2f38d83a7 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:48.699672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 862/1712] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:48 2022] PUT /identity/v3/projects/70a8a2afc3644957afeca6f15fe46d3a/users/b5755c1db3ff4d02a8fbfbdd2328718c/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:48.711793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5217ab-1b41-4344-882d-625d2e905243 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:48.712206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5217ab-1b41-4344-882d-625d2e905243 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:48.712736 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5217ab-1b41-4344-882d-625d2e905243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:48.775996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-dc5217ab-1b41-4344-882d-625d2e905243 None None] MFA Rules not processed for user `b5755c1db3ff4d02a8fbfbdd2328718c`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:48.779403 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-dc5217ab-1b41-4344-882d-625d2e905243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:48.858988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d232934-e85d-4fd3-af6c-bf05b914cacd None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:48.859651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d232934-e85d-4fd3-af6c-bf05b914cacd None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:48.859651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d232934-e85d-4fd3-af6c-bf05b914cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:48.989469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4d232934-e85d-4fd3-af6c-bf05b914cacd None None] MFA Rules not processed for user `8ef71e3a38c245d5a008368c23e701d7`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:48.991217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4d232934-e85d-4fd3-af6c-bf05b914cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:49.023166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:49.097585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:49.104639 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 851/1713] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:49.110499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2e3ff-1444-48d2-bf82-be2f75bb350e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:49.110780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2e3ff-1444-48d2-bf82-be2f75bb350e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:49.113810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2e3ff-1444-48d2-bf82-be2f75bb350e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:49.179754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 863/1714] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:49.180617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d232934-e85d-4fd3-af6c-bf05b914cacd None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:49.199446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-2bf2e3ff-1444-48d2-bf82-be2f75bb350e None None] MFA Rules not processed for user `36ab34b69abc4a8dbe7bb0a40ad768b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:49.200949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2bf2e3ff-1444-48d2-bf82-be2f75bb350e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:49.335753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 852/1715] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:49.340742 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3662a-f81a-4a53-8c65-adfac586d0cc None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:49.343950 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3662a-f81a-4a53-8c65-adfac586d0cc None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:49.344570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3662a-f81a-4a53-8c65-adfac586d0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:49.346463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d232934-e85d-4fd3-af6c-bf05b914cacd None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:49.353558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56d058-aa8e-4a94-bd43-49c1b06e3268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:49.354258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56d058-aa8e-4a94-bd43-49c1b06e3268 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:49.354543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56d058-aa8e-4a94-bd43-49c1b06e3268 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:49.354856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56d058-aa8e-4a94-bd43-49c1b06e3268 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:49.355742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56d058-aa8e-4a94-bd43-49c1b06e3268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:49.358479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56d058-aa8e-4a94-bd43-49c1b06e3268 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:49.417463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-52b3662a-f81a-4a53-8c65-adfac586d0cc None None] MFA Rules not processed for user `8ef71e3a38c245d5a008368c23e701d7`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:49.421825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-52b3662a-f81a-4a53-8c65-adfac586d0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:49.430468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 864/1716] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:53:49 2022] POST /identity/v3/projects => generated 388 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:49.432700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56d058-aa8e-4a94-bd43-49c1b06e3268 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:49.626668 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56d058-aa8e-4a94-bd43-49c1b06e3268 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:49.645451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c711676-fa7a-4e67-bbdb-549c735d33e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:49.646263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c711676-fa7a-4e67-bbdb-549c735d33e9 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:49.646642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c711676-fa7a-4e67-bbdb-549c735d33e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:49.647070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c711676-fa7a-4e67-bbdb-549c735d33e9 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:49.647872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c711676-fa7a-4e67-bbdb-549c735d33e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:49.650579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c711676-fa7a-4e67-bbdb-549c735d33e9 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:49.681231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 853/1717] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:49.695285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3662a-f81a-4a53-8c65-adfac586d0cc None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:49.703824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 865/1718] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:49 2022] POST /identity/v3/users => generated 301 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:49.707983 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c711676-fa7a-4e67-bbdb-549c735d33e9 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:49.719800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c711676-fa7a-4e67-bbdb-549c735d33e9 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:49.725404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a2737-0d1f-4f1f-b291-77769faa0ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:49.726047 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a2737-0d1f-4f1f-b291-77769faa0ddf admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:49.726555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a2737-0d1f-4f1f-b291-77769faa0ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:49.726699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a2737-0d1f-4f1f-b291-77769faa0ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:49.727830 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a2737-0d1f-4f1f-b291-77769faa0ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:49.730760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a2737-0d1f-4f1f-b291-77769faa0ddf admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:49.750538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 866/1719] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:49 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:53:49.756682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a2737-0d1f-4f1f-b291-77769faa0ddf admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:49.796021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a2737-0d1f-4f1f-b291-77769faa0ddf admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:49.820454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a92af-2702-453b-837f-160735ba5337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:49.824269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a92af-2702-453b-837f-160735ba5337 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:49.824723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a92af-2702-453b-837f-160735ba5337 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:49.825074 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a92af-2702-453b-837f-160735ba5337 admin admin] PATH_INFO: `/v3/projects/665acbf2596747018cc634db9ee97bca/users/03a7ee7a2d654a6a90bf90513205d55d/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:49.866382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a92af-2702-453b-837f-160735ba5337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=665acbf2596747018cc634db9ee97bca, user_id=03a7ee7a2d654a6a90bf90513205d55d, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:49.875993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a92af-2702-453b-837f-160735ba5337 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:49.922518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 867/1720] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:49 2022] PUT /identity/v3/projects/665acbf2596747018cc634db9ee97bca/users/03a7ee7a2d654a6a90bf90513205d55d/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:49.930877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a92af-2702-453b-837f-160735ba5337 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:49.933664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3662a-f81a-4a53-8c65-adfac586d0cc None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:49.977797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:50.005454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:50.182159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a92af-2702-453b-837f-160735ba5337 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:50.191909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95466b34-b48f-4d0a-8330-571ce1757f90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:50.196425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466b34-b48f-4d0a-8330-571ce1757f90 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:50.197320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466b34-b48f-4d0a-8330-571ce1757f90 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:50.197468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466b34-b48f-4d0a-8330-571ce1757f90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:50.201469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61ce7a-76b8-4a0c-9251-36c63dd0abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:50.202141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ce7a-76b8-4a0c-9251-36c63dd0abb4 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:50.202427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ce7a-76b8-4a0c-9251-36c63dd0abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:50.202702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ce7a-76b8-4a0c-9251-36c63dd0abb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:50.206585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61ce7a-76b8-4a0c-9251-36c63dd0abb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:50.217648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61ce7a-76b8-4a0c-9251-36c63dd0abb4 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:50.251756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 868/1721] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:53:49 2022] GET /identity/v3/roles => generated 1427 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:50.271656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61ce7a-76b8-4a0c-9251-36c63dd0abb4 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:50.293112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61ce7a-76b8-4a0c-9251-36c63dd0abb4 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:50.315158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2f96c-8175-424b-87e0-e1f169bd4f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:50.316282 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2f96c-8175-424b-87e0-e1f169bd4f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:50.316967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2f96c-8175-424b-87e0-e1f169bd4f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:50.318306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2f96c-8175-424b-87e0-e1f169bd4f89 admin admin] PATH_INFO: `/v3/projects/665acbf2596747018cc634db9ee97bca/users/03a7ee7a2d654a6a90bf90513205d55d/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:50.331783 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2f96c-8175-424b-87e0-e1f169bd4f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=665acbf2596747018cc634db9ee97bca, user_id=03a7ee7a2d654a6a90bf90513205d55d, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:50.340216 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2f96c-8175-424b-87e0-e1f169bd4f89 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:50.394282 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 869/1722] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:53:50 2022] PUT /identity/v3/projects/665acbf2596747018cc634db9ee97bca/users/03a7ee7a2d654a6a90bf90513205d55d/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:50.396048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1215f4-83cd-47c2-a427-21bb4a7e875c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:50.396346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1215f4-83cd-47c2-a427-21bb4a7e875c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:50.396702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1215f4-83cd-47c2-a427-21bb4a7e875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:50.448521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95466b34-b48f-4d0a-8330-571ce1757f90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:50.450155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95466b34-b48f-4d0a-8330-571ce1757f90 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:50.461730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-3a1215f4-83cd-47c2-a427-21bb4a7e875c None None] MFA Rules not processed for user `61cdaecc25284225bb05bf978fe037bb`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:50.463206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3a1215f4-83cd-47c2-a427-21bb4a7e875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:50.479331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 854/1723] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:53:50.480965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc7743-c8a0-4e65-94ab-bfdd7635b063 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:50.481834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc7743-c8a0-4e65-94ab-bfdd7635b063 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:50.482115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc7743-c8a0-4e65-94ab-bfdd7635b063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:50.571494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-dafc7743-c8a0-4e65-94ab-bfdd7635b063 None None] MFA Rules not processed for user `03a7ee7a2d654a6a90bf90513205d55d`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:50.572747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-dafc7743-c8a0-4e65-94ab-bfdd7635b063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:50.681728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 870/1724] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:50.693221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809eeb-1e26-421d-9d64-56fb53e0029e None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:50.693578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809eeb-1e26-421d-9d64-56fb53e0029e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:50.694255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809eeb-1e26-421d-9d64-56fb53e0029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:50.742786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-58809eeb-1e26-421d-9d64-56fb53e0029e None None] MFA Rules not processed for user `61cdaecc25284225bb05bf978fe037bb`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:50.744101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-58809eeb-1e26-421d-9d64-56fb53e0029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:50.767142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 871/1725] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:50.792769 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 855/1726] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:50.918354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58809eeb-1e26-421d-9d64-56fb53e0029e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:50.919996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-58809eeb-1e26-421d-9d64-56fb53e0029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:50.978159 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b673366-7740-4a69-ae7d-70c8d79904c4 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:50.978448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b673366-7740-4a69-ae7d-70c8d79904c4 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:50.978862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b673366-7740-4a69-ae7d-70c8d79904c4 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:50.980212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 856/1727] 10.222.0.124 () {54 vars in 917 bytes} [Mon Aug 1 16:53:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:50.992955 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d3e63-d145-4990-a907-583274b7c75c None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:50.993381 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d3e63-d145-4990-a907-583274b7c75c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:50.993547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d3e63-d145-4990-a907-583274b7c75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:51.104570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-c74d3e63-d145-4990-a907-583274b7c75c None None] MFA Rules not processed for user `dcfe4d6c32064d79835c415d9fc02cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:51.108307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c74d3e63-d145-4990-a907-583274b7c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:51.117443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58809eeb-1e26-421d-9d64-56fb53e0029e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:51.129585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5b0ad-f648-4869-a6c6-6e4602558da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:51.133345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5b0ad-f648-4869-a6c6-6e4602558da1 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:51.134290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5b0ad-f648-4869-a6c6-6e4602558da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:51.134778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5b0ad-f648-4869-a6c6-6e4602558da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:51.160548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5b0ad-f648-4869-a6c6-6e4602558da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:51.165163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5b0ad-f648-4869-a6c6-6e4602558da1 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:51.207545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 872/1728] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:51.256946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:51.379013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 857/1729] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:53:51.427541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5b0ad-f648-4869-a6c6-6e4602558da1 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:51.429279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1fe5b0ad-f648-4869-a6c6-6e4602558da1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:51.468763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5b0ad-f648-4869-a6c6-6e4602558da1 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:51.488990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d901c-6328-4548-933d-9119f26b5720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:51.490303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d901c-6328-4548-933d-9119f26b5720 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:51.490912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d901c-6328-4548-933d-9119f26b5720 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:51.491542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d901c-6328-4548-933d-9119f26b5720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:51.518341 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d901c-6328-4548-933d-9119f26b5720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:51.522414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d901c-6328-4548-933d-9119f26b5720 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:51.571814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 873/1730] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:51.820153 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd395-fe52-480c-99e2-44925c731a72 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:51.820745 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd395-fe52-480c-99e2-44925c731a72 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:51.820966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd395-fe52-480c-99e2-44925c731a72 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:51.822917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 858/1731] 10.222.0.124 () {54 vars in 917 bytes} [Mon Aug 1 16:53:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:51.837989 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4f38d-24e7-415a-b7dd-b0ac2edbd265 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:51.838284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4f38d-24e7-415a-b7dd-b0ac2edbd265 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:51.838563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4f38d-24e7-415a-b7dd-b0ac2edbd265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:51.884376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-21f4f38d-24e7-415a-b7dd-b0ac2edbd265 None None] MFA Rules not processed for user `dcfe4d6c32064d79835c415d9fc02cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:51.890751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-21f4f38d-24e7-415a-b7dd-b0ac2edbd265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:51.914679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 874/1732] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:51.927416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd395-fe52-480c-99e2-44925c731a72 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:51.929964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-040dd395-fe52-480c-99e2-44925c731a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:51.959512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd395-fe52-480c-99e2-44925c731a72 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:51.983754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543eee3-6f54-4287-9a07-688991e256ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:51.984405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543eee3-6f54-4287-9a07-688991e256ef service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:51.984688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543eee3-6f54-4287-9a07-688991e256ef service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:51.984961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543eee3-6f54-4287-9a07-688991e256ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:52.004288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543eee3-6f54-4287-9a07-688991e256ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:52.005687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543eee3-6f54-4287-9a07-688991e256ef service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:52.058589 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 859/1733] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:52.723605 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754640-84ab-43c5-8a15-f59b0795f561 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:52.724113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754640-84ab-43c5-8a15-f59b0795f561 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:52.724781 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754640-84ab-43c5-8a15-f59b0795f561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:52.739401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:52.764062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-fc754640-84ab-43c5-8a15-f59b0795f561 None None] MFA Rules not processed for user `329a85e5f5e9446c80dc45cafd329108`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:52.765719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-fc754640-84ab-43c5-8a15-f59b0795f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:52.829572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543eee3-6f54-4287-9a07-688991e256ef service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:52.957319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 875/1734] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:53.004262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778eb53-0746-467e-921e-cd6d6e2b698d None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:53.004465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778eb53-0746-467e-921e-cd6d6e2b698d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:53.004846 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778eb53-0746-467e-921e-cd6d6e2b698d None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:53.006263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 876/1735] 10.222.0.124 () {54 vars in 966 bytes} [Mon Aug 1 16:53:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:53:53.009684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778eb53-0746-467e-921e-cd6d6e2b698d None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:53.051655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543eee3-6f54-4287-9a07-688991e256ef service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:53.052346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778eb53-0746-467e-921e-cd6d6e2b698d None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:53.058231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdc275-dc70-4a89-9005-883f724f092d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:53.059149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdc275-dc70-4a89-9005-883f724f092d service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:53.059433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdc275-dc70-4a89-9005-883f724f092d service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:53.059834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdc275-dc70-4a89-9005-883f724f092d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:53.065272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1d28-870c-4633-9158-84ab3b9a5595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:53.067617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1d28-870c-4633-9158-84ab3b9a5595 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:53.068058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1d28-870c-4633-9158-84ab3b9a5595 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:53.068336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1d28-870c-4633-9158-84ab3b9a5595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:53.072382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdc275-dc70-4a89-9005-883f724f092d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:53.075296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdc275-dc70-4a89-9005-883f724f092d service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:53.091749 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 860/1736] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:53:53.094456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c75a7-62ac-4c79-96a1-c3333532d2d6 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:53.094990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c75a7-62ac-4c79-96a1-c3333532d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:53.095729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c75a7-62ac-4c79-96a1-c3333532d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:53.137152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-8d1c75a7-62ac-4c79-96a1-c3333532d2d6 None None] MFA Rules not processed for user `6deeea314be545609b0fe4dd786b3b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:53.140756 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8d1c75a7-62ac-4c79-96a1-c3333532d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:53.297581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1d28-870c-4633-9158-84ab3b9a5595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:53.302639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1d28-870c-4633-9158-84ab3b9a5595 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:53.319184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 877/1737] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:53.352573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1d28-870c-4633-9158-84ab3b9a5595 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:53.356366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-83ef1d28-870c-4633-9158-84ab3b9a5595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:53.390185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 861/1738] 10.222.0.124 () {58 vars in 1063 bytes} [Mon Aug 1 16:53:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:53.405590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88506c68-b9be-470c-9493-094c8eaaa65b None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:53.405874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88506c68-b9be-470c-9493-094c8eaaa65b None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:53.406150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88506c68-b9be-470c-9493-094c8eaaa65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:53.417833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1d28-870c-4633-9158-84ab3b9a5595 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:53.436009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31090112-6367-455e-9723-c9611b38434f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:53.436664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31090112-6367-455e-9723-c9611b38434f service placement] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:53.443198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31090112-6367-455e-9723-c9611b38434f service placement] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:53.443482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31090112-6367-455e-9723-c9611b38434f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:53.448327 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-31090112-6367-455e-9723-c9611b38434f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:53.472957 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-88506c68-b9be-470c-9493-094c8eaaa65b None None] MFA Rules not processed for user `8ef71e3a38c245d5a008368c23e701d7`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:53.474512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-88506c68-b9be-470c-9493-094c8eaaa65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:53.497638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31090112-6367-455e-9723-c9611b38434f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:53.502159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31090112-6367-455e-9723-c9611b38434f service placement] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:53.565253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 878/1739] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:53.566411 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31090112-6367-455e-9723-c9611b38434f service placement] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:53.613385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31090112-6367-455e-9723-c9611b38434f service placement] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:53.632237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 862/1740] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:53.647269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb921f5-d254-475f-8410-3d2dc98fd176 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:53.653842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb921f5-d254-475f-8410-3d2dc98fd176 service placement] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:53.654159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb921f5-d254-475f-8410-3d2dc98fd176 service placement] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:53.654448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb921f5-d254-475f-8410-3d2dc98fd176 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:53.703513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb921f5-d254-475f-8410-3d2dc98fd176 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:53.713892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb921f5-d254-475f-8410-3d2dc98fd176 service placement] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:53.767499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 879/1741] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:54.071288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88506c68-b9be-470c-9493-094c8eaaa65b None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:54.072754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-88506c68-b9be-470c-9493-094c8eaaa65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:54.078835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:54.432375 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88506c68-b9be-470c-9493-094c8eaaa65b None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:54.473851 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f0b2b-758c-4d4f-a3d4-13e6f3d1cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:54.474552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f0b2b-758c-4d4f-a3d4-13e6f3d1cda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:54.474839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f0b2b-758c-4d4f-a3d4-13e6f3d1cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:54.475147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f0b2b-758c-4d4f-a3d4-13e6f3d1cda9 admin admin] PATH_INFO: `/v3/users/40a212c3755b4da5a69d736f6f114641` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:54.481120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f0b2b-758c-4d4f-a3d4-13e6f3d1cda9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a212c3755b4da5a69d736f6f114641)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:54.485604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f0b2b-758c-4d4f-a3d4-13e6f3d1cda9 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:54.618768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ad2f0b2b-758c-4d4f-a3d4-13e6f3d1cda9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a212c3755b4da5a69d736f6f114641'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:54.618768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ad2f0b2b-758c-4d4f-a3d4-13e6f3d1cda9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a212c3755b4da5a69d736f6f114641'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:54.642545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ad2f0b2b-758c-4d4f-a3d4-13e6f3d1cda9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a212c3755b4da5a69d736f6f114641'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:54.646916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ad2f0b2b-758c-4d4f-a3d4-13e6f3d1cda9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a212c3755b4da5a69d736f6f114641'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:54.661420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ad2f0b2b-758c-4d4f-a3d4-13e6f3d1cda9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a212c3755b4da5a69d736f6f114641'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:54.725586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb921f5-d254-475f-8410-3d2dc98fd176 service placement] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:54.726157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 863/1742] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:53:54 2022] DELETE /identity/v3/users/40a212c3755b4da5a69d736f6f114641 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:54.730080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-deb921f5-d254-475f-8410-3d2dc98fd176 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:54.731144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11358cf-1dcb-459d-b2de-c2183ee044d6 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:54.731144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11358cf-1dcb-459d-b2de-c2183ee044d6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:54.731674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11358cf-1dcb-459d-b2de-c2183ee044d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:54.757065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e11358cf-1dcb-459d-b2de-c2183ee044d6 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:54.758483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e11358cf-1dcb-459d-b2de-c2183ee044d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:54.768486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb921f5-d254-475f-8410-3d2dc98fd176 service placement] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:54.899771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 864/1743] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:54.910275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11358cf-1dcb-459d-b2de-c2183ee044d6 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:54.911984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e11358cf-1dcb-459d-b2de-c2183ee044d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:54.971159 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:54.996007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:55.000033 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:55.000341 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:55.000627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] PATH_INFO: `/v3/users/60574f322c2b4f7cb4913c970646127d` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:55.005590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60574f322c2b4f7cb4913c970646127d)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:55.021453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:55.041140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11358cf-1dcb-459d-b2de-c2183ee044d6 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:55.056751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12372ec6-71e8-4710-8fb0-3ed2813bb553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:55.059241 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372ec6-71e8-4710-8fb0-3ed2813bb553 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:55.060751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372ec6-71e8-4710-8fb0-3ed2813bb553 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:55.061214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372ec6-71e8-4710-8fb0-3ed2813bb553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:55.074705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12372ec6-71e8-4710-8fb0-3ed2813bb553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:55.084040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12372ec6-71e8-4710-8fb0-3ed2813bb553 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:55.113474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:55.163710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 865/1744] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:55.199343 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60574f322c2b4f7cb4913c970646127d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:55.230333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60574f322c2b4f7cb4913c970646127d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:55.257305 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60574f322c2b4f7cb4913c970646127d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:55.260233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60574f322c2b4f7cb4913c970646127d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:55.269495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60574f322c2b4f7cb4913c970646127d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:55.321037 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 880/1745] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:53:54 2022] DELETE /identity/v3/users/60574f322c2b4f7cb4913c970646127d => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:55.325300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95c16-a9c8-4c1c-aed3-801352cb59f3 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:55.325590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95c16-a9c8-4c1c-aed3-801352cb59f3 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:55.325865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95c16-a9c8-4c1c-aed3-801352cb59f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:55.381805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-3bd95c16-a9c8-4c1c-aed3-801352cb59f3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:55.391310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3bd95c16-a9c8-4c1c-aed3-801352cb59f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:55.732321 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 866/1746] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:56.025714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:56.029029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:56.404104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0f00-57dd-40b9-9b1c-3a22e743f273 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:56.417802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9d15f-1e4a-4bd7-a1d9-9199c7434b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:56.418808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d15f-1e4a-4bd7-a1d9-9199c7434b3a service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:56.419289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d15f-1e4a-4bd7-a1d9-9199c7434b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:56.419945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d15f-1e4a-4bd7-a1d9-9199c7434b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:56.475251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9d15f-1e4a-4bd7-a1d9-9199c7434b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:56.477446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9d15f-1e4a-4bd7-a1d9-9199c7434b3a service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:56.562685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 881/1747] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:53:57.035795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd95c16-a9c8-4c1c-aed3-801352cb59f3 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:57.037627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3bd95c16-a9c8-4c1c-aed3-801352cb59f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:57.068834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd95c16-a9c8-4c1c-aed3-801352cb59f3 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:57.081630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:57.083396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:57.083792 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:57.086759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] PATH_INFO: `/v3/projects/bbef07dd13414f9fb8a7c70c509c15a9` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:57.091210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbef07dd13414f9fb8a7c70c509c15a9)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:57.097322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:57.207477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbef07dd13414f9fb8a7c70c509c15a9', 'request_id': 'req-1566df49-6081-46ee-a273-067cb289f02e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:57.230020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbef07dd13414f9fb8a7c70c509c15a9', 'request_id': 'req-1566df49-6081-46ee-a273-067cb289f02e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:57.246457 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbef07dd13414f9fb8a7c70c509c15a9', 'request_id': 'req-1566df49-6081-46ee-a273-067cb289f02e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:57.295943 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] The token cache is being invalidate because project bbef07dd13414f9fb8a7c70c509c15a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:53:57.296237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:57.305070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:57.308547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 867/1748] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:53:57 2022] DELETE /identity/v3/projects/bbef07dd13414f9fb8a7c70c509c15a9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:57.312636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9d15f-1e4a-4bd7-a1d9-9199c7434b3a service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:57.326188 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9d15f-1e4a-4bd7-a1d9-9199c7434b3a service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:57.515527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:57.516211 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:57.516484 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:57.516752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] PATH_INFO: `/v3/users/4728063a0a454fb0a1ef25ce96b32cb0` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:57.530262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4728063a0a454fb0a1ef25ce96b32cb0)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:57.533373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:57.651145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:57.657114 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4728063a0a454fb0a1ef25ce96b32cb0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:57.675417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4728063a0a454fb0a1ef25ce96b32cb0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:57.694295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4728063a0a454fb0a1ef25ce96b32cb0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:57.696604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4728063a0a454fb0a1ef25ce96b32cb0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:57.698582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4728063a0a454fb0a1ef25ce96b32cb0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:57.801087 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 882/1749] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:53:57 2022] DELETE /identity/v3/users/4728063a0a454fb0a1ef25ce96b32cb0 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:58.109020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:58.110725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:58.157127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566df49-6081-46ee-a273-067cb289f02e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:58.325022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:58.343561 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:58.344556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:58.345099 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:58.345736 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] PATH_INFO: `/v3/projects/5d6cc4bd9ede4fad818e7511a75d9438` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:58.347618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6cc4bd9ede4fad818e7511a75d9438)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:58.350290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:58.441654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6cc4bd9ede4fad818e7511a75d9438', 'request_id': 'req-109bab91-057c-483d-8c3c-d334f9138316'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:58.449904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6cc4bd9ede4fad818e7511a75d9438', 'request_id': 'req-109bab91-057c-483d-8c3c-d334f9138316'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:58.456671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6cc4bd9ede4fad818e7511a75d9438', 'request_id': 'req-109bab91-057c-483d-8c3c-d334f9138316'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:58.496428 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] The token cache is being invalidate because project 5d6cc4bd9ede4fad818e7511a75d9438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:53:58.496740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:58.497720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-109bab91-057c-483d-8c3c-d334f9138316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:58.502029 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 868/1750] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:53:58 2022] DELETE /identity/v3/projects/5d6cc4bd9ede4fad818e7511a75d9438 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:53:58.506233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:58.509054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:58.533466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997202f-6aa7-4a24-8cd2-ef3a4fe50305 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:58.622090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161bdb7-0f78-43f9-8091-7597fe16dbf6 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:58.622971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161bdb7-0f78-43f9-8091-7597fe16dbf6 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:58.623622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161bdb7-0f78-43f9-8091-7597fe16dbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:58.708632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:58.711797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:58.712247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:58.712766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] PATH_INFO: `/v3/users/ebe525da81574dd98c525c20b0e42fa6` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:58.717091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebe525da81574dd98c525c20b0e42fa6)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:58.723546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:58.732121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1161bdb7-0f78-43f9-8091-7597fe16dbf6 None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:58.736665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1161bdb7-0f78-43f9-8091-7597fe16dbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:58.828945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebe525da81574dd98c525c20b0e42fa6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:58.854710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebe525da81574dd98c525c20b0e42fa6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:58.868776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebe525da81574dd98c525c20b0e42fa6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:58.869690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebe525da81574dd98c525c20b0e42fa6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:58.870348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebe525da81574dd98c525c20b0e42fa6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:53:58.912440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 869/1751] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:53:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:53:58.932354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 883/1752] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:53:58 2022] DELETE /identity/v3/users/ebe525da81574dd98c525c20b0e42fa6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:59.123202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161bdb7-0f78-43f9-8091-7597fe16dbf6 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:59.125233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1161bdb7-0f78-43f9-8091-7597fe16dbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:59.250080 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:59.366797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161bdb7-0f78-43f9-8091-7597fe16dbf6 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:59.581087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985921e-f314-4fda-a983-e3f22266c80a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:59.581752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985921e-f314-4fda-a983-e3f22266c80a service swift] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:59.582035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985921e-f314-4fda-a983-e3f22266c80a service swift] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:59.582312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985921e-f314-4fda-a983-e3f22266c80a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:59.617063 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:59.619308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:59.752375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:59.777963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29883c5f-0c67-422d-b73f-56f2530b521d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:59.780657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985921e-f314-4fda-a983-e3f22266c80a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:59.787364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985921e-f314-4fda-a983-e3f22266c80a service swift] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:59.788262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e47cb7-d474-48e8-a153-a2600593e99d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:59.790642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e47cb7-d474-48e8-a153-a2600593e99d service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:59.791757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e47cb7-d474-48e8-a153-a2600593e99d service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:59.792415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e47cb7-d474-48e8-a153-a2600593e99d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:59.799891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b3e47cb7-d474-48e8-a153-a2600593e99d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:59.802251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 870/1753] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:53:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:54:00.182664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e47cb7-d474-48e8-a153-a2600593e99d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:00.190377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e47cb7-d474-48e8-a153-a2600593e99d service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:00.232237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 884/1754] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:53:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:00.462393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985921e-f314-4fda-a983-e3f22266c80a service swift] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:00.464101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a985921e-f314-4fda-a983-e3f22266c80a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:00.777644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985921e-f314-4fda-a983-e3f22266c80a service swift] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:00.784505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:00.785484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:00.785856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:00.786136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] PATH_INFO: `/v3/projects/54a2135234214bbcba074a5f7dce4fdf` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:00.788292 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a2135234214bbcba074a5f7dce4fdf)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:00.791185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:00.816916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:00.893267 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a2135234214bbcba074a5f7dce4fdf', 'request_id': 'req-24395933-32a8-497b-ad06-5dbd8043f85f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:00.906682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a2135234214bbcba074a5f7dce4fdf', 'request_id': 'req-24395933-32a8-497b-ad06-5dbd8043f85f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:00.915020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a2135234214bbcba074a5f7dce4fdf', 'request_id': 'req-24395933-32a8-497b-ad06-5dbd8043f85f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:00.943397 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] The token cache is being invalidate because project 54a2135234214bbcba074a5f7dce4fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:00.943708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:00.944466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:00.953713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 871/1755] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:00 2022] DELETE /identity/v3/projects/54a2135234214bbcba074a5f7dce4fdf => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:00.954105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447284-d3ad-4abe-ae11-06a480673738 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:00.954734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447284-d3ad-4abe-ae11-06a480673738 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:00.954734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447284-d3ad-4abe-ae11-06a480673738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:01.043118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:01.045163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:01.057371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-bb447284-d3ad-4abe-ae11-06a480673738 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:01.058660 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-bb447284-d3ad-4abe-ae11-06a480673738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:01.317366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 885/1756] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:01.319366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ec20-138a-41f8-b49a-e107c6b25275 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:01.319933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ec20-138a-41f8-b49a-e107c6b25275 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:01.320440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ec20-138a-41f8-b49a-e107c6b25275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:01.377026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24395933-32a8-497b-ad06-5dbd8043f85f admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:01.401355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-de10ec20-138a-41f8-b49a-e107c6b25275 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:01.403675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-de10ec20-138a-41f8-b49a-e107c6b25275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:01.418684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:01.420200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:01.420916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:01.421321 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] PATH_INFO: `/v3/projects/ddcc779928e04490b7f438011fffeee2` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:01.427559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddcc779928e04490b7f438011fffeee2)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:01.429783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:01.463301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 886/1757] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:01.468375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10ec20-138a-41f8-b49a-e107c6b25275 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:01.514776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10ec20-138a-41f8-b49a-e107c6b25275 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:01.535222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124d6ee-898d-44c3-a2d5-3204b15a62a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:01.535891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d6ee-898d-44c3-a2d5-3204b15a62a2 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:01.536178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d6ee-898d-44c3-a2d5-3204b15a62a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:01.536500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d6ee-898d-44c3-a2d5-3204b15a62a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:01.537191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124d6ee-898d-44c3-a2d5-3204b15a62a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:01.537554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124d6ee-898d-44c3-a2d5-3204b15a62a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:01.539210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124d6ee-898d-44c3-a2d5-3204b15a62a2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:01.594738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 887/1758] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:54:01.599907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124d6ee-898d-44c3-a2d5-3204b15a62a2 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:01.634364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124d6ee-898d-44c3-a2d5-3204b15a62a2 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:01.691268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddcc779928e04490b7f438011fffeee2', 'request_id': 'req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:01.731754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddcc779928e04490b7f438011fffeee2', 'request_id': 'req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:01.756578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddcc779928e04490b7f438011fffeee2', 'request_id': 'req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:01.789948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] The token cache is being invalidate because project ddcc779928e04490b7f438011fffeee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:01.793279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:01.795118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-98da2605-3ec8-4c90-b73b-2b66e4d8dcdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:01.805985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 872/1759] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:01 2022] DELETE /identity/v3/projects/ddcc779928e04490b7f438011fffeee2 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:01.808779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25735c5-8af2-472f-89d0-5915d9edb33e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:01.809207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25735c5-8af2-472f-89d0-5915d9edb33e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:01.809591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25735c5-8af2-472f-89d0-5915d9edb33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:01.865273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a25735c5-8af2-472f-89d0-5915d9edb33e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:01.870401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a25735c5-8af2-472f-89d0-5915d9edb33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:01.882236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b899a3c-9613-43d8-911b-0fee1d4fe148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:01.882591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b899a3c-9613-43d8-911b-0fee1d4fe148 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:01.882877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b899a3c-9613-43d8-911b-0fee1d4fe148 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:01.883185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b899a3c-9613-43d8-911b-0fee1d4fe148 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:01.883941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b899a3c-9613-43d8-911b-0fee1d4fe148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:01.885906 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b899a3c-9613-43d8-911b-0fee1d4fe148 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:01.970896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 888/1760] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:01 2022] POST /identity/v3/projects => generated 368 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:01.980357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b899a3c-9613-43d8-911b-0fee1d4fe148 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:01.986435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6b899a3c-9613-43d8-911b-0fee1d4fe148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:02.016466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:02.020865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:02.144975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 873/1761] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:02.153567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e2d98-1230-412f-9db1-d36c8009ab09 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:02.154446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e2d98-1230-412f-9db1-d36c8009ab09 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:02.154446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e2d98-1230-412f-9db1-d36c8009ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:02.193615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-9f6e2d98-1230-412f-9db1-d36c8009ab09 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:02.199339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9f6e2d98-1230-412f-9db1-d36c8009ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:02.302461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b899a3c-9613-43d8-911b-0fee1d4fe148 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:02.337713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37c473-9cff-489d-8af1-e2c07c7feb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:02.338439 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37c473-9cff-489d-8af1-e2c07c7feb39 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:02.338723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37c473-9cff-489d-8af1-e2c07c7feb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:02.341418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37c473-9cff-489d-8af1-e2c07c7feb39 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:02.345649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37c473-9cff-489d-8af1-e2c07c7feb39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:02.350538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37c473-9cff-489d-8af1-e2c07c7feb39 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:02.381570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 874/1762] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:02.386560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e2d98-1230-412f-9db1-d36c8009ab09 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:02.409664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e2d98-1230-412f-9db1-d36c8009ab09 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:02.425138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feb970-0ff3-4e01-ba0a-c5c90b8a1516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:02.427266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb970-0ff3-4e01-ba0a-c5c90b8a1516 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:02.427422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb970-0ff3-4e01-ba0a-c5c90b8a1516 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:02.427838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb970-0ff3-4e01-ba0a-c5c90b8a1516 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:02.428396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43feb970-0ff3-4e01-ba0a-c5c90b8a1516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:02.428713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43feb970-0ff3-4e01-ba0a-c5c90b8a1516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:02.433936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43feb970-0ff3-4e01-ba0a-c5c90b8a1516 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:02.439728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 889/1763] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:01 2022] POST /identity/v3/users => generated 285 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:02.441480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37c473-9cff-489d-8af1-e2c07c7feb39 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:02.468560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37c473-9cff-489d-8af1-e2c07c7feb39 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:02.478917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470da96-5fe0-47b2-b5da-483ada84302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:02.480094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470da96-5fe0-47b2-b5da-483ada84302e admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:02.483043 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 875/1764] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:54:02.485212 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470da96-5fe0-47b2-b5da-483ada84302e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:02.485534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470da96-5fe0-47b2-b5da-483ada84302e admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:02.486317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470da96-5fe0-47b2-b5da-483ada84302e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:02.487587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feb970-0ff3-4e01-ba0a-c5c90b8a1516 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:02.493171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470da96-5fe0-47b2-b5da-483ada84302e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:02.519592 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 890/1765] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:02 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:02.521350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470da96-5fe0-47b2-b5da-483ada84302e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:02.543302 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feb970-0ff3-4e01-ba0a-c5c90b8a1516 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:02.545089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470da96-5fe0-47b2-b5da-483ada84302e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:02.559108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688462c-3272-4925-9749-dd58c237d186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:02.559851 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8889712-71c8-42f2-bce9-72dedfc1e433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:02.559995 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688462c-3272-4925-9749-dd58c237d186 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:02.560463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688462c-3272-4925-9749-dd58c237d186 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:02.560575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8889712-71c8-42f2-bce9-72dedfc1e433 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:02.560770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688462c-3272-4925-9749-dd58c237d186 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:02.560933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8889712-71c8-42f2-bce9-72dedfc1e433 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:02.561178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8889712-71c8-42f2-bce9-72dedfc1e433 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:02.561871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8889712-71c8-42f2-bce9-72dedfc1e433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:02.564220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688462c-3272-4925-9749-dd58c237d186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:02.572030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8889712-71c8-42f2-bce9-72dedfc1e433 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:02.576102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688462c-3272-4925-9749-dd58c237d186 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:02.621415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 891/1766] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:02 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:02.626431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688462c-3272-4925-9749-dd58c237d186 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:02.662111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688462c-3272-4925-9749-dd58c237d186 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:02.681811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77c469-a8e1-4f2c-9272-fac3d7248a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:02.682856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77c469-a8e1-4f2c-9272-fac3d7248a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:02.683990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77c469-a8e1-4f2c-9272-fac3d7248a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:02.686621 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77c469-a8e1-4f2c-9272-fac3d7248a31 admin admin] PATH_INFO: `/v3/projects/2c66e1abe7254abc8a5659a026688482/users/a1c6a4f430db4795a2f2b8f2c3b7a86a/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:02.695737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 876/1767] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:02 2022] POST /identity/v3/projects => generated 382 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:02.700119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8889712-71c8-42f2-bce9-72dedfc1e433 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:02.753361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77c469-a8e1-4f2c-9272-fac3d7248a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c66e1abe7254abc8a5659a026688482, user_id=a1c6a4f430db4795a2f2b8f2c3b7a86a, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:02.763346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77c469-a8e1-4f2c-9272-fac3d7248a31 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:02.791072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 892/1768] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:02 2022] PUT /identity/v3/projects/2c66e1abe7254abc8a5659a026688482/users/a1c6a4f430db4795a2f2b8f2c3b7a86a/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:02.802097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a68f3-03b5-4e15-9a98-0a405e0793fc None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:02.802598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a68f3-03b5-4e15-9a98-0a405e0793fc None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:02.803025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a68f3-03b5-4e15-9a98-0a405e0793fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:02.890415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8889712-71c8-42f2-bce9-72dedfc1e433 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:02.918793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-879a68f3-03b5-4e15-9a98-0a405e0793fc None None] MFA Rules not processed for user `a1c6a4f430db4795a2f2b8f2c3b7a86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:02.920467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-879a68f3-03b5-4e15-9a98-0a405e0793fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:03.073316 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:03.153460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616afbe-c10a-4112-8212-91f1fbed5c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:03.154230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616afbe-c10a-4112-8212-91f1fbed5c0e admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:03.154576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616afbe-c10a-4112-8212-91f1fbed5c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:03.157241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 893/1769] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:03.161058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616afbe-c10a-4112-8212-91f1fbed5c0e admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:03.162397 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616afbe-c10a-4112-8212-91f1fbed5c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:03.164606 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616afbe-c10a-4112-8212-91f1fbed5c0e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:03.166451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a68f3-03b5-4e15-9a98-0a405e0793fc None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:03.169198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-879a68f3-03b5-4e15-9a98-0a405e0793fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:03.186082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a68f3-03b5-4e15-9a98-0a405e0793fc None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:03.193898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:03.194828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:03.195356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:03.195799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] PATH_INFO: `/v3/users/488d882b31d6445c817380c2fd5bf572` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:03.198750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=488d882b31d6445c817380c2fd5bf572)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:03.202815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:03.272508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 877/1770] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:02 2022] POST /identity/v3/users => generated 292 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:03.275536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616afbe-c10a-4112-8212-91f1fbed5c0e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:03.286456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:03.319697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488d882b31d6445c817380c2fd5bf572'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:03.321641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616afbe-c10a-4112-8212-91f1fbed5c0e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:03.336828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488d882b31d6445c817380c2fd5bf572'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:03.349090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c11dff-1827-40bf-85ba-8a711cf5d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:03.349856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c11dff-1827-40bf-85ba-8a711cf5d688 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:03.356671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488d882b31d6445c817380c2fd5bf572'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:03.356892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c11dff-1827-40bf-85ba-8a711cf5d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:03.357212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c11dff-1827-40bf-85ba-8a711cf5d688 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:03.358331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488d882b31d6445c817380c2fd5bf572'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:03.360280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488d882b31d6445c817380c2fd5bf572'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:03.360411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c11dff-1827-40bf-85ba-8a711cf5d688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:03.373702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c11dff-1827-40bf-85ba-8a711cf5d688 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:03.409057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 894/1771] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:03 2022] DELETE /identity/v3/users/488d882b31d6445c817380c2fd5bf572 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:03.410071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:03.414245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:03.512678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 878/1772] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:03 2022] POST /identity/v3/projects => generated 370 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:03.514281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5453-9982-4c8d-b050-3a41a44912a5 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:03.514975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5453-9982-4c8d-b050-3a41a44912a5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:03.514975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5453-9982-4c8d-b050-3a41a44912a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:03.595502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-9e0f5453-9982-4c8d-b050-3a41a44912a5 None None] MFA Rules not processed for user `dcfe4d6c32064d79835c415d9fc02cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:03.597314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9e0f5453-9982-4c8d-b050-3a41a44912a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:03.818521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a90d3-3eea-4e61-a267-7ab65476fd96 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:03.852759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 879/1773] 10.222.0.134 () {58 vars in 1020 bytes} [Mon Aug 1 16:54:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:03.855957 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c169691-b85f-495e-9c13-0895cb72dd6e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:03.857995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c169691-b85f-495e-9c13-0895cb72dd6e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:03.858369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c169691-b85f-495e-9c13-0895cb72dd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:03.936605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1c169691-b85f-495e-9c13-0895cb72dd6e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:03.949129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1c169691-b85f-495e-9c13-0895cb72dd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:04.017226 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aade9af-6d01-46e5-bd39-c39a413f5a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:04.017902 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aade9af-6d01-46e5-bd39-c39a413f5a22 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:04.018195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aade9af-6d01-46e5-bd39-c39a413f5a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:04.018469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aade9af-6d01-46e5-bd39-c39a413f5a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:04.019251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aade9af-6d01-46e5-bd39-c39a413f5a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:04.021152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aade9af-6d01-46e5-bd39-c39a413f5a22 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:04.035633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 895/1774] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:03 2022] GET /identity/v3/roles => generated 1427 bytes in 626 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:04.036855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aade9af-6d01-46e5-bd39-c39a413f5a22 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:04.043959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2aade9af-6d01-46e5-bd39-c39a413f5a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:04.075235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aade9af-6d01-46e5-bd39-c39a413f5a22 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:04.078855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a2892-e9fb-4aae-abef-d6949c9901cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:04.080136 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a2892-e9fb-4aae-abef-d6949c9901cf admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:04.080427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a2892-e9fb-4aae-abef-d6949c9901cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:04.080703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a2892-e9fb-4aae-abef-d6949c9901cf admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:04.081490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a2892-e9fb-4aae-abef-d6949c9901cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:04.084082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a2892-e9fb-4aae-abef-d6949c9901cf admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:04.142914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 896/1775] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:04 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:04.144287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a2892-e9fb-4aae-abef-d6949c9901cf admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:04.149921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-479a2892-e9fb-4aae-abef-d6949c9901cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:04.187164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a2892-e9fb-4aae-abef-d6949c9901cf admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:04.200595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb41d07-25cb-496b-a1bb-a57e6f4f3d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:04.202618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb41d07-25cb-496b-a1bb-a57e6f4f3d16 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:04.202903 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb41d07-25cb-496b-a1bb-a57e6f4f3d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:04.203206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb41d07-25cb-496b-a1bb-a57e6f4f3d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:04.230608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 880/1776] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:04.239464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c169691-b85f-495e-9c13-0895cb72dd6e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:04.249403 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb41d07-25cb-496b-a1bb-a57e6f4f3d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:04.253207 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb41d07-25cb-496b-a1bb-a57e6f4f3d16 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:04.253798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c169691-b85f-495e-9c13-0895cb72dd6e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:04.260433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152e5f0-b871-4927-be93-5853127691b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:04.261096 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152e5f0-b871-4927-be93-5853127691b6 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:04.261537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152e5f0-b871-4927-be93-5853127691b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:04.265376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152e5f0-b871-4927-be93-5853127691b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:04.267229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152e5f0-b871-4927-be93-5853127691b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:04.269087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152e5f0-b871-4927-be93-5853127691b6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:04.278886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 897/1777] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:04.286071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 881/1778] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:04 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:04.287052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152e5f0-b871-4927-be93-5853127691b6 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:04.305844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb41d07-25cb-496b-a1bb-a57e6f4f3d16 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:04.351020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb41d07-25cb-496b-a1bb-a57e6f4f3d16 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:04.351337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152e5f0-b871-4927-be93-5853127691b6 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:04.362433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53fa7a-7a04-4c4b-becd-780c8bffe5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:04.365523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53fa7a-7a04-4c4b-becd-780c8bffe5fe admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:04.366763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53fa7a-7a04-4c4b-becd-780c8bffe5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:04.367946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53fa7a-7a04-4c4b-becd-780c8bffe5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:04.371060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53fa7a-7a04-4c4b-becd-780c8bffe5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:04.373172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1357ec6-3fc4-4eaa-ba27-fbecf9649dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:04.374016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357ec6-3fc4-4eaa-ba27-fbecf9649dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:04.374290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357ec6-3fc4-4eaa-ba27-fbecf9649dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:04.374599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357ec6-3fc4-4eaa-ba27-fbecf9649dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:04.375751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53fa7a-7a04-4c4b-becd-780c8bffe5fe admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:04.412292 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 882/1779] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:04 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:04.416380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53fa7a-7a04-4c4b-becd-780c8bffe5fe admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:04.422448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1357ec6-3fc4-4eaa-ba27-fbecf9649dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:04.425577 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1357ec6-3fc4-4eaa-ba27-fbecf9649dc4 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:04.452018 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53fa7a-7a04-4c4b-becd-780c8bffe5fe admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:04.457055 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 898/1780] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:04.466265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1357ec6-3fc4-4eaa-ba27-fbecf9649dc4 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:04.468691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463181d-65b3-4785-bd44-f33490eedca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:04.470630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463181d-65b3-4785-bd44-f33490eedca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:04.472793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463181d-65b3-4785-bd44-f33490eedca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:04.473459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463181d-65b3-4785-bd44-f33490eedca0 admin admin] PATH_INFO: `/v3/projects/9efcf76d0cab47029ff3933deb732392/users/e2c1c3a1797048df9d57a804ea157f8e/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:04.528387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463181d-65b3-4785-bd44-f33490eedca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efcf76d0cab47029ff3933deb732392, user_id=e2c1c3a1797048df9d57a804ea157f8e, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:04.529500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1357ec6-3fc4-4eaa-ba27-fbecf9649dc4 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:04.533912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463181d-65b3-4785-bd44-f33490eedca0 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:04.554085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac6080-8bd7-494a-b3a3-936740687e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:04.560530 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac6080-8bd7-494a-b3a3-936740687e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:04.567158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac6080-8bd7-494a-b3a3-936740687e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:04.567158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac6080-8bd7-494a-b3a3-936740687e22 admin admin] PATH_INFO: `/v3/projects/f7b4e938831449808f1b0602ef8e2a3e/users/42a99bac32ac4467af31fea739079f16/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:04.582419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:04.584627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 883/1781] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:04 2022] PUT /identity/v3/projects/9efcf76d0cab47029ff3933deb732392/users/e2c1c3a1797048df9d57a804ea157f8e/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:04.601438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4a82b-1a07-4f10-99c6-e59543ba2f70 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:04.601731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4a82b-1a07-4f10-99c6-e59543ba2f70 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:04.602017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4a82b-1a07-4f10-99c6-e59543ba2f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:04.661085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac6080-8bd7-494a-b3a3-936740687e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b4e938831449808f1b0602ef8e2a3e, user_id=42a99bac32ac4467af31fea739079f16, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:04.668658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac6080-8bd7-494a-b3a3-936740687e22 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:04.700902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-25c4a82b-1a07-4f10-99c6-e59543ba2f70 None None] MFA Rules not processed for user `e2c1c3a1797048df9d57a804ea157f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:04.702748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-25c4a82b-1a07-4f10-99c6-e59543ba2f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:04.720375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 899/1782] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:04 2022] PUT /identity/v3/projects/f7b4e938831449808f1b0602ef8e2a3e/users/42a99bac32ac4467af31fea739079f16/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:04.726179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac6080-8bd7-494a-b3a3-936740687e22 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:04.731139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:04.944335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac6080-8bd7-494a-b3a3-936740687e22 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:04.945178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 884/1783] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:04.946451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4a82b-1a07-4f10-99c6-e59543ba2f70 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:04.948325 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-25c4a82b-1a07-4f10-99c6-e59543ba2f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:04.950539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e089848-a95b-44b2-b574-cc4308bb8798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:04.951432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e089848-a95b-44b2-b574-cc4308bb8798 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:04.951888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e089848-a95b-44b2-b574-cc4308bb8798 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:04.953571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e089848-a95b-44b2-b574-cc4308bb8798 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:04.955060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e089848-a95b-44b2-b574-cc4308bb8798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:04.956894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e089848-a95b-44b2-b574-cc4308bb8798 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:04.980767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4a82b-1a07-4f10-99c6-e59543ba2f70 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:04.990527 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:04.991248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:04.991532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:04.991808 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] PATH_INFO: `/v3/users/0c36cc83d9894d01954b507dad99205f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:04.999788 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c36cc83d9894d01954b507dad99205f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:05.001795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:05.010138 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 900/1784] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:04 2022] GET /identity/v3/roles => generated 1427 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:05.013404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e089848-a95b-44b2-b574-cc4308bb8798 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:05.041770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e089848-a95b-44b2-b574-cc4308bb8798 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:05.066908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafdbb1-7d36-4a00-9c17-0b17f2823668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:05.073845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafdbb1-7d36-4a00-9c17-0b17f2823668 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:05.075806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafdbb1-7d36-4a00-9c17-0b17f2823668 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:05.077069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafdbb1-7d36-4a00-9c17-0b17f2823668 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:05.079411 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafdbb1-7d36-4a00-9c17-0b17f2823668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:05.084838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafdbb1-7d36-4a00-9c17-0b17f2823668 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:05.099909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c36cc83d9894d01954b507dad99205f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:05.100701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c36cc83d9894d01954b507dad99205f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:05.126411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c36cc83d9894d01954b507dad99205f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:05.127385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c36cc83d9894d01954b507dad99205f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:05.149156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c36cc83d9894d01954b507dad99205f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:05.177954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 901/1785] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:05 2022] POST /identity/v3/projects => generated 382 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:05.180731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafdbb1-7d36-4a00-9c17-0b17f2823668 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:05.188460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4fafdbb1-7d36-4a00-9c17-0b17f2823668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:05.219771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 885/1786] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:04 2022] DELETE /identity/v3/users/0c36cc83d9894d01954b507dad99205f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:05.220920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:05.224683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:05.382656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173fe5f-72a6-4809-9185-2b678d14cb49 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:05.398146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7291d-873c-4e78-a97e-ee0767299abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:05.408256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7291d-873c-4e78-a97e-ee0767299abe admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:05.408946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7291d-873c-4e78-a97e-ee0767299abe admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:05.410788 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7291d-873c-4e78-a97e-ee0767299abe admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:05.412276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7291d-873c-4e78-a97e-ee0767299abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:05.418518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafdbb1-7d36-4a00-9c17-0b17f2823668 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:05.426499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7291d-873c-4e78-a97e-ee0767299abe admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:05.434691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca451eb-0f02-4964-adc9-f14c216dde16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:05.435359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca451eb-0f02-4964-adc9-f14c216dde16 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:05.435645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca451eb-0f02-4964-adc9-f14c216dde16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:05.438363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca451eb-0f02-4964-adc9-f14c216dde16 admin admin] PATH_INFO: `/v3/projects/f7b4e938831449808f1b0602ef8e2a3e/users/42a99bac32ac4467af31fea739079f16/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:05.443491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca451eb-0f02-4964-adc9-f14c216dde16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b4e938831449808f1b0602ef8e2a3e, user_id=42a99bac32ac4467af31fea739079f16, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:05.468060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca451eb-0f02-4964-adc9-f14c216dde16 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:05.512087 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 902/1787] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:05 2022] PUT /identity/v3/projects/f7b4e938831449808f1b0602ef8e2a3e/users/42a99bac32ac4467af31fea739079f16/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:05.519662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6875-1e54-4464-b0af-a2541a81c91e None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:05.519662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6875-1e54-4464-b0af-a2541a81c91e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:05.520409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6875-1e54-4464-b0af-a2541a81c91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:05.526851 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 886/1788] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:05 2022] POST /identity/v3/users => generated 298 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:05.530225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a361c80-c1cf-4c0b-b687-b251d68900f1 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:05.542231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a361c80-c1cf-4c0b-b687-b251d68900f1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:05.542548 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a361c80-c1cf-4c0b-b687-b251d68900f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:05.601650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-972a6875-1e54-4464-b0af-a2541a81c91e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:05.606635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-972a6875-1e54-4464-b0af-a2541a81c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:05.622376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:05.642856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-4a361c80-c1cf-4c0b-b687-b251d68900f1 None None] MFA Rules not processed for user `42a99bac32ac4467af31fea739079f16`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:05.658968 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4a361c80-c1cf-4c0b-b687-b251d68900f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:05.741061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:05.788386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 903/1789] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:05.788386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a6875-1e54-4464-b0af-a2541a81c91e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:05.808670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a6875-1e54-4464-b0af-a2541a81c91e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:05.815580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944a1ee-e1a2-4ae6-89f7-7a0afba24b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:05.816353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944a1ee-e1a2-4ae6-89f7-7a0afba24b34 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:05.816726 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944a1ee-e1a2-4ae6-89f7-7a0afba24b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:05.817006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944a1ee-e1a2-4ae6-89f7-7a0afba24b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:05.818403 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944a1ee-e1a2-4ae6-89f7-7a0afba24b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:05.821112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944a1ee-e1a2-4ae6-89f7-7a0afba24b34 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:05.842023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 887/1790] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:05.858495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 904/1791] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:05 2022] GET /identity/v3/roles => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:05.858697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a361c80-c1cf-4c0b-b687-b251d68900f1 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:05.858697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4a361c80-c1cf-4c0b-b687-b251d68900f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:05.860782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944a1ee-e1a2-4ae6-89f7-7a0afba24b34 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:05.882539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944a1ee-e1a2-4ae6-89f7-7a0afba24b34 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:05.900088 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adf66b-fc41-476f-b249-b31097f293a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:05.901288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf66b-fc41-476f-b249-b31097f293a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:05.901797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf66b-fc41-476f-b249-b31097f293a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:05.902291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf66b-fc41-476f-b249-b31097f293a3 admin admin] PATH_INFO: `/v3/projects/3dc14faec3bc4676b9c259205f525c85/users/b3fd606521ac4a499eae0db4e92cea9c/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:05.955281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adf66b-fc41-476f-b249-b31097f293a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc14faec3bc4676b9c259205f525c85, user_id=b3fd606521ac4a499eae0db4e92cea9c, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:05.960705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adf66b-fc41-476f-b249-b31097f293a3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:05.988099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 905/1792] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:05 2022] PUT /identity/v3/projects/3dc14faec3bc4676b9c259205f525c85/users/b3fd606521ac4a499eae0db4e92cea9c/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:05.996873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adf66b-fc41-476f-b249-b31097f293a3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:06.035336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a361c80-c1cf-4c0b-b687-b251d68900f1 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:06.145217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adf66b-fc41-476f-b249-b31097f293a3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:06.152036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331d042-a078-4898-9a1c-787d3d65cb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:06.152504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c200fe-e0b3-42b0-8032-02b6ceabd781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:06.152863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331d042-a078-4898-9a1c-787d3d65cb33 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:06.153208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331d042-a078-4898-9a1c-787d3d65cb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:06.153372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c200fe-e0b3-42b0-8032-02b6ceabd781 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:06.153522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331d042-a078-4898-9a1c-787d3d65cb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:06.153729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c200fe-e0b3-42b0-8032-02b6ceabd781 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:06.154108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c200fe-e0b3-42b0-8032-02b6ceabd781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:06.154281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331d042-a078-4898-9a1c-787d3d65cb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:06.157314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331d042-a078-4898-9a1c-787d3d65cb33 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:06.177581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 906/1793] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:05 2022] GET /identity/v3/roles => generated 1427 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:06.179083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331d042-a078-4898-9a1c-787d3d65cb33 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:06.182915 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c331d042-a078-4898-9a1c-787d3d65cb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:06.270324 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331d042-a078-4898-9a1c-787d3d65cb33 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:06.283493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459dfd9-c405-4e53-8a4f-cefbe21a1191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:06.284224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459dfd9-c405-4e53-8a4f-cefbe21a1191 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:06.284733 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459dfd9-c405-4e53-8a4f-cefbe21a1191 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:06.284998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459dfd9-c405-4e53-8a4f-cefbe21a1191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:06.286445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c200fe-e0b3-42b0-8032-02b6ceabd781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:06.288332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c200fe-e0b3-42b0-8032-02b6ceabd781 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:06.302182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 888/1794] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:54:06.302558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c200fe-e0b3-42b0-8032-02b6ceabd781 service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:06.306335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459dfd9-c405-4e53-8a4f-cefbe21a1191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:06.309375 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:06.311737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459dfd9-c405-4e53-8a4f-cefbe21a1191 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:06.320748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c200fe-e0b3-42b0-8032-02b6ceabd781 service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:06.331858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6d842-fde4-4c74-9450-5ecad38ceef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:06.332575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6d842-fde4-4c74-9450-5ecad38ceef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:06.332865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6d842-fde4-4c74-9450-5ecad38ceef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:06.333149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6d842-fde4-4c74-9450-5ecad38ceef3 admin admin] PATH_INFO: `/v3/projects/3dc14faec3bc4676b9c259205f525c85/users/b3fd606521ac4a499eae0db4e92cea9c/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:06.334289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 907/1795] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:06.345730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6d842-fde4-4c74-9450-5ecad38ceef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc14faec3bc4676b9c259205f525c85, user_id=b3fd606521ac4a499eae0db4e92cea9c, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:06.350790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6d842-fde4-4c74-9450-5ecad38ceef3 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:06.458658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 889/1796] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:06 2022] PUT /identity/v3/projects/3dc14faec3bc4676b9c259205f525c85/users/b3fd606521ac4a499eae0db4e92cea9c/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:06.463578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9008b7-c78b-4507-a9b6-0567ba41d5c1 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:06.464012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9008b7-c78b-4507-a9b6-0567ba41d5c1 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:06.464520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9008b7-c78b-4507-a9b6-0567ba41d5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:06.570015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ed9008b7-c78b-4507-a9b6-0567ba41d5c1 None None] MFA Rules not processed for user `b3fd606521ac4a499eae0db4e92cea9c`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:06.571703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ed9008b7-c78b-4507-a9b6-0567ba41d5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:06.706501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:06.794294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 908/1797] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:06.795774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6d842-fde4-4c74-9450-5ecad38ceef3 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:06.798141 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f6b6d842-fde4-4c74-9450-5ecad38ceef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:06.901282 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6d842-fde4-4c74-9450-5ecad38ceef3 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:06.919564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffeabec-e750-449e-a52e-619e99f2cce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:06.922351 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffeabec-e750-449e-a52e-619e99f2cce8 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:06.923657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffeabec-e750-449e-a52e-619e99f2cce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:06.924090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffeabec-e750-449e-a52e-619e99f2cce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:06.946483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffeabec-e750-449e-a52e-619e99f2cce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:06.950032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffeabec-e750-449e-a52e-619e99f2cce8 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:06.966483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 890/1798] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:07.753283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9008b7-c78b-4507-a9b6-0567ba41d5c1 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:07.765780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9008b7-c78b-4507-a9b6-0567ba41d5c1 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:07.772801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ea566-1222-4b9d-83d7-0671f71a52e9 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3fd606521ac4a499eae0db4e92cea9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc14faec3bc4676b9c259205f525c85', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:07.773545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ea566-1222-4b9d-83d7-0671f71a52e9 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:07.773947 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ea566-1222-4b9d-83d7-0671f71a52e9 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:07.774221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ea566-1222-4b9d-83d7-0671f71a52e9 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:07.775754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ea566-1222-4b9d-83d7-0671f71a52e9 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:07.776054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ea566-1222-4b9d-83d7-0671f71a52e9 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:07.777769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ea566-1222-4b9d-83d7-0671f71a52e9 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:07.822513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 909/1799] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:54:07.826601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffeabec-e750-449e-a52e-619e99f2cce8 service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:07.854316 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffeabec-e750-449e-a52e-619e99f2cce8 service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:07.861818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b10fd-2f23-455c-8404-357df121470d tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3fd606521ac4a499eae0db4e92cea9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc14faec3bc4676b9c259205f525c85', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:07.862924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b10fd-2f23-455c-8404-357df121470d tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:07.863462 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b10fd-2f23-455c-8404-357df121470d tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:07.863888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b10fd-2f23-455c-8404-357df121470d tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:07.864772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b10fd-2f23-455c-8404-357df121470d tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:07.868516 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b10fd-2f23-455c-8404-357df121470d tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:07.965630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 891/1800] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:07 2022] POST /identity/v3/projects => generated 356 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:07.967030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ea566-1222-4b9d-83d7-0671f71a52e9 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:08.022922 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ea566-1222-4b9d-83d7-0671f71a52e9 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:08.222551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af58d95-4f52-4b21-a0bb-b714cbdf4940 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3fd606521ac4a499eae0db4e92cea9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc14faec3bc4676b9c259205f525c85', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:08.223278 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af58d95-4f52-4b21-a0bb-b714cbdf4940 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:08.223746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af58d95-4f52-4b21-a0bb-b714cbdf4940 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:08.224864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af58d95-4f52-4b21-a0bb-b714cbdf4940 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:08.225739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af58d95-4f52-4b21-a0bb-b714cbdf4940 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:08.226177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af58d95-4f52-4b21-a0bb-b714cbdf4940 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:08.231587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af58d95-4f52-4b21-a0bb-b714cbdf4940 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:08.342870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 910/1801] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:54:08.445220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b10fd-2f23-455c-8404-357df121470d tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:08.454794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af58d95-4f52-4b21-a0bb-b714cbdf4940 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:08.456822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6af58d95-4f52-4b21-a0bb-b714cbdf4940 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:08.476894 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b10fd-2f23-455c-8404-357df121470d tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:08.515881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3fd606521ac4a499eae0db4e92cea9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc14faec3bc4676b9c259205f525c85', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:08.516783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:08.517240 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:08.517618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] PATH_INFO: `/v3/projects/35617e7932a9416a89581aed8db09a34` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:08.519732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: Authorizing `identity:delete_project(project_id=35617e7932a9416a89581aed8db09a34)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:08.526326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:08.637058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35617e7932a9416a89581aed8db09a34', 'request_id': 'req-a58cd205-bedd-425a-99e5-b43bd7f525ef'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:08.654311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35617e7932a9416a89581aed8db09a34', 'request_id': 'req-a58cd205-bedd-425a-99e5-b43bd7f525ef'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:08.662304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35617e7932a9416a89581aed8db09a34', 'request_id': 'req-a58cd205-bedd-425a-99e5-b43bd7f525ef'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:08.673152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af58d95-4f52-4b21-a0bb-b714cbdf4940 tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:08.694458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] The token cache is being invalidate because project 35617e7932a9416a89581aed8db09a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:08.695548 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:08.701020 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a58cd205-bedd-425a-99e5-b43bd7f525ef tempest-VolumeQuotaClassesTest-1194315141 tempest-VolumeQuotaClassesTest-1194315141-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:08.713002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 892/1802] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:08 2022] DELETE /identity/v3/projects/35617e7932a9416a89581aed8db09a34 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:08.823592 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:08.824452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:08.824850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:08.825231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] PATH_INFO: `/v3/projects/3f020f33476c4a5791c238298b68ab92` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:08.826781 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f020f33476c4a5791c238298b68ab92)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:08.828863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:08.854582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:08.897279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347593b-a167-4afa-acb4-b1d3bed5ab0d None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:08.899443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347593b-a167-4afa-acb4-b1d3bed5ab0d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:08.899953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347593b-a167-4afa-acb4-b1d3bed5ab0d None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:08.904343 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 893/1803] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 16:54:08 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:54:08.939598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f020f33476c4a5791c238298b68ab92', 'request_id': 'req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:08.956813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f020f33476c4a5791c238298b68ab92', 'request_id': 'req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:08.969192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f020f33476c4a5791c238298b68ab92', 'request_id': 'req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:08.997372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] The token cache is being invalidate because project 3f020f33476c4a5791c238298b68ab92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:08.997795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:08.998393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6ecb5d31-b6dc-42a2-ae0b-4f69e89f62ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.003497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 911/1804] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:08 2022] DELETE /identity/v3/projects/3f020f33476c4a5791c238298b68ab92 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:09.008736 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347593b-a167-4afa-acb4-b1d3bed5ab0d None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:09.012449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1347593b-a167-4afa-acb4-b1d3bed5ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:09.112851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21255-3295-42ce-ad4b-6092c8b357e8 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:09.113141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21255-3295-42ce-ad4b-6092c8b357e8 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:09.113419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21255-3295-42ce-ad4b-6092c8b357e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:09.158980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-b1a21255-3295-42ce-ad4b-6092c8b357e8 None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:09.160244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b1a21255-3295-42ce-ad4b-6092c8b357e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:09.163069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:09.207293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347593b-a167-4afa-acb4-b1d3bed5ab0d None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:09.216231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:09.217798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:09.218573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:09.219042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] PATH_INFO: `/v3/users/9a0202542ac4408da9ee8a566dd14755` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:09.220711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0202542ac4408da9ee8a566dd14755)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:09.225235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:09.337746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0202542ac4408da9ee8a566dd14755'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.338748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0202542ac4408da9ee8a566dd14755'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.366271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0202542ac4408da9ee8a566dd14755'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.366406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 912/1805] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 16:54:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:09.367186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0202542ac4408da9ee8a566dd14755'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.367298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21255-3295-42ce-ad4b-6092c8b357e8 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:09.369286 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b1a21255-3295-42ce-ad4b-6092c8b357e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:09.384105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0202542ac4408da9ee8a566dd14755'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.421492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21255-3295-42ce-ad4b-6092c8b357e8 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:09.426061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 894/1806] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:09 2022] DELETE /identity/v3/users/9a0202542ac4408da9ee8a566dd14755 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:09.516600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:09.519092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:09.638372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c7e38-219d-4aa5-a1b1-9e673c64d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:09.640546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c7e38-219d-4aa5-a1b1-9e673c64d391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:09.640833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c7e38-219d-4aa5-a1b1-9e673c64d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:09.641113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c7e38-219d-4aa5-a1b1-9e673c64d391 admin admin] PATH_INFO: `/v3/users/e2c1c3a1797048df9d57a804ea157f8e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:09.646876 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c7e38-219d-4aa5-a1b1-9e673c64d391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c1c3a1797048df9d57a804ea157f8e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:09.654939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c7e38-219d-4aa5-a1b1-9e673c64d391 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:09.663626 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761e47a-9e92-47dc-ab3a-118c0363e44e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:09.671203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92253866-0176-4f03-869f-038e01a5e1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:09.673364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92253866-0176-4f03-869f-038e01a5e1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:09.673727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92253866-0176-4f03-869f-038e01a5e1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:09.674052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92253866-0176-4f03-869f-038e01a5e1d0 admin admin] PATH_INFO: `/v3/users/a1c6a4f430db4795a2f2b8f2c3b7a86a` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:09.675639 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92253866-0176-4f03-869f-038e01a5e1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c6a4f430db4795a2f2b8f2c3b7a86a)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:09.679246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92253866-0176-4f03-869f-038e01a5e1d0 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:09.767798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:09.824590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-0b9c7e38-219d-4aa5-a1b1-9e673c64d391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c1c3a1797048df9d57a804ea157f8e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.825981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-92253866-0176-4f03-869f-038e01a5e1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c6a4f430db4795a2f2b8f2c3b7a86a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.826871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-92253866-0176-4f03-869f-038e01a5e1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c6a4f430db4795a2f2b8f2c3b7a86a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.847424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-0b9c7e38-219d-4aa5-a1b1-9e673c64d391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c1c3a1797048df9d57a804ea157f8e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.878910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-0b9c7e38-219d-4aa5-a1b1-9e673c64d391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c1c3a1797048df9d57a804ea157f8e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.880980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-0b9c7e38-219d-4aa5-a1b1-9e673c64d391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c1c3a1797048df9d57a804ea157f8e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.884548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-0b9c7e38-219d-4aa5-a1b1-9e673c64d391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c1c3a1797048df9d57a804ea157f8e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.888276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-92253866-0176-4f03-869f-038e01a5e1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c6a4f430db4795a2f2b8f2c3b7a86a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.891566 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-92253866-0176-4f03-869f-038e01a5e1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c6a4f430db4795a2f2b8f2c3b7a86a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.919592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-92253866-0176-4f03-869f-038e01a5e1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c6a4f430db4795a2f2b8f2c3b7a86a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:09.926011 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:09.955696 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 913/1807] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:09 2022] DELETE /identity/v3/users/e2c1c3a1797048df9d57a804ea157f8e => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:09.961996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb48f6-c31f-4980-82db-d6ad782ead0c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:09.962321 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb48f6-c31f-4980-82db-d6ad782ead0c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:09.965899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb48f6-c31f-4980-82db-d6ad782ead0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:09.969869 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 895/1808] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:09 2022] DELETE /identity/v3/users/a1c6a4f430db4795a2f2b8f2c3b7a86a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:09.974255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c2239-820e-4433-a11a-ea680ceb3568 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:09.974554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c2239-820e-4433-a11a-ea680ceb3568 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:09.974839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c2239-820e-4433-a11a-ea680ceb3568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:10.019512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-cf5c2239-820e-4433-a11a-ea680ceb3568 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:10.019730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-57bb48f6-c31f-4980-82db-d6ad782ead0c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:10.020853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-57bb48f6-c31f-4980-82db-d6ad782ead0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:10.021501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cf5c2239-820e-4433-a11a-ea680ceb3568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:10.131180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 896/1809] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:10.166777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 914/1810] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:10.182676 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c2239-820e-4433-a11a-ea680ceb3568 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:10.184410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cf5c2239-820e-4433-a11a-ea680ceb3568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:10.208108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb48f6-c31f-4980-82db-d6ad782ead0c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:10.211393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-57bb48f6-c31f-4980-82db-d6ad782ead0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:10.443112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb48f6-c31f-4980-82db-d6ad782ead0c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:10.455424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137069f3-8ecb-4b98-85ec-791f03367ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:10.458716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137069f3-8ecb-4b98-85ec-791f03367ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:10.459399 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137069f3-8ecb-4b98-85ec-791f03367ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:10.461095 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137069f3-8ecb-4b98-85ec-791f03367ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:10.478407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c2239-820e-4433-a11a-ea680ceb3568 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:10.486838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137069f3-8ecb-4b98-85ec-791f03367ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:10.491806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e2895-2d91-433d-8859-1aaab76c25b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:10.492500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137069f3-8ecb-4b98-85ec-791f03367ae0 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:10.498149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2895-2d91-433d-8859-1aaab76c25b2 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:10.498690 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2895-2d91-433d-8859-1aaab76c25b2 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:10.499149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2895-2d91-433d-8859-1aaab76c25b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:10.503388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-dd1e2895-2d91-433d-8859-1aaab76c25b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:10.522764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 915/1811] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:10.524312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137069f3-8ecb-4b98-85ec-791f03367ae0 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:10.537273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e2895-2d91-433d-8859-1aaab76c25b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:10.541969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e2895-2d91-433d-8859-1aaab76c25b2 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:10.549376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137069f3-8ecb-4b98-85ec-791f03367ae0 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:10.560798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09513c9c-f6fe-4e47-b59b-f03ae7b1d5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:10.563625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09513c9c-f6fe-4e47-b59b-f03ae7b1d5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:10.565493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09513c9c-f6fe-4e47-b59b-f03ae7b1d5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:10.565794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09513c9c-f6fe-4e47-b59b-f03ae7b1d5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:10.588001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 897/1812] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:10.588593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e2895-2d91-433d-8859-1aaab76c25b2 service nova] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:10.592713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-dd1e2895-2d91-433d-8859-1aaab76c25b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:10.611350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09513c9c-f6fe-4e47-b59b-f03ae7b1d5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:10.616779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09513c9c-f6fe-4e47-b59b-f03ae7b1d5b9 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:10.642987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e2895-2d91-433d-8859-1aaab76c25b2 service nova] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:10.648058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 916/1813] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:10.652455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:10.653203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:10.653502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:10.653778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] PATH_INFO: `/v3/projects/4a9010f20d2b463ca3cd27b944b58877` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:10.655151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9010f20d2b463ca3cd27b944b58877)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:10.657780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:10.735965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594fadb-a420-406e-8f3d-90c11ce3afc2 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:10.736277 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594fadb-a420-406e-8f3d-90c11ce3afc2 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:10.736561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594fadb-a420-406e-8f3d-90c11ce3afc2 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:10.738739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 917/1814] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 16:54:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:54:10.756839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9010f20d2b463ca3cd27b944b58877', 'request_id': 'req-f27199f5-f708-4d62-a2be-4a1009cde057'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:10.768240 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9010f20d2b463ca3cd27b944b58877', 'request_id': 'req-f27199f5-f708-4d62-a2be-4a1009cde057'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:10.771338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303e41-754a-434c-8d0f-4e17adc2f78c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:10.772435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303e41-754a-434c-8d0f-4e17adc2f78c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:10.772916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303e41-754a-434c-8d0f-4e17adc2f78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:10.782247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9010f20d2b463ca3cd27b944b58877', 'request_id': 'req-f27199f5-f708-4d62-a2be-4a1009cde057'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:10.808504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:10.812905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] The token cache is being invalidate because project 4a9010f20d2b463ca3cd27b944b58877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:10.817324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:10.817969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:10.819732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 898/1815] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:10 2022] DELETE /identity/v3/projects/4a9010f20d2b463ca3cd27b944b58877 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:10.825359 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:10.828014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:10.921209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-8a303e41-754a-434c-8d0f-4e17adc2f78c None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:10.928934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8a303e41-754a-434c-8d0f-4e17adc2f78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:10.981092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27199f5-f708-4d62-a2be-4a1009cde057 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:10.996494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d9c93-5310-4bb7-bf6c-cf62284ae4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:10.997188 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d9c93-5310-4bb7-bf6c-cf62284ae4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:10.997474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d9c93-5310-4bb7-bf6c-cf62284ae4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:11.000539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d9c93-5310-4bb7-bf6c-cf62284ae4d8 admin admin] PATH_INFO: `/v3/users/b5755c1db3ff4d02a8fbfbdd2328718c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:11.002533 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d9c93-5310-4bb7-bf6c-cf62284ae4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5755c1db3ff4d02a8fbfbdd2328718c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:11.004555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d9c93-5310-4bb7-bf6c-cf62284ae4d8 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:11.075262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:11.150645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-804d9c93-5310-4bb7-bf6c-cf62284ae4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5755c1db3ff4d02a8fbfbdd2328718c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:11.153298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-804d9c93-5310-4bb7-bf6c-cf62284ae4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5755c1db3ff4d02a8fbfbdd2328718c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:11.157087 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 918/1816] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 16:54:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:11.158167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303e41-754a-434c-8d0f-4e17adc2f78c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:11.166107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8a303e41-754a-434c-8d0f-4e17adc2f78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:11.193637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-804d9c93-5310-4bb7-bf6c-cf62284ae4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5755c1db3ff4d02a8fbfbdd2328718c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:11.194819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-804d9c93-5310-4bb7-bf6c-cf62284ae4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5755c1db3ff4d02a8fbfbdd2328718c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:11.200727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303e41-754a-434c-8d0f-4e17adc2f78c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:11.211775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:11.214011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:11.214524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:11.215257 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] PATH_INFO: `/v3/projects/ff20eb03896c48f788208c4af8912588` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:11.215501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-804d9c93-5310-4bb7-bf6c-cf62284ae4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5755c1db3ff4d02a8fbfbdd2328718c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:11.217140 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff20eb03896c48f788208c4af8912588)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:11.220670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:11.240898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 899/1817] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:10 2022] DELETE /identity/v3/users/b5755c1db3ff4d02a8fbfbdd2328718c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:11.330842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff20eb03896c48f788208c4af8912588', 'request_id': 'req-fe026dee-6b1b-40de-a718-ce84855310b1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:11.361441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff20eb03896c48f788208c4af8912588', 'request_id': 'req-fe026dee-6b1b-40de-a718-ce84855310b1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:11.403975 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff20eb03896c48f788208c4af8912588', 'request_id': 'req-fe026dee-6b1b-40de-a718-ce84855310b1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:11.429617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] The token cache is being invalidate because project ff20eb03896c48f788208c4af8912588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:11.430472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:11.431981 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-fe026dee-6b1b-40de-a718-ce84855310b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:11.435578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 919/1818] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:11 2022] DELETE /identity/v3/projects/ff20eb03896c48f788208c4af8912588 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:11.442339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edf2f6-9035-4e3a-9ef9-f25789919809 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:11.442975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edf2f6-9035-4e3a-9ef9-f25789919809 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:11.443514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edf2f6-9035-4e3a-9ef9-f25789919809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:11.538740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b0edf2f6-9035-4e3a-9ef9-f25789919809 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:11.542852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b0edf2f6-9035-4e3a-9ef9-f25789919809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:11.723885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f6666-f530-49eb-8f5b-0f61e2d8171b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:11.724361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f6666-f530-49eb-8f5b-0f61e2d8171b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:11.724770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f6666-f530-49eb-8f5b-0f61e2d8171b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:11.740197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 900/1819] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:11.800763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edf2f6-9035-4e3a-9ef9-f25789919809 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:11.807104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b0edf2f6-9035-4e3a-9ef9-f25789919809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:11.884924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-498f6666-f530-49eb-8f5b-0f61e2d8171b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:11.889818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-498f6666-f530-49eb-8f5b-0f61e2d8171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:11.915458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 920/1820] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:11.918104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f6666-f530-49eb-8f5b-0f61e2d8171b None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:11.944649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:11.978107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f6666-f530-49eb-8f5b-0f61e2d8171b None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:12.005338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7384c-234b-43e0-9582-d5cea79807c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:12.006170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7384c-234b-43e0-9582-d5cea79807c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:12.006625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7384c-234b-43e0-9582-d5cea79807c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:12.007138 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7384c-234b-43e0-9582-d5cea79807c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:12.008000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7384c-234b-43e0-9582-d5cea79807c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:12.011932 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7384c-234b-43e0-9582-d5cea79807c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:12.014433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7384c-234b-43e0-9582-d5cea79807c6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:12.021456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edf2f6-9035-4e3a-9ef9-f25789919809 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:12.030643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc9f1f-919e-4b54-b44e-0a59c76a9b1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:12.031488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc9f1f-919e-4b54-b44e-0a59c76a9b1b service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:12.031862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc9f1f-919e-4b54-b44e-0a59c76a9b1b service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:12.032287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc9f1f-919e-4b54-b44e-0a59c76a9b1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:12.035821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-41bc9f1f-919e-4b54-b44e-0a59c76a9b1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:12.055370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc9f1f-919e-4b54-b44e-0a59c76a9b1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:12.057329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc9f1f-919e-4b54-b44e-0a59c76a9b1b service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:12.074905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 901/1821] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:12.077495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 921/1822] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:54:12.082699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc9f1f-919e-4b54-b44e-0a59c76a9b1b service nova] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:12.098334 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc9f1f-919e-4b54-b44e-0a59c76a9b1b service nova] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:12.104280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072822f-c334-46ab-a4d9-fd9e962cce5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:12.105023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072822f-c334-46ab-a4d9-fd9e962cce5e admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:12.105428 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072822f-c334-46ab-a4d9-fd9e962cce5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:12.105732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072822f-c334-46ab-a4d9-fd9e962cce5e admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:12.106561 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072822f-c334-46ab-a4d9-fd9e962cce5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:12.108962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072822f-c334-46ab-a4d9-fd9e962cce5e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:12.163274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 902/1823] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:12 2022] POST /identity/v3/projects => generated 384 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:12.164598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7384c-234b-43e0-9582-d5cea79807c6 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:12.184398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7384c-234b-43e0-9582-d5cea79807c6 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:12.370648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef80a6-3724-4fe5-a21e-89b8c201885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:12.371588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef80a6-3724-4fe5-a21e-89b8c201885e admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:12.371909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef80a6-3724-4fe5-a21e-89b8c201885e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:12.372267 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef80a6-3724-4fe5-a21e-89b8c201885e admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:12.379950 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef80a6-3724-4fe5-a21e-89b8c201885e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:12.382202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef80a6-3724-4fe5-a21e-89b8c201885e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:12.435939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 922/1824] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:12 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:12.442656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072822f-c334-46ab-a4d9-fd9e962cce5e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:12.467224 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072822f-c334-46ab-a4d9-fd9e962cce5e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:12.478913 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bc7ce-339e-472b-9611-ee18b1bf90e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:12.479618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc7ce-339e-472b-9611-ee18b1bf90e4 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:12.479904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc7ce-339e-472b-9611-ee18b1bf90e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:12.480184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc7ce-339e-472b-9611-ee18b1bf90e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:12.480895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bc7ce-339e-472b-9611-ee18b1bf90e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:12.482535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bc7ce-339e-472b-9611-ee18b1bf90e4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:12.523704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 903/1825] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:12 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:12.527412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef80a6-3724-4fe5-a21e-89b8c201885e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:12.539225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef80a6-3724-4fe5-a21e-89b8c201885e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:12.546098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f7ae3-aadb-40b4-8ff0-5a042e9b52c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:12.546823 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7ae3-aadb-40b4-8ff0-5a042e9b52c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:12.547357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7ae3-aadb-40b4-8ff0-5a042e9b52c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:12.547701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7ae3-aadb-40b4-8ff0-5a042e9b52c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:12.548543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f7ae3-aadb-40b4-8ff0-5a042e9b52c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:12.550792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f7ae3-aadb-40b4-8ff0-5a042e9b52c6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:12.578438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 923/1826] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:12 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:12.583978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bc7ce-339e-472b-9611-ee18b1bf90e4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:12.595674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bc7ce-339e-472b-9611-ee18b1bf90e4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:12.600886 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d7f0b-25ba-4fd4-94c6-0195541466fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:12.601581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d7f0b-25ba-4fd4-94c6-0195541466fa admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:12.601862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d7f0b-25ba-4fd4-94c6-0195541466fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:12.602140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d7f0b-25ba-4fd4-94c6-0195541466fa admin admin] PATH_INFO: `/v3/projects/a74a26e1099945358f027ed76295f626/users/3317485484c64efea26cb53092e88616/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:12.625425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d7f0b-25ba-4fd4-94c6-0195541466fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74a26e1099945358f027ed76295f626, user_id=3317485484c64efea26cb53092e88616, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:12.629237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d7f0b-25ba-4fd4-94c6-0195541466fa admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:12.665161 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 904/1827] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:12 2022] PUT /identity/v3/projects/a74a26e1099945358f027ed76295f626/users/3317485484c64efea26cb53092e88616/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:12.677040 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739bb4b-dae4-45ed-95be-6bd2049da976 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:12.677343 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739bb4b-dae4-45ed-95be-6bd2049da976 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:12.677611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739bb4b-dae4-45ed-95be-6bd2049da976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:12.710809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:12.715904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-7739bb4b-dae4-45ed-95be-6bd2049da976 None None] MFA Rules not processed for user `3317485484c64efea26cb53092e88616`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:12.718814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7739bb4b-dae4-45ed-95be-6bd2049da976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:12.805228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 924/1828] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:12.809915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d7f0b-25ba-4fd4-94c6-0195541466fa admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:12.818786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739bb4b-dae4-45ed-95be-6bd2049da976 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:12.820566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7739bb4b-dae4-45ed-95be-6bd2049da976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:12.900878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739bb4b-dae4-45ed-95be-6bd2049da976 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:12.919280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:12.922075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:12.922678 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:12.923281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] PATH_INFO: `/v3/projects/2c66e1abe7254abc8a5659a026688482` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:12.925699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c66e1abe7254abc8a5659a026688482)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:12.929463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:12.930993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d7f0b-25ba-4fd4-94c6-0195541466fa admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:12.938760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9fd20-d711-46f9-8001-5c8a8c6b1f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:12.939834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9fd20-d711-46f9-8001-5c8a8c6b1f45 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:12.939834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9fd20-d711-46f9-8001-5c8a8c6b1f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:12.940014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9fd20-d711-46f9-8001-5c8a8c6b1f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:12.941017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9fd20-d711-46f9-8001-5c8a8c6b1f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:12.943228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9fd20-d711-46f9-8001-5c8a8c6b1f45 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:12.998357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 905/1829] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:12 2022] POST /identity/v3/projects => generated 384 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:12.999556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9fd20-d711-46f9-8001-5c8a8c6b1f45 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:13.001448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9fc9fd20-d711-46f9-8001-5c8a8c6b1f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:13.027424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c66e1abe7254abc8a5659a026688482', 'request_id': 'req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.039188 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c66e1abe7254abc8a5659a026688482', 'request_id': 'req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.047083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c66e1abe7254abc8a5659a026688482', 'request_id': 'req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.049986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:13.059777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] The token cache is being invalidate because project 2c66e1abe7254abc8a5659a026688482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:13.060149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.060972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.065663 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 925/1830] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:12 2022] DELETE /identity/v3/projects/2c66e1abe7254abc8a5659a026688482 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:13.066640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:13.068081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:13.089934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9fd20-d711-46f9-8001-5c8a8c6b1f45 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:13.111320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:13.148077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e2afa-1563-4814-9dd4-0bad6d3ccbe8 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:13.153722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:13.154562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:13.154673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:13.154980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] PATH_INFO: `/v3/projects/70a8a2afc3644957afeca6f15fe46d3a` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:13.156388 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a8a2afc3644957afeca6f15fe46d3a)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:13.158357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:13.165251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:13.166631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:13.167577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:13.167869 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] PATH_INFO: `/v3/projects/9efcf76d0cab47029ff3933deb732392` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:13.170920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efcf76d0cab47029ff3933deb732392)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:13.173491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:13.230449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a8a2afc3644957afeca6f15fe46d3a', 'request_id': 'req-a319fba3-3479-428b-8379-6166b00a7b17'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.240617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a8a2afc3644957afeca6f15fe46d3a', 'request_id': 'req-a319fba3-3479-428b-8379-6166b00a7b17'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.249068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a8a2afc3644957afeca6f15fe46d3a', 'request_id': 'req-a319fba3-3479-428b-8379-6166b00a7b17'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.251602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efcf76d0cab47029ff3933deb732392', 'request_id': 'req-db796616-0ba0-49c5-b1a8-d19b669d871a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.258859 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efcf76d0cab47029ff3933deb732392', 'request_id': 'req-db796616-0ba0-49c5-b1a8-d19b669d871a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.263448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] The token cache is being invalidate because project 70a8a2afc3644957afeca6f15fe46d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:13.263745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.264616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.266161 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efcf76d0cab47029ff3933deb732392', 'request_id': 'req-db796616-0ba0-49c5-b1a8-d19b669d871a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.267587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 926/1831] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:13 2022] DELETE /identity/v3/projects/70a8a2afc3644957afeca6f15fe46d3a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:13.268462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:13.269993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:13.281751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] The token cache is being invalidate because project 9efcf76d0cab47029ff3933deb732392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:13.282217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.283098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.284999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 906/1832] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:12 2022] DELETE /identity/v3/projects/9efcf76d0cab47029ff3933deb732392 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:13.285713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:13.288209 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:13.350084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319fba3-3479-428b-8379-6166b00a7b17 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:13.355863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb775c-be02-4399-97c0-316dcb0f4a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:13.356646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb775c-be02-4399-97c0-316dcb0f4a7a admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:13.357032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb775c-be02-4399-97c0-316dcb0f4a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:13.357406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb775c-be02-4399-97c0-316dcb0f4a7a admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:13.358206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb775c-be02-4399-97c0-316dcb0f4a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:13.358938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796616-0ba0-49c5-b1a8-d19b669d871a admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:13.360507 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb775c-be02-4399-97c0-316dcb0f4a7a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:13.363460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:13.364133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:13.364557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:13.364841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] PATH_INFO: `/v3/users/42a99bac32ac4467af31fea739079f16` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:13.366051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a99bac32ac4467af31fea739079f16)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:13.368837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:13.383756 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:13.385476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 927/1833] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:13 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:13.389279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb775c-be02-4399-97c0-316dcb0f4a7a admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:13.392464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1bdb775c-be02-4399-97c0-316dcb0f4a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:13.405286 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb775c-be02-4399-97c0-316dcb0f4a7a admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:13.411113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:13.411759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:13.412081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:13.412318 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] PATH_INFO: `/v3/users/03a7ee7a2d654a6a90bf90513205d55d` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:13.413744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a7ee7a2d654a6a90bf90513205d55d)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:13.416040 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:13.432196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a99bac32ac4467af31fea739079f16'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.432888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a99bac32ac4467af31fea739079f16'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.446737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a99bac32ac4467af31fea739079f16'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.447555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a99bac32ac4467af31fea739079f16'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.455553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a99bac32ac4467af31fea739079f16'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.469721 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a7ee7a2d654a6a90bf90513205d55d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.470867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 907/1834] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:13 2022] DELETE /identity/v3/users/42a99bac32ac4467af31fea739079f16 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:13.471656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:13.471774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:13.473121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:13.480803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a7ee7a2d654a6a90bf90513205d55d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.499323 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a7ee7a2d654a6a90bf90513205d55d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.499323 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a7ee7a2d654a6a90bf90513205d55d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.499323 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a7ee7a2d654a6a90bf90513205d55d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.533450 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 928/1835] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:13 2022] DELETE /identity/v3/users/03a7ee7a2d654a6a90bf90513205d55d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:13.535683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:13.550358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:13.574034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e084-cc44-46d4-ae1a-2487c54b6967 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:13.640729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:13.641600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:13.641938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:13.642310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] PATH_INFO: `/v3/users/b3fd606521ac4a499eae0db4e92cea9c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:13.643700 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3fd606521ac4a499eae0db4e92cea9c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:13.646059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:13.664751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088311ee-a326-439e-9d06-caba6a2c5a2b admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:13.672486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38e17b-d0a2-4338-8c31-f6405fd250db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:13.673346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e17b-d0a2-4338-8c31-f6405fd250db admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:13.673727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e17b-d0a2-4338-8c31-f6405fd250db admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:13.674102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e17b-d0a2-4338-8c31-f6405fd250db admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:13.675039 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38e17b-d0a2-4338-8c31-f6405fd250db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:13.677965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38e17b-d0a2-4338-8c31-f6405fd250db admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:13.693393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 929/1836] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:13 2022] GET /identity/v3/roles => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:13.698363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38e17b-d0a2-4338-8c31-f6405fd250db admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:13.713849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38e17b-d0a2-4338-8c31-f6405fd250db admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:13.720801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:13.722105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8530b51-e403-4c7c-a1ba-056641504740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:13.724897 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530b51-e403-4c7c-a1ba-056641504740 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:13.725705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530b51-e403-4c7c-a1ba-056641504740 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:13.726016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530b51-e403-4c7c-a1ba-056641504740 admin admin] PATH_INFO: `/v3/projects/e6e207f0c8634a6f8a77d58fd80e35e8/users/808d719653404003bd0d22bb2c14dee7/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:13.737326 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3fd606521ac4a499eae0db4e92cea9c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.738394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3fd606521ac4a499eae0db4e92cea9c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.760540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3fd606521ac4a499eae0db4e92cea9c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.761388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3fd606521ac4a499eae0db4e92cea9c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.772182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3fd606521ac4a499eae0db4e92cea9c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:13.777259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8530b51-e403-4c7c-a1ba-056641504740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e207f0c8634a6f8a77d58fd80e35e8, user_id=808d719653404003bd0d22bb2c14dee7, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:13.780608 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8530b51-e403-4c7c-a1ba-056641504740 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:13.792426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 908/1837] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:13 2022] DELETE /identity/v3/users/b3fd606521ac4a499eae0db4e92cea9c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:13.811078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 930/1838] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:13 2022] PUT /identity/v3/projects/e6e207f0c8634a6f8a77d58fd80e35e8/users/808d719653404003bd0d22bb2c14dee7/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:13.813420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:13.815058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:13.829172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8530b51-e403-4c7c-a1ba-056641504740 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:13.834005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e8530b51-e403-4c7c-a1ba-056641504740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:13.938190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dfda2-9771-4515-a24c-71d631af53a6 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:13.941619 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8530b51-e403-4c7c-a1ba-056641504740 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:13.945285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df37dff-a930-420c-892c-8b48bfe26e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:13.946352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df37dff-a930-420c-892c-8b48bfe26e83 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:13.946917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df37dff-a930-420c-892c-8b48bfe26e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:13.947477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df37dff-a930-420c-892c-8b48bfe26e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:13.948412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df37dff-a930-420c-892c-8b48bfe26e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:13.950734 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df37dff-a930-420c-892c-8b48bfe26e83 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:13.952384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:13.953374 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:13.954095 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:13.954384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] PATH_INFO: `/v3/projects/f7b4e938831449808f1b0602ef8e2a3e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:13.955740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b4e938831449808f1b0602ef8e2a3e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:13.958840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:13.962601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 909/1839] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:13 2022] GET /identity/v3/roles => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:13.966808 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df37dff-a930-420c-892c-8b48bfe26e83 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:14.006485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df37dff-a930-420c-892c-8b48bfe26e83 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:14.017138 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:INSERT=2,keystone:DELETE=6,keystone:SELECT=92 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:14.033942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b4e938831449808f1b0602ef8e2a3e', 'request_id': 'req-b7e4893c-320f-4d3e-b73c-ebaa12154609'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.059426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b4e938831449808f1b0602ef8e2a3e', 'request_id': 'req-b7e4893c-320f-4d3e-b73c-ebaa12154609'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.071739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b4e938831449808f1b0602ef8e2a3e', 'request_id': 'req-b7e4893c-320f-4d3e-b73c-ebaa12154609'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.087992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] The token cache is being invalidate because project f7b4e938831449808f1b0602ef8e2a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:14.088393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.089102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.091231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 931/1840] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:13 2022] DELETE /identity/v3/projects/f7b4e938831449808f1b0602ef8e2a3e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:14.092291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:14.100952 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b266c38-9685-4d8e-bba1-c34074663f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:14.102605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266c38-9685-4d8e-bba1-c34074663f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.103236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266c38-9685-4d8e-bba1-c34074663f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.103798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266c38-9685-4d8e-bba1-c34074663f71 admin admin] PATH_INFO: `/v3/projects/e6e207f0c8634a6f8a77d58fd80e35e8/users/808d719653404003bd0d22bb2c14dee7/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.106180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b266c38-9685-4d8e-bba1-c34074663f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e207f0c8634a6f8a77d58fd80e35e8, user_id=808d719653404003bd0d22bb2c14dee7, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:14.108693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:14.110625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b266c38-9685-4d8e-bba1-c34074663f71 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:14.125164 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 910/1841] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:13 2022] PUT /identity/v3/projects/e6e207f0c8634a6f8a77d58fd80e35e8/users/808d719653404003bd0d22bb2c14dee7/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:14.126015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4893c-320f-4d3e-b73c-ebaa12154609 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:14.127183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc465-e912-4228-9ec8-31e79e4dc66a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.127670 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc465-e912-4228-9ec8-31e79e4dc66a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.128257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc465-e912-4228-9ec8-31e79e4dc66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.150666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1a2fc465-e912-4228-9ec8-31e79e4dc66a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:14.152126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1a2fc465-e912-4228-9ec8-31e79e4dc66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:14.199891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:14.200565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.200848 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.201124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] PATH_INFO: `/v3/projects/665acbf2596747018cc634db9ee97bca` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.202496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665acbf2596747018cc634db9ee97bca)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:14.203878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:14.205706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:14.230214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 911/1842] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:14.231967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1b486-4ece-419d-821d-3c61ac115713 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.231967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1b486-4ece-419d-821d-3c61ac115713 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.232785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1b486-4ece-419d-821d-3c61ac115713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.265128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665acbf2596747018cc634db9ee97bca', 'request_id': 'req-9706f7c4-6204-40ad-bb33-22957c97b112'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.274934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-4bd1b486-4ece-419d-821d-3c61ac115713 None None] MFA Rules not processed for user `808d719653404003bd0d22bb2c14dee7`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:14.277055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4bd1b486-4ece-419d-821d-3c61ac115713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:14.294554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665acbf2596747018cc634db9ee97bca', 'request_id': 'req-9706f7c4-6204-40ad-bb33-22957c97b112'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.313194 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665acbf2596747018cc634db9ee97bca', 'request_id': 'req-9706f7c4-6204-40ad-bb33-22957c97b112'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.337008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] The token cache is being invalidate because project 665acbf2596747018cc634db9ee97bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:14.338019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.338937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-9706f7c4-6204-40ad-bb33-22957c97b112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.341781 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 932/1843] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:14 2022] DELETE /identity/v3/projects/665acbf2596747018cc634db9ee97bca => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:14.342890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077a9ee-e97c-4ce2-90d3-4389756689ed None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.343279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077a9ee-e97c-4ce2-90d3-4389756689ed None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.343585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077a9ee-e97c-4ce2-90d3-4389756689ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.391083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-3077a9ee-e97c-4ce2-90d3-4389756689ed None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:14.392373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3077a9ee-e97c-4ce2-90d3-4389756689ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:14.392907 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 912/1844] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:14.393549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1b486-4ece-419d-821d-3c61ac115713 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:14.395961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4bd1b486-4ece-419d-821d-3c61ac115713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:14.486888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:14.507196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 933/1845] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:14.507196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45196-2585-44e2-ad9e-61e3d4bbf143 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.507196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45196-2585-44e2-ad9e-61e3d4bbf143 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.507196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45196-2585-44e2-ad9e-61e3d4bbf143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.541226 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1b486-4ece-419d-821d-3c61ac115713 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:14.542361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-b3f45196-2585-44e2-ad9e-61e3d4bbf143 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:14.543761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b3f45196-2585-44e2-ad9e-61e3d4bbf143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:14.557681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:14.558391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.558819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.559154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] PATH_INFO: `/v3/projects/3dc14faec3bc4676b9c259205f525c85` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.560452 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc14faec3bc4676b9c259205f525c85)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:14.562007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 934/1846] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:14.562660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:14.563314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f45196-2585-44e2-ad9e-61e3d4bbf143 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:14.569867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b3f45196-2585-44e2-ad9e-61e3d4bbf143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:14.635195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc14faec3bc4676b9c259205f525c85', 'request_id': 'req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.641248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f45196-2585-44e2-ad9e-61e3d4bbf143 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:14.642432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc14faec3bc4676b9c259205f525c85', 'request_id': 'req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.648881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc14faec3bc4676b9c259205f525c85', 'request_id': 'req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.670448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] The token cache is being invalidate because project 3dc14faec3bc4676b9c259205f525c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:14.670783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.671720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:14.674028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 913/1847] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:14 2022] DELETE /identity/v3/projects/3dc14faec3bc4676b9c259205f525c85 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:14.676885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:14.679011 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:14.686766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:14.738510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8812cc-8b4f-4f00-90b3-2966716de795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:14.739102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8812cc-8b4f-4f00-90b3-2966716de795 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.739378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8812cc-8b4f-4f00-90b3-2966716de795 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.739855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8812cc-8b4f-4f00-90b3-2966716de795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.741757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-cf8812cc-8b4f-4f00-90b3-2966716de795 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:14.766898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ccb73-64aa-4fc9-a3bc-90a7376bfff0 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:14.774549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7841a-8361-4d49-8185-5e44788ebd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:14.775679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7841a-8361-4d49-8185-5e44788ebd94 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.776193 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7841a-8361-4d49-8185-5e44788ebd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.776693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7841a-8361-4d49-8185-5e44788ebd94 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.777859 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7841a-8361-4d49-8185-5e44788ebd94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:14.778171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7841a-8361-4d49-8185-5e44788ebd94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:14.779839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7841a-8361-4d49-8185-5e44788ebd94 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:14.793027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 914/1848] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:54:14.797694 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2983f7c-3ce3-4c42-9be8-5500fd679c25 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.797992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2983f7c-3ce3-4c42-9be8-5500fd679c25 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.798276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2983f7c-3ce3-4c42-9be8-5500fd679c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.815992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8812cc-8b4f-4f00-90b3-2966716de795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:14.817636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8812cc-8b4f-4f00-90b3-2966716de795 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:14.819598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d2983f7c-3ce3-4c42-9be8-5500fd679c25 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:14.820836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d2983f7c-3ce3-4c42-9be8-5500fd679c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:14.833692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 915/1849] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:14.833692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171303d-d53c-4088-a709-11669f33a524 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.833692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171303d-d53c-4088-a709-11669f33a524 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.833692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171303d-d53c-4088-a709-11669f33a524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.834094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 935/1850] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:14.834094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8812cc-8b4f-4f00-90b3-2966716de795 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:14.854921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8812cc-8b4f-4f00-90b3-2966716de795 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:14.865911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5e1e-b93b-453d-ac5e-a049bde4d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:14.866566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5e1e-b93b-453d-ac5e-a049bde4d613 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.866856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5e1e-b93b-453d-ac5e-a049bde4d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.867167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5e1e-b93b-453d-ac5e-a049bde4d613 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.868670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5e1e-b93b-453d-ac5e-a049bde4d613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:14.870972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5e1e-b93b-453d-ac5e-a049bde4d613 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:14.889767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-7171303d-d53c-4088-a709-11669f33a524 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:14.893652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-7171303d-d53c-4088-a709-11669f33a524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:14.906162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 916/1851] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:14.907132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171303d-d53c-4088-a709-11669f33a524 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:14.921952 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 936/1852] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:14 2022] POST /identity/v3/projects => generated 368 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:14.922169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b095fa0-0499-4d96-96a4-5b8d7b410cbc None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:14.922644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b095fa0-0499-4d96-96a4-5b8d7b410cbc None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:14.923092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b095fa0-0499-4d96-96a4-5b8d7b410cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:14.930532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171303d-d53c-4088-a709-11669f33a524 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:14.956115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-0b095fa0-0499-4d96-96a4-5b8d7b410cbc None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:14.957185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0b095fa0-0499-4d96-96a4-5b8d7b410cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:15.018157 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:15.059766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa106a-c26a-4ec7-baef-29650ff4212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.060473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa106a-c26a-4ec7-baef-29650ff4212a admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.060762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa106a-c26a-4ec7-baef-29650ff4212a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.061086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa106a-c26a-4ec7-baef-29650ff4212a admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.061806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa106a-c26a-4ec7-baef-29650ff4212a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:15.062115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa106a-c26a-4ec7-baef-29650ff4212a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.063846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa106a-c26a-4ec7-baef-29650ff4212a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.066199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 937/1853] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:15.067069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b095fa0-0499-4d96-96a4-5b8d7b410cbc None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.082219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 917/1854] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:54:15.082219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa106a-c26a-4ec7-baef-29650ff4212a admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.082547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b095fa0-0499-4d96-96a4-5b8d7b410cbc None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.084996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6dfa106a-c26a-4ec7-baef-29650ff4212a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:15.088590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae117-0f19-4496-9883-85ac65b85123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.090272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae117-0f19-4496-9883-85ac65b85123 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.090272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae117-0f19-4496-9883-85ac65b85123 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.091222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae117-0f19-4496-9883-85ac65b85123 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.092075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ae117-0f19-4496-9883-85ac65b85123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.094225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ae117-0f19-4496-9883-85ac65b85123 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.127232 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 938/1855] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:15 2022] POST /identity/v3/users => generated 285 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:15.127232 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae117-0f19-4496-9883-85ac65b85123 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.146778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae117-0f19-4496-9883-85ac65b85123 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.154197 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478e3a-0378-4912-a9cb-5ee903a34f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.155046 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478e3a-0378-4912-a9cb-5ee903a34f7e admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.155431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478e3a-0378-4912-a9cb-5ee903a34f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.155604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa106a-c26a-4ec7-baef-29650ff4212a admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.156069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478e3a-0378-4912-a9cb-5ee903a34f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.157061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09478e3a-0378-4912-a9cb-5ee903a34f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:15.157441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09478e3a-0378-4912-a9cb-5ee903a34f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.159337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09478e3a-0378-4912-a9cb-5ee903a34f7e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.160336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a4b1-ce08-4072-9292-15487607328c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.161128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a4b1-ce08-4072-9292-15487607328c service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.161563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a4b1-ce08-4072-9292-15487607328c service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.162018 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a4b1-ce08-4072-9292-15487607328c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.164424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2bf5a4b1-ce08-4072-9292-15487607328c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:15.180548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 939/1856] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:54:15.182248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478e3a-0378-4912-a9cb-5ee903a34f7e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.195337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478e3a-0378-4912-a9cb-5ee903a34f7e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.201350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87012253-0084-43c7-abc4-b8f643a4a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.202133 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87012253-0084-43c7-abc4-b8f643a4a3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.202976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87012253-0084-43c7-abc4-b8f643a4a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.203390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87012253-0084-43c7-abc4-b8f643a4a3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.205308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87012253-0084-43c7-abc4-b8f643a4a3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.207358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87012253-0084-43c7-abc4-b8f643a4a3b7 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.210466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:15.244659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5a4b1-ce08-4072-9292-15487607328c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.246627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5a4b1-ce08-4072-9292-15487607328c service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.247486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 940/1857] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:15 2022] POST /identity/v3/projects => generated 378 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:15.248279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87012253-0084-43c7-abc4-b8f643a4a3b7 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.259374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 918/1858] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:15.260269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a4b1-ce08-4072-9292-15487607328c service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.271948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a4b1-ce08-4072-9292-15487607328c service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.393232 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d435583-1dee-4b02-b9b3-deed9994dbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.393891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d435583-1dee-4b02-b9b3-deed9994dbbe admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.394176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d435583-1dee-4b02-b9b3-deed9994dbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.394452 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d435583-1dee-4b02-b9b3-deed9994dbbe admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.395182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d435583-1dee-4b02-b9b3-deed9994dbbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.397122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d435583-1dee-4b02-b9b3-deed9994dbbe admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.410239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87012253-0084-43c7-abc4-b8f643a4a3b7 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.437767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 919/1859] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:15 2022] POST /identity/v3/projects => generated 376 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:15.438647 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d435583-1dee-4b02-b9b3-deed9994dbbe admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.441183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f042a59-3bf7-43cc-a696-6687f61e73ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.442075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042a59-3bf7-43cc-a696-6687f61e73ac admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.442310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042a59-3bf7-43cc-a696-6687f61e73ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.442633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042a59-3bf7-43cc-a696-6687f61e73ac admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.444165 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f042a59-3bf7-43cc-a696-6687f61e73ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.446556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f042a59-3bf7-43cc-a696-6687f61e73ac admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.466940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 941/1860] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:15 2022] GET /identity/v3/roles => generated 1427 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:15.467969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f042a59-3bf7-43cc-a696-6687f61e73ac admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.487256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f042a59-3bf7-43cc-a696-6687f61e73ac admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.527866 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d435583-1dee-4b02-b9b3-deed9994dbbe admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.542803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b6026-7ddb-4731-8405-598c02332b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.546341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6026-7ddb-4731-8405-598c02332b93 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.546341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6026-7ddb-4731-8405-598c02332b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.546341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6026-7ddb-4731-8405-598c02332b93 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.546341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6026-7ddb-4731-8405-598c02332b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.547182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6026-7ddb-4731-8405-598c02332b93 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.597777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcf98-8fcc-442e-9b7a-25acce7015a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.598771 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcf98-8fcc-442e-9b7a-25acce7015a7 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.599715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcf98-8fcc-442e-9b7a-25acce7015a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.599715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcf98-8fcc-442e-9b7a-25acce7015a7 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.600349 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfcf98-8fcc-442e-9b7a-25acce7015a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.602984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfcf98-8fcc-442e-9b7a-25acce7015a7 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.605450 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 920/1861] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:15 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:15.606638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b6026-7ddb-4731-8405-598c02332b93 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.626675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b6026-7ddb-4731-8405-598c02332b93 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.654314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 942/1862] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:15 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:15.654314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcf98-8fcc-442e-9b7a-25acce7015a7 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.655725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a44709-8c55-4047-99a4-46659a538f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.656737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a44709-8c55-4047-99a4-46659a538f68 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.657021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a44709-8c55-4047-99a4-46659a538f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.657294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a44709-8c55-4047-99a4-46659a538f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.658015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a44709-8c55-4047-99a4-46659a538f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.660145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a44709-8c55-4047-99a4-46659a538f68 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.672157 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcf98-8fcc-442e-9b7a-25acce7015a7 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.673787 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 921/1863] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:15 2022] GET /identity/v3/roles => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:15.677268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a44709-8c55-4047-99a4-46659a538f68 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.683753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce1094-6a21-433b-9547-286c689a85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.684855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce1094-6a21-433b-9547-286c689a85b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.685369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce1094-6a21-433b-9547-286c689a85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.685651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce1094-6a21-433b-9547-286c689a85b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.686371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce1094-6a21-433b-9547-286c689a85b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.688427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce1094-6a21-433b-9547-286c689a85b8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.691235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:15.693103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a44709-8c55-4047-99a4-46659a538f68 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.699288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b2d78-c52d-4390-a0d1-6cdbb30da28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.699924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b2d78-c52d-4390-a0d1-6cdbb30da28a admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.700265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b2d78-c52d-4390-a0d1-6cdbb30da28a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.700542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b2d78-c52d-4390-a0d1-6cdbb30da28a admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.701307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b2d78-c52d-4390-a0d1-6cdbb30da28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.703023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b2d78-c52d-4390-a0d1-6cdbb30da28a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.703424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 943/1864] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:15 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:15.704644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce1094-6a21-433b-9547-286c689a85b8 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.714712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 922/1865] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:15 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:15.715862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b2d78-c52d-4390-a0d1-6cdbb30da28a admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.716149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce1094-6a21-433b-9547-286c689a85b8 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.719195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-710b2d78-c52d-4390-a0d1-6cdbb30da28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:15.722048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8060b-5660-4d86-b91d-ef216cd57756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.724081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8060b-5660-4d86-b91d-ef216cd57756 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.724081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8060b-5660-4d86-b91d-ef216cd57756 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.724081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8060b-5660-4d86-b91d-ef216cd57756 admin admin] PATH_INFO: `/v3/projects/a8807d611d8d48fa96ff993d53cd1a12/users/6ccb8a78b1cf49c0bcc06106ddb72153/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.733289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b2d78-c52d-4390-a0d1-6cdbb30da28a admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.738607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.739522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.739901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.740268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] PATH_INFO: `/v3/users/3317485484c64efea26cb53092e88616` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.741620 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3317485484c64efea26cb53092e88616)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.744037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.752234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8060b-5660-4d86-b91d-ef216cd57756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8807d611d8d48fa96ff993d53cd1a12, user_id=6ccb8a78b1cf49c0bcc06106ddb72153, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.755955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8060b-5660-4d86-b91d-ef216cd57756 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.773762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:15.779336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 944/1866] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:15 2022] PUT /identity/v3/projects/a8807d611d8d48fa96ff993d53cd1a12/users/6ccb8a78b1cf49c0bcc06106ddb72153/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:15.780551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8060b-5660-4d86-b91d-ef216cd57756 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.819458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3317485484c64efea26cb53092e88616'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:15.820199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3317485484c64efea26cb53092e88616'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:15.837504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3317485484c64efea26cb53092e88616'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:15.838244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3317485484c64efea26cb53092e88616'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:15.847773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3317485484c64efea26cb53092e88616'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:15.857705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8060b-5660-4d86-b91d-ef216cd57756 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.862979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37f315-b8c6-4e69-8565-15bab3c328d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.863687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37f315-b8c6-4e69-8565-15bab3c328d2 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.864262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 923/1867] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:15 2022] DELETE /identity/v3/users/3317485484c64efea26cb53092e88616 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:15.864372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37f315-b8c6-4e69-8565-15bab3c328d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.864372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37f315-b8c6-4e69-8565-15bab3c328d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.865303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37f315-b8c6-4e69-8565-15bab3c328d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.866856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37f315-b8c6-4e69-8565-15bab3c328d2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.868661 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.870047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:15.879359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 945/1868] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:15 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:15.880782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703fb75-dce5-4890-b951-56a3ed475c4b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.881164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703fb75-dce5-4890-b951-56a3ed475c4b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.881645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703fb75-dce5-4890-b951-56a3ed475c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.911748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-3703fb75-dce5-4890-b951-56a3ed475c4b None None] MFA Rules not processed for user `6ccb8a78b1cf49c0bcc06106ddb72153`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:15.913129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3703fb75-dce5-4890-b951-56a3ed475c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:15.952540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61936231-f29d-403c-9a5a-28e7f5ed8067 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:15.958010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf38304-81e7-4911-9c0b-305933c4c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:15.958639 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf38304-81e7-4911-9c0b-305933c4c4ed admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.958916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf38304-81e7-4911-9c0b-305933c4c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.959214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf38304-81e7-4911-9c0b-305933c4c4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.959921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf38304-81e7-4911-9c0b-305933c4c4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:15.962112 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf38304-81e7-4911-9c0b-305933c4c4ed admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:15.972814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 924/1869] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:15 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:15.974074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c64080-653a-4e98-8ab0-777430fcfccd None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:15.974360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c64080-653a-4e98-8ab0-777430fcfccd None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:15.974711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c64080-653a-4e98-8ab0-777430fcfccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:15.984658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 946/1870] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:15.985487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703fb75-dce5-4890-b951-56a3ed475c4b None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:15.986767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3703fb75-dce5-4890-b951-56a3ed475c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:15.994577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-29c64080-653a-4e98-8ab0-777430fcfccd None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:15.995818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-29c64080-653a-4e98-8ab0-777430fcfccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:16.000679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703fb75-dce5-4890-b951-56a3ed475c4b None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.003483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 925/1871] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:16.006111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d8834-88d3-4938-ae84-7939491d8fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.006901 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8834-88d3-4938-ae84-7939491d8fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.007257 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8834-88d3-4938-ae84-7939491d8fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.007364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c64080-653a-4e98-8ab0-777430fcfccd None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.007522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8834-88d3-4938-ae84-7939491d8fd8 admin admin] PATH_INFO: `/v3/projects/be2f75591d584ff5983385e0d33821fe/users/2d23e2b0161d49d5b23e06cd63acbc3a/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.018054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c64080-653a-4e98-8ab0-777430fcfccd None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.023513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa52b36-3bb5-4b0d-9ff7-787c7cefaf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.024263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52b36-3bb5-4b0d-9ff7-787c7cefaf4c admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.024683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52b36-3bb5-4b0d-9ff7-787c7cefaf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.025171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52b36-3bb5-4b0d-9ff7-787c7cefaf4c admin admin] PATH_INFO: `/v3/projects/50b5a5819e254d429d43786bb20fd904/users/60b9b092d4b94440951e09c3bfef180b/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.025963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d8834-88d3-4938-ae84-7939491d8fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2f75591d584ff5983385e0d33821fe, user_id=2d23e2b0161d49d5b23e06cd63acbc3a, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.029265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d8834-88d3-4938-ae84-7939491d8fd8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.041782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa52b36-3bb5-4b0d-9ff7-787c7cefaf4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b5a5819e254d429d43786bb20fd904, user_id=60b9b092d4b94440951e09c3bfef180b, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.044513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa52b36-3bb5-4b0d-9ff7-787c7cefaf4c admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.046252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 947/1872] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:15 2022] PUT /identity/v3/projects/be2f75591d584ff5983385e0d33821fe/users/2d23e2b0161d49d5b23e06cd63acbc3a/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:16.047313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d8834-88d3-4938-ae84-7939491d8fd8 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.049371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3c3d8834-88d3-4938-ae84-7939491d8fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:16.067211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 926/1873] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:16 2022] PUT /identity/v3/projects/50b5a5819e254d429d43786bb20fd904/users/60b9b092d4b94440951e09c3bfef180b/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:16.068148 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa52b36-3bb5-4b0d-9ff7-787c7cefaf4c admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.070036 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-afa52b36-3bb5-4b0d-9ff7-787c7cefaf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:16.095447 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:16.124217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d8834-88d3-4938-ae84-7939491d8fd8 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.132601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa52b36-3bb5-4b0d-9ff7-787c7cefaf4c admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.136468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa7c8e-b7e0-4217-b010-f232c90404c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.137092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa7c8e-b7e0-4217-b010-f232c90404c0 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.137385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa7c8e-b7e0-4217-b010-f232c90404c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.137646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa7c8e-b7e0-4217-b010-f232c90404c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.151644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:16.182882 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d10fd-7e16-4460-8033-dacf75821027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.183538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d10fd-7e16-4460-8033-dacf75821027 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.183820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d10fd-7e16-4460-8033-dacf75821027 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.184064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d10fd-7e16-4460-8033-dacf75821027 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.184778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d10fd-7e16-4460-8033-dacf75821027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.186691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d10fd-7e16-4460-8033-dacf75821027 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.203373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa7c8e-b7e0-4217-b010-f232c90404c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.204837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa7c8e-b7e0-4217-b010-f232c90404c0 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.215890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 927/1874] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:16.216539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 948/1875] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:16 2022] POST /identity/v3/projects => generated 368 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:16.217151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39383c7-7455-4412-b3d2-7d2163b96447 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.217439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39383c7-7455-4412-b3d2-7d2163b96447 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.217716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39383c7-7455-4412-b3d2-7d2163b96447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.217853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627a67a-a02c-4a71-86c6-6886fca1098a None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.218147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627a67a-a02c-4a71-86c6-6886fca1098a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.218431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627a67a-a02c-4a71-86c6-6886fca1098a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.250052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b39383c7-7455-4412-b3d2-7d2163b96447 None None] MFA Rules not processed for user `2d23e2b0161d49d5b23e06cd63acbc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:16.250450 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-f627a67a-a02c-4a71-86c6-6886fca1098a None None] MFA Rules not processed for user `60b9b092d4b94440951e09c3bfef180b`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:16.251431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b39383c7-7455-4412-b3d2-7d2163b96447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:16.251748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f627a67a-a02c-4a71-86c6-6886fca1098a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:16.338302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 949/1876] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:16.338302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627a67a-a02c-4a71-86c6-6886fca1098a None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.346332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 928/1877] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:16.347627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39383c7-7455-4412-b3d2-7d2163b96447 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.421004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:16.425791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627a67a-a02c-4a71-86c6-6886fca1098a None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.432973 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6a1a2-7cda-411e-b6aa-d073a9b60ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.433766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6a1a2-7cda-411e-b6aa-d073a9b60ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.434053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6a1a2-7cda-411e-b6aa-d073a9b60ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.434322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6a1a2-7cda-411e-b6aa-d073a9b60ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.435032 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6a1a2-7cda-411e-b6aa-d073a9b60ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.436986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6a1a2-7cda-411e-b6aa-d073a9b60ac5 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.454824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39383c7-7455-4412-b3d2-7d2163b96447 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.461555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7994c4-4a8b-4717-a4d8-53600dbd5efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.462938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7994c4-4a8b-4717-a4d8-53600dbd5efe admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.462938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7994c4-4a8b-4717-a4d8-53600dbd5efe admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.463173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7994c4-4a8b-4717-a4d8-53600dbd5efe admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.463882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7994c4-4a8b-4717-a4d8-53600dbd5efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.464490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 950/1878] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:16 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:16.465474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6a1a2-7cda-411e-b6aa-d073a9b60ac5 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.466072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7994c4-4a8b-4717-a4d8-53600dbd5efe admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.467360 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6eb6a1a2-7cda-411e-b6aa-d073a9b60ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:16.508254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 929/1879] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:16 2022] POST /identity/v3/projects => generated 378 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:16.509647 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7994c4-4a8b-4717-a4d8-53600dbd5efe admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.558153 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:16.584951 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6a1a2-7cda-411e-b6aa-d073a9b60ac5 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.620203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7994c4-4a8b-4717-a4d8-53600dbd5efe admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.625073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514d34-dded-47a8-862a-a15b892879bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.625723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514d34-dded-47a8-862a-a15b892879bc admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.626007 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514d34-dded-47a8-862a-a15b892879bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.626281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514d34-dded-47a8-862a-a15b892879bc admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.627037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35514d34-dded-47a8-862a-a15b892879bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.628672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35514d34-dded-47a8-862a-a15b892879bc admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.646577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 930/1880] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:16 2022] GET /identity/v3/roles => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:16.652997 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514d34-dded-47a8-862a-a15b892879bc admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.655772 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577ad0a-8f1f-4a6e-a9b6-baa14578d679 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1cabb41d38a40acb7d41c169cc90cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.656494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577ad0a-8f1f-4a6e-a9b6-baa14578d679 service glance] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.656780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577ad0a-8f1f-4a6e-a9b6-baa14578d679 service glance] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.657055 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577ad0a-8f1f-4a6e-a9b6-baa14578d679 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.664845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514d34-dded-47a8-862a-a15b892879bc admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.669921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae98194-b59c-4ab9-8ccd-2626448c8d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.670569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae98194-b59c-4ab9-8ccd-2626448c8d55 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.670852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae98194-b59c-4ab9-8ccd-2626448c8d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.671157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae98194-b59c-4ab9-8ccd-2626448c8d55 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.671833 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae98194-b59c-4ab9-8ccd-2626448c8d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.673779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae98194-b59c-4ab9-8ccd-2626448c8d55 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.711988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 931/1881] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:16 2022] POST /identity/v3/users => generated 290 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:16.716938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae98194-b59c-4ab9-8ccd-2626448c8d55 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.719497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1ae98194-b59c-4ab9-8ccd-2626448c8d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:16.736355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577ad0a-8f1f-4a6e-a9b6-baa14578d679 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.737849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577ad0a-8f1f-4a6e-a9b6-baa14578d679 service glance] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.737962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae98194-b59c-4ab9-8ccd-2626448c8d55 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.744232 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.745147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.745543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.746019 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] PATH_INFO: `/v3/projects/a74a26e1099945358f027ed76295f626` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.748220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74a26e1099945358f027ed76295f626)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.750903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.753141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 951/1882] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:16.754007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577ad0a-8f1f-4a6e-a9b6-baa14578d679 service glance] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.767189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577ad0a-8f1f-4a6e-a9b6-baa14578d679 service glance] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.773390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dbae8-f2f6-4f0b-9226-c800f28afb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.773777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dbae8-f2f6-4f0b-9226-c800f28afb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.774161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dbae8-f2f6-4f0b-9226-c800f28afb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.774382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dbae8-f2f6-4f0b-9226-c800f28afb7a admin admin] PATH_INFO: `/v3/projects/4bd1e4ef3e7a435e9ac0ada450de6555/users/024e7d5c2e344490b4825114551f428a/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.827908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dbae8-f2f6-4f0b-9226-c800f28afb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd1e4ef3e7a435e9ac0ada450de6555, user_id=024e7d5c2e344490b4825114551f428a, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.830884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dbae8-f2f6-4f0b-9226-c800f28afb7a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.858634 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74a26e1099945358f027ed76295f626', 'request_id': 'req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:16.860240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 952/1883] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:16 2022] PUT /identity/v3/projects/4bd1e4ef3e7a435e9ac0ada450de6555/users/024e7d5c2e344490b4825114551f428a/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:16.861173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dbae8-f2f6-4f0b-9226-c800f28afb7a admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.871556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74a26e1099945358f027ed76295f626', 'request_id': 'req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:16.879243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74a26e1099945358f027ed76295f626', 'request_id': 'req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:16.894409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:16.897595 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] The token cache is being invalidate because project a74a26e1099945358f027ed76295f626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:16.898087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:16.898774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:16.900700 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 932/1884] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:16 2022] DELETE /identity/v3/projects/a74a26e1099945358f027ed76295f626 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:16.904797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.906979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:16.954860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dbae8-f2f6-4f0b-9226-c800f28afb7a admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.960098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3090da5-9e95-4851-8fa8-6169da2dfeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:16.961173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3090da5-9e95-4851-8fa8-6169da2dfeba admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:16.961453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3090da5-9e95-4851-8fa8-6169da2dfeba admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:16.961817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3090da5-9e95-4851-8fa8-6169da2dfeba admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:16.962537 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3090da5-9e95-4851-8fa8-6169da2dfeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:16.964443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3090da5-9e95-4851-8fa8-6169da2dfeba admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:16.978371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 953/1885] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:16 2022] GET /identity/v3/roles => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:16.979085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3090da5-9e95-4851-8fa8-6169da2dfeba admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:16.980881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f3090da5-9e95-4851-8fa8-6169da2dfeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:16.993536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9041-f2bd-4a98-b8c1-cdef857df6b2 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.995398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3090da5-9e95-4851-8fa8-6169da2dfeba admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:16.999103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7b499-93e6-4c8e-850c-d0a6f0cda8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:17.000591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b499-93e6-4c8e-850c-d0a6f0cda8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:17.000793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b499-93e6-4c8e-850c-d0a6f0cda8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:17.001051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b499-93e6-4c8e-850c-d0a6f0cda8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:17.001511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f796e-c466-4e05-afd3-2b6f374bd4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:17.002174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f796e-c466-4e05-afd3-2b6f374bd4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:17.002465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f796e-c466-4e05-afd3-2b6f374bd4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:17.002734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f796e-c466-4e05-afd3-2b6f374bd4f7 admin admin] PATH_INFO: `/v3/users/808d719653404003bd0d22bb2c14dee7` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:17.003965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f796e-c466-4e05-afd3-2b6f374bd4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=808d719653404003bd0d22bb2c14dee7)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:17.004726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7b499-93e6-4c8e-850c-d0a6f0cda8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:17.006424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7b499-93e6-4c8e-850c-d0a6f0cda8f7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:17.006555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f796e-c466-4e05-afd3-2b6f374bd4f7 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:17.035128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 933/1886] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:16 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:17.035128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7b499-93e6-4c8e-850c-d0a6f0cda8f7 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:17.037319 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-10c7b499-93e6-4c8e-850c-d0a6f0cda8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:17.058191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7b499-93e6-4c8e-850c-d0a6f0cda8f7 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:17.063129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad100-cc56-4d58-95f1-5a890fcbceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:17.063772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad100-cc56-4d58-95f1-5a890fcbceb5 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:17.064125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad100-cc56-4d58-95f1-5a890fcbceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:17.064570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ad100-cc56-4d58-95f1-5a890fcbceb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:17.065290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ad100-cc56-4d58-95f1-5a890fcbceb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:17.067246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ad100-cc56-4d58-95f1-5a890fcbceb5 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:17.069093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a98f796e-c466-4e05-afd3-2b6f374bd4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808d719653404003bd0d22bb2c14dee7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:17.081818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 934/1887] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:17 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:17.081818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad100-cc56-4d58-95f1-5a890fcbceb5 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:17.090520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a98f796e-c466-4e05-afd3-2b6f374bd4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808d719653404003bd0d22bb2c14dee7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:17.091614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ad100-cc56-4d58-95f1-5a890fcbceb5 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:17.097164 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74280888-a667-49e8-9f2b-b5456cb81f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:17.098009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74280888-a667-49e8-9f2b-b5456cb81f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:17.098245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74280888-a667-49e8-9f2b-b5456cb81f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:17.098520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74280888-a667-49e8-9f2b-b5456cb81f9e admin admin] PATH_INFO: `/v3/projects/4bd1e4ef3e7a435e9ac0ada450de6555/users/024e7d5c2e344490b4825114551f428a/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:17.099649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a98f796e-c466-4e05-afd3-2b6f374bd4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808d719653404003bd0d22bb2c14dee7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:17.100359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a98f796e-c466-4e05-afd3-2b6f374bd4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808d719653404003bd0d22bb2c14dee7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:17.100990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74280888-a667-49e8-9f2b-b5456cb81f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd1e4ef3e7a435e9ac0ada450de6555, user_id=024e7d5c2e344490b4825114551f428a, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:17.101686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a98f796e-c466-4e05-afd3-2b6f374bd4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808d719653404003bd0d22bb2c14dee7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:17.104429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74280888-a667-49e8-9f2b-b5456cb81f9e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:17.112497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:17.131643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 935/1888] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:17 2022] PUT /identity/v3/projects/4bd1e4ef3e7a435e9ac0ada450de6555/users/024e7d5c2e344490b4825114551f428a/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:17.135804 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 954/1889] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:16 2022] DELETE /identity/v3/users/808d719653404003bd0d22bb2c14dee7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:17.136062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74280888-a667-49e8-9f2b-b5456cb81f9e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:17.136161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf71701-ca6a-4fed-9417-fb7baae491dc None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:17.136161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf71701-ca6a-4fed-9417-fb7baae491dc None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:17.136161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf71701-ca6a-4fed-9417-fb7baae491dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:17.147281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-74280888-a667-49e8-9f2b-b5456cb81f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:17.179879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-daf71701-ca6a-4fed-9417-fb7baae491dc None None] MFA Rules not processed for user `024e7d5c2e344490b4825114551f428a`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:17.181308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-daf71701-ca6a-4fed-9417-fb7baae491dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:17.244634 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74280888-a667-49e8-9f2b-b5456cb81f9e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:17.294086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 955/1890] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:17.307144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf71701-ca6a-4fed-9417-fb7baae491dc None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:17.309929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-daf71701-ca6a-4fed-9417-fb7baae491dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:17.321458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:17.340301 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d95c0-8861-45d4-b23d-6f6124fffe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:17.341447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d95c0-8861-45d4-b23d-6f6124fffe61 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:17.341803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d95c0-8861-45d4-b23d-6f6124fffe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:17.342845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d95c0-8861-45d4-b23d-6f6124fffe61 admin admin] PATH_INFO: `/v3/projects/ebb6c2c4e9004ad096d3380467041176/users/49b354d05ce442a5b7ceddc3ac410d91/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:17.373459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d95c0-8861-45d4-b23d-6f6124fffe61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb6c2c4e9004ad096d3380467041176, user_id=49b354d05ce442a5b7ceddc3ac410d91, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:17.376338 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d95c0-8861-45d4-b23d-6f6124fffe61 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:17.401914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf71701-ca6a-4fed-9417-fb7baae491dc None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:17.402807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 936/1891] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:17 2022] PUT /identity/v3/projects/ebb6c2c4e9004ad096d3380467041176/users/49b354d05ce442a5b7ceddc3ac410d91/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:17.414055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba634b-d7de-45bd-ac22-bd3a00c70bbc None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:17.414385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba634b-d7de-45bd-ac22-bd3a00c70bbc None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:17.414896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba634b-d7de-45bd-ac22-bd3a00c70bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:17.478268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-39ba634b-d7de-45bd-ac22-bd3a00c70bbc None None] MFA Rules not processed for user `49b354d05ce442a5b7ceddc3ac410d91`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:17.480127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-39ba634b-d7de-45bd-ac22-bd3a00c70bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:17.507164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49822d34-6a7e-4438-b51a-3899ba459604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:17.508025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49822d34-6a7e-4438-b51a-3899ba459604 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:17.508311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49822d34-6a7e-4438-b51a-3899ba459604 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:17.509214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49822d34-6a7e-4438-b51a-3899ba459604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:17.597141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49822d34-6a7e-4438-b51a-3899ba459604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:17.598494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49822d34-6a7e-4438-b51a-3899ba459604 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:17.600903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 937/1892] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:17.601749 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba634b-d7de-45bd-ac22-bd3a00c70bbc None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:17.603146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-39ba634b-d7de-45bd-ac22-bd3a00c70bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:17.609569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 956/1893] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:54:17.610735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49822d34-6a7e-4438-b51a-3899ba459604 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:17.630317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:17.689459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba634b-d7de-45bd-ac22-bd3a00c70bbc None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:17.694539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:17.695084 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:17.695496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:17.695779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] PATH_INFO: `/v3/projects/e6e207f0c8634a6f8a77d58fd80e35e8` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:17.697061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e207f0c8634a6f8a77d58fd80e35e8)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:17.699149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:17.704511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49822d34-6a7e-4438-b51a-3899ba459604 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:17.709428 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320627c-6429-4ae6-926b-51862fca865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:17.710721 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320627c-6429-4ae6-926b-51862fca865f admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:17.711231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320627c-6429-4ae6-926b-51862fca865f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:17.711509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320627c-6429-4ae6-926b-51862fca865f admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:17.712364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320627c-6429-4ae6-926b-51862fca865f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:17.714346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320627c-6429-4ae6-926b-51862fca865f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:17.741601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:17.755419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 957/1894] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:17 2022] POST /identity/v3/projects => generated 380 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:17.756518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320627c-6429-4ae6-926b-51862fca865f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:17.759627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8320627c-6429-4ae6-926b-51862fca865f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:17.779484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e207f0c8634a6f8a77d58fd80e35e8', 'request_id': 'req-7d951e5f-dbee-4742-b9da-8e898a87f938'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:17.788284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e207f0c8634a6f8a77d58fd80e35e8', 'request_id': 'req-7d951e5f-dbee-4742-b9da-8e898a87f938'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:17.796415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e207f0c8634a6f8a77d58fd80e35e8', 'request_id': 'req-7d951e5f-dbee-4742-b9da-8e898a87f938'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:17.897123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] The token cache is being invalidate because project e6e207f0c8634a6f8a77d58fd80e35e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:17.897446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:17.908135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:17.924574 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 938/1895] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:17 2022] DELETE /identity/v3/projects/e6e207f0c8634a6f8a77d58fd80e35e8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:17.924574 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:17.925338 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:17.937363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320627c-6429-4ae6-926b-51862fca865f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.006600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934c628-76ae-4739-a2ec-5f058c7dbbd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.007274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934c628-76ae-4739-a2ec-5f058c7dbbd2 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.007479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934c628-76ae-4739-a2ec-5f058c7dbbd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.007718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934c628-76ae-4739-a2ec-5f058c7dbbd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.009666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b934c628-76ae-4739-a2ec-5f058c7dbbd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:18.020748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d951e5f-dbee-4742-b9da-8e898a87f938 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.027982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33713314-679a-4644-9ec9-0e6d25a3e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.028814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33713314-679a-4644-9ec9-0e6d25a3e307 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.029097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33713314-679a-4644-9ec9-0e6d25a3e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.029439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33713314-679a-4644-9ec9-0e6d25a3e307 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.030288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33713314-679a-4644-9ec9-0e6d25a3e307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.032936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33713314-679a-4644-9ec9-0e6d25a3e307 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.067464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 939/1896] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:17 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:18.068858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2694bf-39ea-4582-883a-374b3c8ef672 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.069082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2694bf-39ea-4582-883a-374b3c8ef672 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.069332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2694bf-39ea-4582-883a-374b3c8ef672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.120158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-db2694bf-39ea-4582-883a-374b3c8ef672 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:18.121500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-db2694bf-39ea-4582-883a-374b3c8ef672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:18.125819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934c628-76ae-4739-a2ec-5f058c7dbbd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.127621 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934c628-76ae-4739-a2ec-5f058c7dbbd2 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.140312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 958/1897] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:18.151657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 940/1898] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:18.151743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934c628-76ae-4739-a2ec-5f058c7dbbd2 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:18.156286 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63cd3-1a76-4212-9cac-5557d9582957 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.156578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63cd3-1a76-4212-9cac-5557d9582957 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.156854 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63cd3-1a76-4212-9cac-5557d9582957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.187201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-4ef63cd3-1a76-4212-9cac-5557d9582957 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:18.188618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4ef63cd3-1a76-4212-9cac-5557d9582957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:18.191034 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934c628-76ae-4739-a2ec-5f058c7dbbd2 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.201098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8475e98-bc80-43fc-b9f4-287dd3c3cd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.201780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8475e98-bc80-43fc-b9f4-287dd3c3cd80 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.202102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8475e98-bc80-43fc-b9f4-287dd3c3cd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.202412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8475e98-bc80-43fc-b9f4-287dd3c3cd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.203310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8475e98-bc80-43fc-b9f4-287dd3c3cd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.204970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8475e98-bc80-43fc-b9f4-287dd3c3cd80 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.215182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 941/1899] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:18.219278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63cd3-1a76-4212-9cac-5557d9582957 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:18.234364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 959/1900] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:18 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:18.234605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63cd3-1a76-4212-9cac-5557d9582957 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.236581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8475e98-bc80-43fc-b9f4-287dd3c3cd80 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:18.249456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929e0c4-5b16-47d3-abce-0c0b0c1d9982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.250098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929e0c4-5b16-47d3-abce-0c0b0c1d9982 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.250364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929e0c4-5b16-47d3-abce-0c0b0c1d9982 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.250697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929e0c4-5b16-47d3-abce-0c0b0c1d9982 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.251512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929e0c4-5b16-47d3-abce-0c0b0c1d9982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:18.252202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929e0c4-5b16-47d3-abce-0c0b0c1d9982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.261852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8475e98-bc80-43fc-b9f4-287dd3c3cd80 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.261961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929e0c4-5b16-47d3-abce-0c0b0c1d9982 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.275397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208626e-d8f6-42d5-b543-bac06df16bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.276778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208626e-d8f6-42d5-b543-bac06df16bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.276778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208626e-d8f6-42d5-b543-bac06df16bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.277166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208626e-d8f6-42d5-b543-bac06df16bb9 admin admin] PATH_INFO: `/v3/projects/a22fd4ebf36045b2b18189f4fa410c32/users/7ab8ac0c07a24bbcb7399cb7fc6b21a1/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.287699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 942/1901] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:54:18.293658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929e0c4-5b16-47d3-abce-0c0b0c1d9982 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:18.316373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208626e-d8f6-42d5-b543-bac06df16bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22fd4ebf36045b2b18189f4fa410c32, user_id=7ab8ac0c07a24bbcb7399cb7fc6b21a1, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.317173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929e0c4-5b16-47d3-abce-0c0b0c1d9982 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.321063 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208626e-d8f6-42d5-b543-bac06df16bb9 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.328630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c134f-2a55-4467-bb3e-c85df32e6d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.329509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c134f-2a55-4467-bb3e-c85df32e6d22 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.329858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c134f-2a55-4467-bb3e-c85df32e6d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.330142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c134f-2a55-4467-bb3e-c85df32e6d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.331064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c134f-2a55-4467-bb3e-c85df32e6d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.343017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c134f-2a55-4467-bb3e-c85df32e6d22 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.350307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 960/1902] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:18 2022] PUT /identity/v3/projects/a22fd4ebf36045b2b18189f4fa410c32/users/7ab8ac0c07a24bbcb7399cb7fc6b21a1/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:18.355475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208626e-d8f6-42d5-b543-bac06df16bb9 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:18.379483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:18.419289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 943/1903] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:18 2022] POST /identity/v3/projects => generated 386 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:18.420293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c134f-2a55-4467-bb3e-c85df32e6d22 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:18.435449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:18.539389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208626e-d8f6-42d5-b543-bac06df16bb9 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.567269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c134f-2a55-4467-bb3e-c85df32e6d22 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.584763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ea78e-0665-4e00-ae40-b6058edb6704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.584763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ea78e-0665-4e00-ae40-b6058edb6704 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.584763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ea78e-0665-4e00-ae40-b6058edb6704 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.585509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ea78e-0665-4e00-ae40-b6058edb6704 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.585902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ea78e-0665-4e00-ae40-b6058edb6704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.587931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ea78e-0665-4e00-ae40-b6058edb6704 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.634901 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854953fb-c02c-4c51-b809-15decf2a5ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.636234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854953fb-c02c-4c51-b809-15decf2a5ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.636647 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854953fb-c02c-4c51-b809-15decf2a5ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.636838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854953fb-c02c-4c51-b809-15decf2a5ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.637531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854953fb-c02c-4c51-b809-15decf2a5ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.639204 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854953fb-c02c-4c51-b809-15decf2a5ed9 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.644463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 944/1904] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:18 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:18.651759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ea78e-0665-4e00-ae40-b6058edb6704 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:18.661311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 961/1905] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:18 2022] GET /identity/v3/roles => generated 1427 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:18.665364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854953fb-c02c-4c51-b809-15decf2a5ed9 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:18.692674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ea78e-0665-4e00-ae40-b6058edb6704 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.709237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54a689-de5e-4616-9af0-86c2a747fa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.711253 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54a689-de5e-4616-9af0-86c2a747fa5e admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.716554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54a689-de5e-4616-9af0-86c2a747fa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.717328 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54a689-de5e-4616-9af0-86c2a747fa5e admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.717502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854953fb-c02c-4c51-b809-15decf2a5ed9 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.727977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54a689-de5e-4616-9af0-86c2a747fa5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.730121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54a689-de5e-4616-9af0-86c2a747fa5e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.744024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd5aec-614c-4ccc-aee3-a50cb0f97ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.744731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5aec-614c-4ccc-aee3-a50cb0f97ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.745014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5aec-614c-4ccc-aee3-a50cb0f97ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.745292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5aec-614c-4ccc-aee3-a50cb0f97ed3 admin admin] PATH_INFO: `/v3/projects/a22fd4ebf36045b2b18189f4fa410c32/users/7ab8ac0c07a24bbcb7399cb7fc6b21a1/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.747796 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd5aec-614c-4ccc-aee3-a50cb0f97ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22fd4ebf36045b2b18189f4fa410c32, user_id=7ab8ac0c07a24bbcb7399cb7fc6b21a1, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.751351 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd5aec-614c-4ccc-aee3-a50cb0f97ed3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.753565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 945/1906] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:18 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:18.755679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54a689-de5e-4616-9af0-86c2a747fa5e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:18.775173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54a689-de5e-4616-9af0-86c2a747fa5e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.779833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 962/1907] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:18 2022] PUT /identity/v3/projects/a22fd4ebf36045b2b18189f4fa410c32/users/7ab8ac0c07a24bbcb7399cb7fc6b21a1/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:18.782734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a2af7-38b6-4218-99d8-b00622538fa7 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.783197 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a2af7-38b6-4218-99d8-b00622538fa7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.783571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a2af7-38b6-4218-99d8-b00622538fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.826149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-2f0a2af7-38b6-4218-99d8-b00622538fa7 None None] MFA Rules not processed for user `7ab8ac0c07a24bbcb7399cb7fc6b21a1`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:18.827712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2f0a2af7-38b6-4218-99d8-b00622538fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:18.878035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c6503-2854-4ec6-b68d-f48d99b0a90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.878732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6503-2854-4ec6-b68d-f48d99b0a90e admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.879057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6503-2854-4ec6-b68d-f48d99b0a90e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.879339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6503-2854-4ec6-b68d-f48d99b0a90e admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.880405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c6503-2854-4ec6-b68d-f48d99b0a90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.882129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c6503-2854-4ec6-b68d-f48d99b0a90e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.903284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 946/1908] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:18 2022] GET /identity/v3/roles => generated 1427 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:18.904551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c6503-2854-4ec6-b68d-f48d99b0a90e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:18.919415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c6503-2854-4ec6-b68d-f48d99b0a90e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:18.929060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb445ef-c8b4-4782-867e-3e96c453c618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:18.930057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb445ef-c8b4-4782-867e-3e96c453c618 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.930477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb445ef-c8b4-4782-867e-3e96c453c618 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:18.930775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb445ef-c8b4-4782-867e-3e96c453c618 admin admin] PATH_INFO: `/v3/projects/9930456f049f4b4f848b5ddcd76677d4/users/fa4898a76b41449ead2b00c398d08b47/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:18.948022 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 963/1909] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:18.953832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb445ef-c8b4-4782-867e-3e96c453c618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9930456f049f4b4f848b5ddcd76677d4, user_id=fa4898a76b41449ead2b00c398d08b47, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:18.957117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb445ef-c8b4-4782-867e-3e96c453c618 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:18.962059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a2af7-38b6-4218-99d8-b00622538fa7 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:18.971577 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2f0a2af7-38b6-4218-99d8-b00622538fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:18.996690 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 947/1910] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:18 2022] PUT /identity/v3/projects/9930456f049f4b4f848b5ddcd76677d4/users/fa4898a76b41449ead2b00c398d08b47/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:18.999492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dc68a-24ee-4232-b17a-194f7edb2d25 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:18.999983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dc68a-24ee-4232-b17a-194f7edb2d25 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:19.000510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dc68a-24ee-4232-b17a-194f7edb2d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:19.041910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-741dc68a-24ee-4232-b17a-194f7edb2d25 None None] MFA Rules not processed for user `fa4898a76b41449ead2b00c398d08b47`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:19.044170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-741dc68a-24ee-4232-b17a-194f7edb2d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:19.086538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:19.091690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a2af7-38b6-4218-99d8-b00622538fa7 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:19.099957 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:19.147446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 948/1911] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:19.154873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dc68a-24ee-4232-b17a-194f7edb2d25 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:19.157252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-741dc68a-24ee-4232-b17a-194f7edb2d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:19.159779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025f973-8745-4a6e-8e3a-029ee6f7817d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:19.160460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025f973-8745-4a6e-8e3a-029ee6f7817d service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:19.160802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025f973-8745-4a6e-8e3a-029ee6f7817d service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:19.161200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025f973-8745-4a6e-8e3a-029ee6f7817d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:19.172508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dc68a-24ee-4232-b17a-194f7edb2d25 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:19.181495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441b425-5055-4418-99c9-3c79d04f7d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:19.182095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441b425-5055-4418-99c9-3c79d04f7d80 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:19.182543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441b425-5055-4418-99c9-3c79d04f7d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:19.182842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441b425-5055-4418-99c9-3c79d04f7d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:19.192149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441b425-5055-4418-99c9-3c79d04f7d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:19.193696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441b425-5055-4418-99c9-3c79d04f7d80 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:19.204178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 949/1912] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:19.244440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025f973-8745-4a6e-8e3a-029ee6f7817d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:19.246542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025f973-8745-4a6e-8e3a-029ee6f7817d service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:19.257458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 964/1913] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:19.306144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441b425-5055-4418-99c9-3c79d04f7d80 service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:19.319798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441b425-5055-4418-99c9-3c79d04f7d80 service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:19.324644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc94245-e462-4ca6-a6d9-df4fc52e92fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:19.325267 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94245-e462-4ca6-a6d9-df4fc52e92fb service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:19.325710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94245-e462-4ca6-a6d9-df4fc52e92fb service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:19.326022 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94245-e462-4ca6-a6d9-df4fc52e92fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:19.327843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-7fc94245-e462-4ca6-a6d9-df4fc52e92fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:19.395529 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc94245-e462-4ca6-a6d9-df4fc52e92fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:19.398044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc94245-e462-4ca6-a6d9-df4fc52e92fb service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:19.409009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 950/1914] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:22.034687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025f973-8745-4a6e-8e3a-029ee6f7817d service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:22.036491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3025f973-8745-4a6e-8e3a-029ee6f7817d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:22.117553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025f973-8745-4a6e-8e3a-029ee6f7817d service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:22.127034 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c692ce-9671-4d40-986e-8939d6f36e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:22.129096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c692ce-9671-4d40-986e-8939d6f36e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:22.129690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c692ce-9671-4d40-986e-8939d6f36e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:22.130225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c692ce-9671-4d40-986e-8939d6f36e35 admin admin] PATH_INFO: `/v3/users/6ccb8a78b1cf49c0bcc06106ddb72153` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:22.131947 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c692ce-9671-4d40-986e-8939d6f36e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccb8a78b1cf49c0bcc06106ddb72153)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:22.135561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c692ce-9671-4d40-986e-8939d6f36e35 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:22.196919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56dbbd-778c-4636-836a-e33be5155378 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:22.197501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56dbbd-778c-4636-836a-e33be5155378 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:22.197664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56dbbd-778c-4636-836a-e33be5155378 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:22.199639 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 951/1915] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 16:54:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:54:22.211572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad2266-412c-40e5-a85c-5e4ef3c3b4a0 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:22.212021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad2266-412c-40e5-a85c-5e4ef3c3b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:22.212911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad2266-412c-40e5-a85c-5e4ef3c3b4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:22.225936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c7c692ce-9671-4d40-986e-8939d6f36e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccb8a78b1cf49c0bcc06106ddb72153'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:22.247981 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c7c692ce-9671-4d40-986e-8939d6f36e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccb8a78b1cf49c0bcc06106ddb72153'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:22.255860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:22.261938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-cdad2266-412c-40e5-a85c-5e4ef3c3b4a0 None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:22.263108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c7c692ce-9671-4d40-986e-8939d6f36e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccb8a78b1cf49c0bcc06106ddb72153'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:22.264030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cdad2266-412c-40e5-a85c-5e4ef3c3b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:22.264166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c7c692ce-9671-4d40-986e-8939d6f36e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccb8a78b1cf49c0bcc06106ddb72153'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:22.265813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c7c692ce-9671-4d40-986e-8939d6f36e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccb8a78b1cf49c0bcc06106ddb72153'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:22.320111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 965/1916] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:22 2022] DELETE /identity/v3/users/6ccb8a78b1cf49c0bcc06106ddb72153 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:22.325694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621a29e-fb61-442f-979c-45f652113b5f None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:22.325995 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621a29e-fb61-442f-979c-45f652113b5f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:22.326275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621a29e-fb61-442f-979c-45f652113b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:22.364325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-0621a29e-fb61-442f-979c-45f652113b5f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:22.366125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0621a29e-fb61-442f-979c-45f652113b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:22.400745 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 952/1917] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 16:54:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:22.416089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad2266-412c-40e5-a85c-5e4ef3c3b4a0 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:22.423281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cdad2266-412c-40e5-a85c-5e4ef3c3b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:22.451139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad2266-412c-40e5-a85c-5e4ef3c3b4a0 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:22.492339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 966/1918] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:22.510270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621a29e-fb61-442f-979c-45f652113b5f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:22.513030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0621a29e-fb61-442f-979c-45f652113b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:22.571856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:22.617998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621a29e-fb61-442f-979c-45f652113b5f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:22.626980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c21b7-ce3c-4cc9-b8d3-8e20606d08ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:22.628888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c21b7-ce3c-4cc9-b8d3-8e20606d08ae service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:22.628888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c21b7-ce3c-4cc9-b8d3-8e20606d08ae service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:22.628888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c21b7-ce3c-4cc9-b8d3-8e20606d08ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:22.633191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913879b-ed5a-439c-b233-4442c9132fe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:22.634379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913879b-ed5a-439c-b233-4442c9132fe0 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:22.634648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913879b-ed5a-439c-b233-4442c9132fe0 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:22.635021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913879b-ed5a-439c-b233-4442c9132fe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:22.642193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c21b7-ce3c-4cc9-b8d3-8e20606d08ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:22.644051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c21b7-ce3c-4cc9-b8d3-8e20606d08ae service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:22.650599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913879b-ed5a-439c-b233-4442c9132fe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:22.650599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913879b-ed5a-439c-b233-4442c9132fe0 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:22.657025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 967/1919] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:22.657866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c21b7-ce3c-4cc9-b8d3-8e20606d08ae service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:22.659518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5f8c21b7-ce3c-4cc9-b8d3-8e20606d08ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:22.684062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c21b7-ce3c-4cc9-b8d3-8e20606d08ae service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:22.689616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:22.690460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:22.690750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:22.691064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] PATH_INFO: `/v3/users/2d23e2b0161d49d5b23e06cd63acbc3a` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:22.692300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d23e2b0161d49d5b23e06cd63acbc3a)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:22.694664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:22.695991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 953/1920] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:22.817444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d23e2b0161d49d5b23e06cd63acbc3a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:22.839183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d23e2b0161d49d5b23e06cd63acbc3a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:22.847336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d23e2b0161d49d5b23e06cd63acbc3a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:22.848136 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d23e2b0161d49d5b23e06cd63acbc3a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:22.848760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d23e2b0161d49d5b23e06cd63acbc3a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:22.870626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:22.898843 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 968/1921] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:22 2022] DELETE /identity/v3/users/2d23e2b0161d49d5b23e06cd63acbc3a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:22.904163 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cda46-7f55-4501-abac-a5bd62bf1d33 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:22.905527 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cda46-7f55-4501-abac-a5bd62bf1d33 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:22.906083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cda46-7f55-4501-abac-a5bd62bf1d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:22.946222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-408cda46-7f55-4501-abac-a5bd62bf1d33 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:22.947627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-408cda46-7f55-4501-abac-a5bd62bf1d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:23.042906 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 954/1922] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:23.053945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:23.055461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:23.105002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cda46-7f55-4501-abac-a5bd62bf1d33 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:23.108476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-408cda46-7f55-4501-abac-a5bd62bf1d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:23.129736 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cda46-7f55-4501-abac-a5bd62bf1d33 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:23.132612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1ec06-71b1-435a-959a-5899bb5116b8 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:23.136065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:23.136882 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729577a-1c17-4ec0-a01d-3088efbf22db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:23.137612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729577a-1c17-4ec0-a01d-3088efbf22db service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:23.137925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729577a-1c17-4ec0-a01d-3088efbf22db service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:23.138640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729577a-1c17-4ec0-a01d-3088efbf22db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:23.139856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:23.140235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:23.140413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] PATH_INFO: `/v3/projects/a8807d611d8d48fa96ff993d53cd1a12` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:23.141797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8807d611d8d48fa96ff993d53cd1a12)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:23.143947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:23.149674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729577a-1c17-4ec0-a01d-3088efbf22db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:23.156454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729577a-1c17-4ec0-a01d-3088efbf22db service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:23.166881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 969/1923] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:23.207499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8807d611d8d48fa96ff993d53cd1a12', 'request_id': 'req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.214787 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8807d611d8d48fa96ff993d53cd1a12', 'request_id': 'req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.220671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8807d611d8d48fa96ff993d53cd1a12', 'request_id': 'req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.235926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] The token cache is being invalidate because project a8807d611d8d48fa96ff993d53cd1a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:23.236237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.236952 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.238790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 955/1924] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:23 2022] DELETE /identity/v3/projects/a8807d611d8d48fa96ff993d53cd1a12 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:23.243192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729577a-1c17-4ec0-a01d-3088efbf22db service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:23.253512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729577a-1c17-4ec0-a01d-3088efbf22db service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:23.319121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:23.319826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:23.320166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:23.320391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] PATH_INFO: `/v3/users/024e7d5c2e344490b4825114551f428a` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:23.321703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=024e7d5c2e344490b4825114551f428a)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:23.324246 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:23.375907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024e7d5c2e344490b4825114551f428a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.385922 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024e7d5c2e344490b4825114551f428a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.393681 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024e7d5c2e344490b4825114551f428a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.394472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024e7d5c2e344490b4825114551f428a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.395139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024e7d5c2e344490b4825114551f428a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.421315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 970/1925] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:23 2022] DELETE /identity/v3/users/024e7d5c2e344490b4825114551f428a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:23.491215 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:23.495006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:23.507630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccf2c1-43f4-4f4f-8671-aeca227d9215 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:23.597317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:23.604026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:23.605155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:23.605989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:23.605989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] PATH_INFO: `/v3/projects/be2f75591d584ff5983385e0d33821fe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:23.607355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2f75591d584ff5983385e0d33821fe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:23.610942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:23.694128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2f75591d584ff5983385e0d33821fe', 'request_id': 'req-444632a7-3d2c-410e-b8f4-28e4c7a9b816'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.702649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2f75591d584ff5983385e0d33821fe', 'request_id': 'req-444632a7-3d2c-410e-b8f4-28e4c7a9b816'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.716317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2f75591d584ff5983385e0d33821fe', 'request_id': 'req-444632a7-3d2c-410e-b8f4-28e4c7a9b816'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.735790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] The token cache is being invalidate because project be2f75591d584ff5983385e0d33821fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:23.736090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.736854 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.738507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 956/1926] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:23 2022] DELETE /identity/v3/projects/be2f75591d584ff5983385e0d33821fe => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:23.742699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:23.744789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:23.764731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b2a24-7856-430c-85af-4b01c65ec241 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:23.775144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:23.856138 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:23.856702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:23.856978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:23.857237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] PATH_INFO: `/v3/users/49b354d05ce442a5b7ceddc3ac410d91` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:23.858452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b354d05ce442a5b7ceddc3ac410d91)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:23.860451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:23.933426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b354d05ce442a5b7ceddc3ac410d91'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.949227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b354d05ce442a5b7ceddc3ac410d91'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.959779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b354d05ce442a5b7ceddc3ac410d91'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.961712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b354d05ce442a5b7ceddc3ac410d91'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:23.962558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b354d05ce442a5b7ceddc3ac410d91'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.021521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 971/1927] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:23 2022] DELETE /identity/v3/users/49b354d05ce442a5b7ceddc3ac410d91 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:24.456890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:24.458518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:24.481791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444632a7-3d2c-410e-b8f4-28e4c7a9b816 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:24.561637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:24.562373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:24.562743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:24.563027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] PATH_INFO: `/v3/projects/4bd1e4ef3e7a435e9ac0ada450de6555` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:24.564514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd1e4ef3e7a435e9ac0ada450de6555)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:24.566494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:24.591684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:24.593224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:24.608022 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0118dc-ba9e-4ba0-87f1-cac75a31b286 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:24.613452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:24.614149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:24.614463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:24.614771 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] PATH_INFO: `/v3/projects/ebb6c2c4e9004ad096d3380467041176` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:24.616081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb6c2c4e9004ad096d3380467041176)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:24.618027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:24.639934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd1e4ef3e7a435e9ac0ada450de6555', 'request_id': 'req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.646216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd1e4ef3e7a435e9ac0ada450de6555', 'request_id': 'req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.653070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd1e4ef3e7a435e9ac0ada450de6555', 'request_id': 'req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.668894 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] The token cache is being invalidate because project 4bd1e4ef3e7a435e9ac0ada450de6555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:24.669253 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.670996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3bdd8a2d-b84b-45f3-81fc-9d0ae0c2320e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.676056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 957/1928] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:24 2022] DELETE /identity/v3/projects/4bd1e4ef3e7a435e9ac0ada450de6555 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:24.679555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddc62f-cb0d-43fd-b54b-76199041d0b2 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:24.680025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddc62f-cb0d-43fd-b54b-76199041d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:24.680536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddc62f-cb0d-43fd-b54b-76199041d0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:24.687688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb6c2c4e9004ad096d3380467041176', 'request_id': 'req-a07bead0-e4ea-4225-bc30-c89486c250ea'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.703302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb6c2c4e9004ad096d3380467041176', 'request_id': 'req-a07bead0-e4ea-4225-bc30-c89486c250ea'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.704673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6eddc62f-cb0d-43fd-b54b-76199041d0b2 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:24.705924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6eddc62f-cb0d-43fd-b54b-76199041d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:24.713529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb6c2c4e9004ad096d3380467041176', 'request_id': 'req-a07bead0-e4ea-4225-bc30-c89486c250ea'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.726039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:24.730550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] The token cache is being invalidate because project ebb6c2c4e9004ad096d3380467041176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:24.730920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.731676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.734566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 972/1929] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:24 2022] DELETE /identity/v3/projects/ebb6c2c4e9004ad096d3380467041176 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:24.739102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:24.744133 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:24.761846 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:24.794307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 958/1930] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:24.802256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a25d48-5e9b-449d-8c8d-5446b9c613d2 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:24.802588 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a25d48-5e9b-449d-8c8d-5446b9c613d2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:24.807100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a25d48-5e9b-449d-8c8d-5446b9c613d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:24.840715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bead0-e4ea-4225-bc30-c89486c250ea admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:24.846476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:24.846851 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-04a25d48-5e9b-449d-8c8d-5446b9c613d2 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:24.847199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:24.847612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:24.847766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] PATH_INFO: `/v3/users/7ab8ac0c07a24bbcb7399cb7fc6b21a1` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:24.848601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-04a25d48-5e9b-449d-8c8d-5446b9c613d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:24.849053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab8ac0c07a24bbcb7399cb7fc6b21a1)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:24.851006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:24.861764 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 959/1931] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:24.869090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a25d48-5e9b-449d-8c8d-5446b9c613d2 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:24.884576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a25d48-5e9b-449d-8c8d-5446b9c613d2 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:24.907258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e18dd-002a-4045-9fb6-15fd922a18aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:24.907925 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e18dd-002a-4045-9fb6-15fd922a18aa admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:24.908215 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e18dd-002a-4045-9fb6-15fd922a18aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:24.908474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e18dd-002a-4045-9fb6-15fd922a18aa admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:24.909255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e18dd-002a-4045-9fb6-15fd922a18aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:24.910056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e18dd-002a-4045-9fb6-15fd922a18aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:24.912609 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e18dd-002a-4045-9fb6-15fd922a18aa admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:24.943348 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 960/1932] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:54:24.948570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e18dd-002a-4045-9fb6-15fd922a18aa admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:24.956327 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab8ac0c07a24bbcb7399cb7fc6b21a1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.966433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e18dd-002a-4045-9fb6-15fd922a18aa admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:24.971976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab8ac0c07a24bbcb7399cb7fc6b21a1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.974239 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efec69-9145-4895-81f3-62f97ad871cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:24.974922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efec69-9145-4895-81f3-62f97ad871cd admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:24.975241 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efec69-9145-4895-81f3-62f97ad871cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:24.975525 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efec69-9145-4895-81f3-62f97ad871cd admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:24.977657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efec69-9145-4895-81f3-62f97ad871cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:24.979405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efec69-9145-4895-81f3-62f97ad871cd admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:24.986911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab8ac0c07a24bbcb7399cb7fc6b21a1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.987985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab8ac0c07a24bbcb7399cb7fc6b21a1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:24.989101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab8ac0c07a24bbcb7399cb7fc6b21a1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:25.018607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 973/1933] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:24 2022] DELETE /identity/v3/users/7ab8ac0c07a24bbcb7399cb7fc6b21a1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:25.034418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 961/1934] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:24 2022] POST /identity/v3/projects => generated 400 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:25.036948 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:25.039386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:25.129048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177288e4-65c2-4a65-993a-83f7465bb2ef admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:25.171223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:25.193700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8200-0dcd-45ac-9f1e-3081332b00bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:25.194340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8200-0dcd-45ac-9f1e-3081332b00bc admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.194623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8200-0dcd-45ac-9f1e-3081332b00bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.194899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8200-0dcd-45ac-9f1e-3081332b00bc admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.195630 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea8200-0dcd-45ac-9f1e-3081332b00bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:25.197662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea8200-0dcd-45ac-9f1e-3081332b00bc admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:25.226735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 974/1935] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:25 2022] POST /identity/v3/users => generated 301 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:25.231050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efec69-9145-4895-81f3-62f97ad871cd admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:25.242823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efec69-9145-4895-81f3-62f97ad871cd admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:25.246296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8200-0dcd-45ac-9f1e-3081332b00bc admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:25.248755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b1ea8200-0dcd-45ac-9f1e-3081332b00bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:25.253514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375d498-b4de-44f5-9707-81277560d6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:25.254605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375d498-b4de-44f5-9707-81277560d6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.255278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375d498-b4de-44f5-9707-81277560d6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.255748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375d498-b4de-44f5-9707-81277560d6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.256655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375d498-b4de-44f5-9707-81277560d6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:25.259713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375d498-b4de-44f5-9707-81277560d6c4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:25.263549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8200-0dcd-45ac-9f1e-3081332b00bc admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:25.274280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 962/1936] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:25 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:25.276606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1540f63-31fe-46c8-9536-c1a2cba41508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:25.277286 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540f63-31fe-46c8-9536-c1a2cba41508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.278712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375d498-b4de-44f5-9707-81277560d6c4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:25.279346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540f63-31fe-46c8-9536-c1a2cba41508 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.280479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540f63-31fe-46c8-9536-c1a2cba41508 admin admin] PATH_INFO: `/v3/users/fa4898a76b41449ead2b00c398d08b47` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.282100 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1540f63-31fe-46c8-9536-c1a2cba41508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4898a76b41449ead2b00c398d08b47)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:25.286964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1540f63-31fe-46c8-9536-c1a2cba41508 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:25.290169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375d498-b4de-44f5-9707-81277560d6c4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:25.295251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311b8c8-8a71-41cb-9116-b493d07ee1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:25.296073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311b8c8-8a71-41cb-9116-b493d07ee1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.297317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311b8c8-8a71-41cb-9116-b493d07ee1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.297317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311b8c8-8a71-41cb-9116-b493d07ee1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.298174 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311b8c8-8a71-41cb-9116-b493d07ee1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:25.300598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311b8c8-8a71-41cb-9116-b493d07ee1a1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:25.318024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 963/1937] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:25 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:25.322098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311b8c8-8a71-41cb-9116-b493d07ee1a1 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:25.334367 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311b8c8-8a71-41cb-9116-b493d07ee1a1 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:25.340510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a06c72-841a-4ae6-a1d6-09fe40489a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:25.341424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06c72-841a-4ae6-a1d6-09fe40489a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.341799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06c72-841a-4ae6-a1d6-09fe40489a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.342292 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06c72-841a-4ae6-a1d6-09fe40489a86 admin admin] PATH_INFO: `/v3/projects/b0fd3843b19248e4aaca61989559b63b/users/1518f802a50841e3a77bec578f0e118f/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.367484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a06c72-841a-4ae6-a1d6-09fe40489a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0fd3843b19248e4aaca61989559b63b, user_id=1518f802a50841e3a77bec578f0e118f, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:25.373036 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a06c72-841a-4ae6-a1d6-09fe40489a86 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:25.389173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c1540f63-31fe-46c8-9536-c1a2cba41508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4898a76b41449ead2b00c398d08b47'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:25.395043 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 964/1938] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:25 2022] PUT /identity/v3/projects/b0fd3843b19248e4aaca61989559b63b/users/1518f802a50841e3a77bec578f0e118f/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:25.397340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a06c72-841a-4ae6-a1d6-09fe40489a86 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:25.404446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c1540f63-31fe-46c8-9536-c1a2cba41508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4898a76b41449ead2b00c398d08b47'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:25.407148 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-38a06c72-841a-4ae6-a1d6-09fe40489a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:25.428879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c1540f63-31fe-46c8-9536-c1a2cba41508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4898a76b41449ead2b00c398d08b47'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:25.430385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c1540f63-31fe-46c8-9536-c1a2cba41508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4898a76b41449ead2b00c398d08b47'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:25.431129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c1540f63-31fe-46c8-9536-c1a2cba41508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4898a76b41449ead2b00c398d08b47'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:25.467745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 975/1939] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:25 2022] DELETE /identity/v3/users/fa4898a76b41449ead2b00c398d08b47 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:25.469306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f750d-9b09-48bb-bf14-c68df129c76e None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.469864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f750d-9b09-48bb-bf14-c68df129c76e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.470312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f750d-9b09-48bb-bf14-c68df129c76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.512298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-f91f750d-9b09-48bb-bf14-c68df129c76e None None] MFA Rules not processed for user `1518f802a50841e3a77bec578f0e118f`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:25.513842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f91f750d-9b09-48bb-bf14-c68df129c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:25.516021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a06c72-841a-4ae6-a1d6-09fe40489a86 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:25.569543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:25.595968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 976/1940] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:25.597391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05672-2c68-415d-8bee-b413e314f79e None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.597749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05672-2c68-415d-8bee-b413e314f79e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.598033 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05672-2c68-415d-8bee-b413e314f79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.605705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:25.606587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.607093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.607470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] PATH_INFO: `/v3/projects/a22fd4ebf36045b2b18189f4fa410c32` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.609008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22fd4ebf36045b2b18189f4fa410c32)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:25.611089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:25.620326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-18a05672-2c68-415d-8bee-b413e314f79e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:25.621949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-18a05672-2c68-415d-8bee-b413e314f79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:25.631490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 977/1941] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:25.632376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a05672-2c68-415d-8bee-b413e314f79e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:25.633706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-18a05672-2c68-415d-8bee-b413e314f79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:25.652935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a05672-2c68-415d-8bee-b413e314f79e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:25.658576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67749665-53fc-42d1-8567-704c8c41085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:25.659312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749665-53fc-42d1-8567-704c8c41085c admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.659613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749665-53fc-42d1-8567-704c8c41085c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.659960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749665-53fc-42d1-8567-704c8c41085c admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.660687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67749665-53fc-42d1-8567-704c8c41085c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:25.662787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67749665-53fc-42d1-8567-704c8c41085c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:25.679584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22fd4ebf36045b2b18189f4fa410c32', 'request_id': 'req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:25.686665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22fd4ebf36045b2b18189f4fa410c32', 'request_id': 'req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:25.692680 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22fd4ebf36045b2b18189f4fa410c32', 'request_id': 'req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:25.696381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 978/1942] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:25 2022] POST /identity/v3/projects => generated 402 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:25.697618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67749665-53fc-42d1-8567-704c8c41085c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:25.699540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-67749665-53fc-42d1-8567-704c8c41085c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:25.705624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:25.710040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] The token cache is being invalidate because project a22fd4ebf36045b2b18189f4fa410c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:25.710673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:25.711727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:25.713411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 965/1943] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:25 2022] DELETE /identity/v3/projects/a22fd4ebf36045b2b18189f4fa410c32 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:25.714208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:25.715581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:25.772939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67749665-53fc-42d1-8567-704c8c41085c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:25.777331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9117d-2d29-4b67-89ce-374f8fd425a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:25.778027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9117d-2d29-4b67-89ce-374f8fd425a7 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.778508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9117d-2d29-4b67-89ce-374f8fd425a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.779003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9117d-2d29-4b67-89ce-374f8fd425a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.781557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b0c9117d-2d29-4b67-89ce-374f8fd425a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:25.785364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28eadd-c2e6-4cf5-9afc-5632ec2d3cd4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:25.853214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaefded-5675-4f1d-92c3-96504f3b6132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:25.853951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaefded-5675-4f1d-92c3-96504f3b6132 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.854146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaefded-5675-4f1d-92c3-96504f3b6132 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.854425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaefded-5675-4f1d-92c3-96504f3b6132 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.855143 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaefded-5675-4f1d-92c3-96504f3b6132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:25.856799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9117d-2d29-4b67-89ce-374f8fd425a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:25.857175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaefded-5675-4f1d-92c3-96504f3b6132 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:25.858249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9117d-2d29-4b67-89ce-374f8fd425a7 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:25.873788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 979/1944] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:25.874219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e2b6-0ebc-4ba5-aeb3-4f76c707a7e9 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.874695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e2b6-0ebc-4ba5-aeb3-4f76c707a7e9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.875005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e2b6-0ebc-4ba5-aeb3-4f76c707a7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.883869 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 966/1945] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:25 2022] POST /identity/v3/users => generated 308 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:25.888754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaefded-5675-4f1d-92c3-96504f3b6132 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:25.897697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:25.903888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaefded-5675-4f1d-92c3-96504f3b6132 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:25.904703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-5742e2b6-0ebc-4ba5-aeb3-4f76c707a7e9 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:25.906259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5742e2b6-0ebc-4ba5-aeb3-4f76c707a7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:25.912995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f3913-d364-43ef-b70a-b77d7734221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:25.920035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f3913-d364-43ef-b70a-b77d7734221d admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.921078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 980/1946] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:25.924371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f3913-d364-43ef-b70a-b77d7734221d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.925355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f3913-d364-43ef-b70a-b77d7734221d admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.926979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f3913-d364-43ef-b70a-b77d7734221d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:25.930926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f3913-d364-43ef-b70a-b77d7734221d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:25.931516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dceaf-7216-4b02-a64a-a6d0e37636ea None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.933011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dceaf-7216-4b02-a64a-a6d0e37636ea None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.934030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dceaf-7216-4b02-a64a-a6d0e37636ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.953526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 967/1947] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:25 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:25.955794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f3913-d364-43ef-b70a-b77d7734221d admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:25.971203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f3913-d364-43ef-b70a-b77d7734221d admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:25.986174 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4991bb5-b3a6-48b7-a5a1-cf5a4fc3d79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:25.987066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4991bb5-b3a6-48b7-a5a1-cf5a4fc3d79e admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:25.987234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-849dceaf-7216-4b02-a64a-a6d0e37636ea None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:25.987392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4991bb5-b3a6-48b7-a5a1-cf5a4fc3d79e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:25.987668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4991bb5-b3a6-48b7-a5a1-cf5a4fc3d79e admin admin] PATH_INFO: `/v3/projects/a0c09fdaa0f949bd9e95e980056a45e6/users/b5cb2d3a596645aaad7d3cf2dee7de02/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:25.989336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-849dceaf-7216-4b02-a64a-a6d0e37636ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:26.006745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 981/1948] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:26.012526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dceaf-7216-4b02-a64a-a6d0e37636ea None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:26.016815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4991bb5-b3a6-48b7-a5a1-cf5a4fc3d79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c09fdaa0f949bd9e95e980056a45e6, user_id=b5cb2d3a596645aaad7d3cf2dee7de02, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:26.024126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4991bb5-b3a6-48b7-a5a1-cf5a4fc3d79e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:26.029302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dceaf-7216-4b02-a64a-a6d0e37636ea None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:26.035693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c76e7f-1eeb-4ebc-9d84-2e50876d0449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:26.041994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c76e7f-1eeb-4ebc-9d84-2e50876d0449 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.042385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c76e7f-1eeb-4ebc-9d84-2e50876d0449 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.042695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c76e7f-1eeb-4ebc-9d84-2e50876d0449 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.043499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c76e7f-1eeb-4ebc-9d84-2e50876d0449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:26.043818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c76e7f-1eeb-4ebc-9d84-2e50876d0449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:26.045683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c76e7f-1eeb-4ebc-9d84-2e50876d0449 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:26.051940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 968/1949] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:25 2022] PUT /identity/v3/projects/a0c09fdaa0f949bd9e95e980056a45e6/users/b5cb2d3a596645aaad7d3cf2dee7de02/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:26.053077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4991bb5-b3a6-48b7-a5a1-cf5a4fc3d79e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:26.087383 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 982/1950] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:54:26.093428 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c76e7f-1eeb-4ebc-9d84-2e50876d0449 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:26.121882 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c76e7f-1eeb-4ebc-9d84-2e50876d0449 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:26.237941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4991bb5-b3a6-48b7-a5a1-cf5a4fc3d79e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:26.251613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0831d2-35c5-4963-a987-8ed180c064fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:26.251613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0831d2-35c5-4963-a987-8ed180c064fa admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.252021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0831d2-35c5-4963-a987-8ed180c064fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.252202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0831d2-35c5-4963-a987-8ed180c064fa admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.256168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0831d2-35c5-4963-a987-8ed180c064fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:26.258039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0831d2-35c5-4963-a987-8ed180c064fa admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:26.279172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 969/1951] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:26 2022] GET /identity/v3/roles => generated 1427 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:26.280398 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0831d2-35c5-4963-a987-8ed180c064fa admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:26.283917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717bb09-dcbd-407b-8293-6b9649813445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:26.284575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717bb09-dcbd-407b-8293-6b9649813445 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.284859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717bb09-dcbd-407b-8293-6b9649813445 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.285136 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717bb09-dcbd-407b-8293-6b9649813445 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.285819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717bb09-dcbd-407b-8293-6b9649813445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:26.288697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717bb09-dcbd-407b-8293-6b9649813445 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:26.292953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0831d2-35c5-4963-a987-8ed180c064fa admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:26.305720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adf614-83d1-4b41-af4a-5e600df3b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:26.307495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf614-83d1-4b41-af4a-5e600df3b160 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.308025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf614-83d1-4b41-af4a-5e600df3b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.308824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf614-83d1-4b41-af4a-5e600df3b160 admin admin] PATH_INFO: `/v3/projects/a0c09fdaa0f949bd9e95e980056a45e6/users/b5cb2d3a596645aaad7d3cf2dee7de02/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.311863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adf614-83d1-4b41-af4a-5e600df3b160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c09fdaa0f949bd9e95e980056a45e6, user_id=b5cb2d3a596645aaad7d3cf2dee7de02, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:26.315094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adf614-83d1-4b41-af4a-5e600df3b160 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:26.342563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 970/1952] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:26 2022] PUT /identity/v3/projects/a0c09fdaa0f949bd9e95e980056a45e6/users/b5cb2d3a596645aaad7d3cf2dee7de02/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:26.346615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7da7c-1ca5-475b-ba9c-afcbaef8b8ba None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.346899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7da7c-1ca5-475b-ba9c-afcbaef8b8ba None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.347221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7da7c-1ca5-475b-ba9c-afcbaef8b8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.353116 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 983/1953] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:26 2022] POST /identity/v3/projects => generated 368 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:26.354197 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717bb09-dcbd-407b-8293-6b9649813445 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:26.372323 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:26.396511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-9ea7da7c-1ca5-475b-ba9c-afcbaef8b8ba None None] MFA Rules not processed for user `b5cb2d3a596645aaad7d3cf2dee7de02`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:26.397761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9ea7da7c-1ca5-475b-ba9c-afcbaef8b8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:26.453690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717bb09-dcbd-407b-8293-6b9649813445 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:26.459433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf0bcc-31f2-49f5-bb7d-86df6c5d872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:26.460206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf0bcc-31f2-49f5-bb7d-86df6c5d872e admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.460980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf0bcc-31f2-49f5-bb7d-86df6c5d872e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.461432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf0bcc-31f2-49f5-bb7d-86df6c5d872e admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.462149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf0bcc-31f2-49f5-bb7d-86df6c5d872e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:26.465475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf0bcc-31f2-49f5-bb7d-86df6c5d872e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:26.516932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 971/1955] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:26 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:26.519787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 984/1955] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:26 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:26.521137 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7da7c-1ca5-475b-ba9c-afcbaef8b8ba None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:26.531317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf0bcc-31f2-49f5-bb7d-86df6c5d872e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:26.534587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3eaf0bcc-31f2-49f5-bb7d-86df6c5d872e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:26.555212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7da7c-1ca5-475b-ba9c-afcbaef8b8ba None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:26.567646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2a216-de74-4c05-8654-e46146f5ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:26.570581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a216-de74-4c05-8654-e46146f5ef68 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.570581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a216-de74-4c05-8654-e46146f5ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.570977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a216-de74-4c05-8654-e46146f5ef68 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.571562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2a216-de74-4c05-8654-e46146f5ef68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:26.579673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2a216-de74-4c05-8654-e46146f5ef68 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:26.604736 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 972/1956] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:26 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:26.612552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2a216-de74-4c05-8654-e46146f5ef68 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:26.654588 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2a216-de74-4c05-8654-e46146f5ef68 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:26.656999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf0bcc-31f2-49f5-bb7d-86df6c5d872e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:26.662808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386cf8-c14a-426c-83f1-5f2be629aa74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:26.663557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386cf8-c14a-426c-83f1-5f2be629aa74 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.663851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386cf8-c14a-426c-83f1-5f2be629aa74 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.664176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386cf8-c14a-426c-83f1-5f2be629aa74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.678168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8386cf8-c14a-426c-83f1-5f2be629aa74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:26.678880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939517e4-1357-4049-ad24-d9f91e6a84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:26.679563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939517e4-1357-4049-ad24-d9f91e6a84be admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.679842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939517e4-1357-4049-ad24-d9f91e6a84be admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.680213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939517e4-1357-4049-ad24-d9f91e6a84be admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.681092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939517e4-1357-4049-ad24-d9f91e6a84be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:26.683462 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939517e4-1357-4049-ad24-d9f91e6a84be admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:26.687320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8386cf8-c14a-426c-83f1-5f2be629aa74 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:26.714555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 985/1957] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:26 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:26.720462 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 973/1958] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:26 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:26.722129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386cf8-c14a-426c-83f1-5f2be629aa74 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:26.723910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d8386cf8-c14a-426c-83f1-5f2be629aa74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:26.740186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939517e4-1357-4049-ad24-d9f91e6a84be admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:26.757969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939517e4-1357-4049-ad24-d9f91e6a84be admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:26.764162 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386cf8-c14a-426c-83f1-5f2be629aa74 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:26.773792 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0314d6-27f3-46c0-bf61-bc8052dc26e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:26.775073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0314d6-27f3-46c0-bf61-bc8052dc26e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.776773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0314d6-27f3-46c0-bf61-bc8052dc26e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.777033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0314d6-27f3-46c0-bf61-bc8052dc26e9 admin admin] PATH_INFO: `/v3/projects/4c12ba70cde84a4eb69cbf718660942a/users/aa709088cee34f9fad445b32736be56d/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.778914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:26.779925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.780232 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.780494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] PATH_INFO: `/v3/projects/9930456f049f4b4f848b5ddcd76677d4` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.783895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9930456f049f4b4f848b5ddcd76677d4)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:26.791229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:26.813409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:26.823302 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0314d6-27f3-46c0-bf61-bc8052dc26e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c12ba70cde84a4eb69cbf718660942a, user_id=aa709088cee34f9fad445b32736be56d, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:26.833732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0314d6-27f3-46c0-bf61-bc8052dc26e9 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:26.867727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 974/1959] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:26 2022] PUT /identity/v3/projects/4c12ba70cde84a4eb69cbf718660942a/users/aa709088cee34f9fad445b32736be56d/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:26.894094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c698b-388d-4346-9a38-a9a939980147 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:26.895355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c698b-388d-4346-9a38-a9a939980147 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:26.895721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c698b-388d-4346-9a38-a9a939980147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:26.951444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9930456f049f4b4f848b5ddcd76677d4', 'request_id': 'req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:26.955195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-dc3c698b-388d-4346-9a38-a9a939980147 None None] MFA Rules not processed for user `aa709088cee34f9fad445b32736be56d`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:26.957315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-dc3c698b-388d-4346-9a38-a9a939980147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:26.970550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9930456f049f4b4f848b5ddcd76677d4', 'request_id': 'req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:26.981290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9930456f049f4b4f848b5ddcd76677d4', 'request_id': 'req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:27.006222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] The token cache is being invalidate because project 9930456f049f4b4f848b5ddcd76677d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:27.006858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:27.008126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:27.011205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 986/1960] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:26 2022] DELETE /identity/v3/projects/9930456f049f4b4f848b5ddcd76677d4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:27.012550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.014791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:27.059160 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:27.064683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 975/1961] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:27.066100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30477ec0-4f5b-4f6a-9786-793a348a0383 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.066414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30477ec0-4f5b-4f6a-9786-793a348a0383 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.066675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30477ec0-4f5b-4f6a-9786-793a348a0383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.089374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-30477ec0-4f5b-4f6a-9786-793a348a0383 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:27.090604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-30477ec0-4f5b-4f6a-9786-793a348a0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:27.094729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9716d-d8e6-4d1c-ac4c-a74902c1ebdf admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.098920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104e9b9-f022-4ed6-9fbf-14b34eff2e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.099589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104e9b9-f022-4ed6-9fbf-14b34eff2e07 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.099951 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104e9b9-f022-4ed6-9fbf-14b34eff2e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.100158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104e9b9-f022-4ed6-9fbf-14b34eff2e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.102041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8104e9b9-f022-4ed6-9fbf-14b34eff2e07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:27.163707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 976/1962] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:27.171414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30477ec0-4f5b-4f6a-9786-793a348a0383 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.171414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-30477ec0-4f5b-4f6a-9786-793a348a0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:27.176572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104e9b9-f022-4ed6-9fbf-14b34eff2e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.178042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104e9b9-f022-4ed6-9fbf-14b34eff2e07 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.180055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30477ec0-4f5b-4f6a-9786-793a348a0383 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.185165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072c321-06a1-4544-8b84-908bd4b2253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.185798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072c321-06a1-4544-8b84-908bd4b2253e admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.186242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072c321-06a1-4544-8b84-908bd4b2253e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.186524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072c321-06a1-4544-8b84-908bd4b2253e admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.187248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072c321-06a1-4544-8b84-908bd4b2253e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.189198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072c321-06a1-4544-8b84-908bd4b2253e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.189303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 987/1963] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:27 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:27.193329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fae6e1-59f1-47f6-9a41-f254db43c8b0 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.193849 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fae6e1-59f1-47f6-9a41-f254db43c8b0 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.194427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fae6e1-59f1-47f6-9a41-f254db43c8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.221786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a2fae6e1-59f1-47f6-9a41-f254db43c8b0 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:27.223054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a2fae6e1-59f1-47f6-9a41-f254db43c8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:27.229363 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 977/1964] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:27 2022] POST /identity/v3/projects => generated 368 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:27.230477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072c321-06a1-4544-8b84-908bd4b2253e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.313889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072c321-06a1-4544-8b84-908bd4b2253e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.320105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54722350-c02c-4366-b38e-19c6ee60c533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.321362 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54722350-c02c-4366-b38e-19c6ee60c533 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.321891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54722350-c02c-4366-b38e-19c6ee60c533 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.322249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54722350-c02c-4366-b38e-19c6ee60c533 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.322670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 988/1965] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:27.322964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54722350-c02c-4366-b38e-19c6ee60c533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.326402 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54722350-c02c-4366-b38e-19c6ee60c533 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.330478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fae6e1-59f1-47f6-9a41-f254db43c8b0 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.337374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:27.348444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fae6e1-59f1-47f6-9a41-f254db43c8b0 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.355354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 978/1966] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:27 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:27.359335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54722350-c02c-4366-b38e-19c6ee60c533 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.361690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95953f7-046a-4f53-b104-6ae74f48e8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.362894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95953f7-046a-4f53-b104-6ae74f48e8bd admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.363477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95953f7-046a-4f53-b104-6ae74f48e8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.365338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95953f7-046a-4f53-b104-6ae74f48e8bd admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.367001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95953f7-046a-4f53-b104-6ae74f48e8bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:27.367512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95953f7-046a-4f53-b104-6ae74f48e8bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.372548 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54722350-c02c-4366-b38e-19c6ee60c533 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.372717 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95953f7-046a-4f53-b104-6ae74f48e8bd admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.376280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6522271-8cdf-48ed-9d58-dc8c2b3e133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.377132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6522271-8cdf-48ed-9d58-dc8c2b3e133c admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.377483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6522271-8cdf-48ed-9d58-dc8c2b3e133c admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.378114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6522271-8cdf-48ed-9d58-dc8c2b3e133c admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.378602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6522271-8cdf-48ed-9d58-dc8c2b3e133c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.380353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6522271-8cdf-48ed-9d58-dc8c2b3e133c admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.392834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 979/1967] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:27 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:27.394285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 989/1968] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:54:27.397263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6522271-8cdf-48ed-9d58-dc8c2b3e133c admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.398685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95953f7-046a-4f53-b104-6ae74f48e8bd admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.410172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6522271-8cdf-48ed-9d58-dc8c2b3e133c admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.418561 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53bdb2-5054-4ec7-934b-453c60d3f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.419322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53bdb2-5054-4ec7-934b-453c60d3f4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.419477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95953f7-046a-4f53-b104-6ae74f48e8bd admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.419590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53bdb2-5054-4ec7-934b-453c60d3f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.419917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53bdb2-5054-4ec7-934b-453c60d3f4d6 admin admin] PATH_INFO: `/v3/projects/14ab26de6a0a437b8b7386a42e2ab2f0/users/c2d168b8bb404b659ffb6d3bfb993049/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.426694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50ab09-ca6e-4392-b412-13f0135e7edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.427563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50ab09-ca6e-4392-b412-13f0135e7edb admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.427983 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50ab09-ca6e-4392-b412-13f0135e7edb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.428576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50ab09-ca6e-4392-b412-13f0135e7edb admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.429495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50ab09-ca6e-4392-b412-13f0135e7edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.432267 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50ab09-ca6e-4392-b412-13f0135e7edb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.451369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53bdb2-5054-4ec7-934b-453c60d3f4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ab26de6a0a437b8b7386a42e2ab2f0, user_id=c2d168b8bb404b659ffb6d3bfb993049, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.454521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53bdb2-5054-4ec7-934b-453c60d3f4d6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.483946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 980/1969] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:27 2022] PUT /identity/v3/projects/14ab26de6a0a437b8b7386a42e2ab2f0/users/c2d168b8bb404b659ffb6d3bfb993049/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:27.489827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 990/1970] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:27 2022] POST /identity/v3/projects => generated 374 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:27.503826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53bdb2-5054-4ec7-934b-453c60d3f4d6 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.504037 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50ab09-ca6e-4392-b412-13f0135e7edb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.625448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:27.672791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50ab09-ca6e-4392-b412-13f0135e7edb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.679793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df733d6d-e34f-470e-a82a-aecb5dc833cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.680722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df733d6d-e34f-470e-a82a-aecb5dc833cb admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.681444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df733d6d-e34f-470e-a82a-aecb5dc833cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.681788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df733d6d-e34f-470e-a82a-aecb5dc833cb admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.682565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df733d6d-e34f-470e-a82a-aecb5dc833cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.683192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53bdb2-5054-4ec7-934b-453c60d3f4d6 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.684969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df733d6d-e34f-470e-a82a-aecb5dc833cb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.688839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeca3ee-ee8f-4da2-8e6b-369e4aa778b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.689899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca3ee-ee8f-4da2-8e6b-369e4aa778b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.690207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca3ee-ee8f-4da2-8e6b-369e4aa778b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.690569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca3ee-ee8f-4da2-8e6b-369e4aa778b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.691426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeca3ee-ee8f-4da2-8e6b-369e4aa778b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.693074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeca3ee-ee8f-4da2-8e6b-369e4aa778b2 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.711909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 981/1971] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:27 2022] GET /identity/v3/roles => generated 1427 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:27.717207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeca3ee-ee8f-4da2-8e6b-369e4aa778b2 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.725263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 991/1972] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:27 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:27.730750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df733d6d-e34f-470e-a82a-aecb5dc833cb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.732949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeca3ee-ee8f-4da2-8e6b-369e4aa778b2 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.738700 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3e059-202a-4fd8-89c8-61bef2828dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.739423 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e059-202a-4fd8-89c8-61bef2828dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.739737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e059-202a-4fd8-89c8-61bef2828dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.740169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e059-202a-4fd8-89c8-61bef2828dd3 admin admin] PATH_INFO: `/v3/projects/14ab26de6a0a437b8b7386a42e2ab2f0/users/c2d168b8bb404b659ffb6d3bfb993049/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.742160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3e059-202a-4fd8-89c8-61bef2828dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ab26de6a0a437b8b7386a42e2ab2f0, user_id=c2d168b8bb404b659ffb6d3bfb993049, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.743563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df733d6d-e34f-470e-a82a-aecb5dc833cb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.745553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3e059-202a-4fd8-89c8-61bef2828dd3 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.750704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207e48f-dfd5-424e-9f2d-5f90683e33ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.751382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207e48f-dfd5-424e-9f2d-5f90683e33ba admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.751666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207e48f-dfd5-424e-9f2d-5f90683e33ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.752067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207e48f-dfd5-424e-9f2d-5f90683e33ba admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.752785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207e48f-dfd5-424e-9f2d-5f90683e33ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.754972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207e48f-dfd5-424e-9f2d-5f90683e33ba admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.761470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 982/1973] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:27 2022] PUT /identity/v3/projects/14ab26de6a0a437b8b7386a42e2ab2f0/users/c2d168b8bb404b659ffb6d3bfb993049/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:27.767870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 992/1974] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:27 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:27.771916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da979-ba8b-4f7c-81fa-9d97dc94a42c None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.772565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da979-ba8b-4f7c-81fa-9d97dc94a42c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.772853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da979-ba8b-4f7c-81fa-9d97dc94a42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.774298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207e48f-dfd5-424e-9f2d-5f90683e33ba admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.785872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207e48f-dfd5-424e-9f2d-5f90683e33ba admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.806931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-cf2da979-ba8b-4f7c-81fa-9d97dc94a42c None None] MFA Rules not processed for user `c2d168b8bb404b659ffb6d3bfb993049`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:27.808402 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cf2da979-ba8b-4f7c-81fa-9d97dc94a42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:27.854468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee27ef5-b43e-4796-9500-3daa507ee7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.855139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27ef5-b43e-4796-9500-3daa507ee7dc admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.855772 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27ef5-b43e-4796-9500-3daa507ee7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.856054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27ef5-b43e-4796-9500-3daa507ee7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.857089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee27ef5-b43e-4796-9500-3daa507ee7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.858890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee27ef5-b43e-4796-9500-3daa507ee7dc admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.872946 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 993/1975] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:27 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:27.874013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee27ef5-b43e-4796-9500-3daa507ee7dc admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.883842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee27ef5-b43e-4796-9500-3daa507ee7dc admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.884248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 983/1976] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:27.891293 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f2e33-c22b-4647-a66a-ef1d841f998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:27.891987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2e33-c22b-4647-a66a-ef1d841f998e admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.892444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2e33-c22b-4647-a66a-ef1d841f998e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.892723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2e33-c22b-4647-a66a-ef1d841f998e admin admin] PATH_INFO: `/v3/projects/b2e3bceea2f34ca0a5a65c8a93e17327/users/0cda09a578be4af489c1239cdaa76605/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.897902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2da979-ba8b-4f7c-81fa-9d97dc94a42c None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:27.909368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f2e33-c22b-4647-a66a-ef1d841f998e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e3bceea2f34ca0a5a65c8a93e17327, user_id=0cda09a578be4af489c1239cdaa76605, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:27.912067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f2e33-c22b-4647-a66a-ef1d841f998e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:27.925378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:27.927842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 994/1977] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:27 2022] PUT /identity/v3/projects/b2e3bceea2f34ca0a5a65c8a93e17327/users/0cda09a578be4af489c1239cdaa76605/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:27.939890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bf566-bd13-4b59-82d2-9be3b845004c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:27.940189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bf566-bd13-4b59-82d2-9be3b845004c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:27.940587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bf566-bd13-4b59-82d2-9be3b845004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:27.973783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2da979-ba8b-4f7c-81fa-9d97dc94a42c None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:27.987991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-7f1bf566-bd13-4b59-82d2-9be3b845004c None None] MFA Rules not processed for user `0cda09a578be4af489c1239cdaa76605`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:27.989420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7f1bf566-bd13-4b59-82d2-9be3b845004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:28.066313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de04461-2c2f-4a56-b736-abfa2c1becbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:28.067146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04461-2c2f-4a56-b736-abfa2c1becbf service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:28.067426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04461-2c2f-4a56-b736-abfa2c1becbf service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:28.067793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04461-2c2f-4a56-b736-abfa2c1becbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:28.091464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 995/1978] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:28.099875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bf566-bd13-4b59-82d2-9be3b845004c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:28.101254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7f1bf566-bd13-4b59-82d2-9be3b845004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:28.129084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bf566-bd13-4b59-82d2-9be3b845004c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:28.133500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a628df5-cd01-4e4c-8cd3-78e48d74e30f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:28.134180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a628df5-cd01-4e4c-8cd3-78e48d74e30f service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:28.134464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a628df5-cd01-4e4c-8cd3-78e48d74e30f service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:28.135501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a628df5-cd01-4e4c-8cd3-78e48d74e30f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:28.153890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a628df5-cd01-4e4c-8cd3-78e48d74e30f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:28.155437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a628df5-cd01-4e4c-8cd3-78e48d74e30f service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:28.168394 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 996/1979] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:28.178687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de04461-2c2f-4a56-b736-abfa2c1becbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:28.179502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de04461-2c2f-4a56-b736-abfa2c1becbf service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:28.191097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 984/1980] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:54:28.291585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a628df5-cd01-4e4c-8cd3-78e48d74e30f service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:28.300262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a628df5-cd01-4e4c-8cd3-78e48d74e30f service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:28.304197 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c687045-5af1-4679-a858-9273ac775d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:28.304837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c687045-5af1-4679-a858-9273ac775d2a service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:28.305166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c687045-5af1-4679-a858-9273ac775d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:28.305430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c687045-5af1-4679-a858-9273ac775d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:28.317218 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:28.372413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c687045-5af1-4679-a858-9273ac775d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:28.374199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c687045-5af1-4679-a858-9273ac775d2a service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:28.386699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 997/1981] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:31.813568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de04461-2c2f-4a56-b736-abfa2c1becbf service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:31.815260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0de04461-2c2f-4a56-b736-abfa2c1becbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:31.888664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de04461-2c2f-4a56-b736-abfa2c1becbf service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:31.894827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17211e3-77c4-4659-92b8-0de7ce588ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:31.895158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17211e3-77c4-4659-92b8-0de7ce588ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:31.895599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17211e3-77c4-4659-92b8-0de7ce588ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:31.896154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17211e3-77c4-4659-92b8-0de7ce588ecc admin admin] PATH_INFO: `/v3/users/1518f802a50841e3a77bec578f0e118f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:31.897553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17211e3-77c4-4659-92b8-0de7ce588ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1518f802a50841e3a77bec578f0e118f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:31.900158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17211e3-77c4-4659-92b8-0de7ce588ecc admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:31.955262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:31.956407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c687045-5af1-4679-a858-9273ac775d2a service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:31.974364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c687045-5af1-4679-a858-9273ac775d2a service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:31.979799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fefa7-c785-47c6-8736-0fa3e5ba8922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:31.980596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fefa7-c785-47c6-8736-0fa3e5ba8922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:31.980878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fefa7-c785-47c6-8736-0fa3e5ba8922 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:31.981218 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fefa7-c785-47c6-8736-0fa3e5ba8922 admin admin] PATH_INFO: `/v3/users/0cda09a578be4af489c1239cdaa76605` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:31.982725 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fefa7-c785-47c6-8736-0fa3e5ba8922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cda09a578be4af489c1239cdaa76605)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:31.987472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fefa7-c785-47c6-8736-0fa3e5ba8922 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:31.997190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b17211e3-77c4-4659-92b8-0de7ce588ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1518f802a50841e3a77bec578f0e118f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:31.997973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b17211e3-77c4-4659-92b8-0de7ce588ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1518f802a50841e3a77bec578f0e118f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:32.015172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b17211e3-77c4-4659-92b8-0de7ce588ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1518f802a50841e3a77bec578f0e118f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:32.017324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b17211e3-77c4-4659-92b8-0de7ce588ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1518f802a50841e3a77bec578f0e118f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:32.028929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b17211e3-77c4-4659-92b8-0de7ce588ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1518f802a50841e3a77bec578f0e118f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:32.049354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 985/1982] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:31 2022] DELETE /identity/v3/users/1518f802a50841e3a77bec578f0e118f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:32.054018 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07716668-4a7f-4eb1-8d7f-c24f71468617 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:32.054759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07716668-4a7f-4eb1-8d7f-c24f71468617 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:32.055208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07716668-4a7f-4eb1-8d7f-c24f71468617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:32.061554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f60fefa7-c785-47c6-8736-0fa3e5ba8922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cda09a578be4af489c1239cdaa76605'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:32.074270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f60fefa7-c785-47c6-8736-0fa3e5ba8922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cda09a578be4af489c1239cdaa76605'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:32.086893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f60fefa7-c785-47c6-8736-0fa3e5ba8922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cda09a578be4af489c1239cdaa76605'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:32.087931 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f60fefa7-c785-47c6-8736-0fa3e5ba8922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cda09a578be4af489c1239cdaa76605'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:32.088745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f60fefa7-c785-47c6-8736-0fa3e5ba8922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cda09a578be4af489c1239cdaa76605'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:32.103497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-07716668-4a7f-4eb1-8d7f-c24f71468617 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:32.105421 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-07716668-4a7f-4eb1-8d7f-c24f71468617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:32.123232 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 998/1983] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:31 2022] DELETE /identity/v3/users/0cda09a578be4af489c1239cdaa76605 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:32.132834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e171-a69a-49ca-a2c0-bda2a95bd755 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:32.133119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e171-a69a-49ca-a2c0-bda2a95bd755 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:32.133370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e171-a69a-49ca-a2c0-bda2a95bd755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:32.157155 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-8199e171-a69a-49ca-a2c0-bda2a95bd755 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:32.158555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8199e171-a69a-49ca-a2c0-bda2a95bd755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:32.204983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 986/1984] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:32.217343 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07716668-4a7f-4eb1-8d7f-c24f71468617 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:32.220234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-07716668-4a7f-4eb1-8d7f-c24f71468617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:32.241935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 999/1985] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:32.252438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199e171-a69a-49ca-a2c0-bda2a95bd755 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:32.253995 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8199e171-a69a-49ca-a2c0-bda2a95bd755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:32.286343 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:32.292669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07716668-4a7f-4eb1-8d7f-c24f71468617 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:32.323119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199e171-a69a-49ca-a2c0-bda2a95bd755 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:32.326992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c432fb-0a73-476a-acd5-9f8c352577c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:32.327928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c432fb-0a73-476a-acd5-9f8c352577c3 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:32.328209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c432fb-0a73-476a-acd5-9f8c352577c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:32.328486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c432fb-0a73-476a-acd5-9f8c352577c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:32.338886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c432fb-0a73-476a-acd5-9f8c352577c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:32.340381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c432fb-0a73-476a-acd5-9f8c352577c3 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:32.347355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ba5e0-4e70-4164-8561-e6b86c032d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:32.348385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ba5e0-4e70-4164-8561-e6b86c032d1a service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:32.348596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ba5e0-4e70-4164-8561-e6b86c032d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:32.348868 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ba5e0-4e70-4164-8561-e6b86c032d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:32.351397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1000/1986] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:54:32.363827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ba5e0-4e70-4164-8561-e6b86c032d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:32.365501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ba5e0-4e70-4164-8561-e6b86c032d1a service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:32.382056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 987/1987] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:32.984425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c432fb-0a73-476a-acd5-9f8c352577c3 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:32.986182 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-06c432fb-0a73-476a-acd5-9f8c352577c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:33.002879 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ba5e0-4e70-4164-8561-e6b86c032d1a service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:33.004520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c36ba5e0-4e70-4164-8561-e6b86c032d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:33.007467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c432fb-0a73-476a-acd5-9f8c352577c3 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:33.035684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ba5e0-4e70-4164-8561-e6b86c032d1a service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:33.046996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:33.046996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.046996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.046996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] PATH_INFO: `/v3/projects/b2e3bceea2f34ca0a5a65c8a93e17327` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.047450 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2e3bceea2f34ca0a5a65c8a93e17327)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:33.047539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:33.048494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:33.049883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.050273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.050408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:33.051131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] PATH_INFO: `/v3/projects/b0fd3843b19248e4aaca61989559b63b` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.056828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0fd3843b19248e4aaca61989559b63b)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:33.059117 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:33.108248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e3bceea2f34ca0a5a65c8a93e17327', 'request_id': 'req-7b916113-4b13-49df-843b-386562a6c83d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.114983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e3bceea2f34ca0a5a65c8a93e17327', 'request_id': 'req-7b916113-4b13-49df-843b-386562a6c83d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.121019 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e3bceea2f34ca0a5a65c8a93e17327', 'request_id': 'req-7b916113-4b13-49df-843b-386562a6c83d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.123256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0fd3843b19248e4aaca61989559b63b', 'request_id': 'req-41787c03-ed30-47f4-b545-55c1771b4837'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.134827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0fd3843b19248e4aaca61989559b63b', 'request_id': 'req-41787c03-ed30-47f4-b545-55c1771b4837'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.135644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] The token cache is being invalidate because project b2e3bceea2f34ca0a5a65c8a93e17327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:33.135938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.136582 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7b916113-4b13-49df-843b-386562a6c83d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.138389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 988/1988] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:33 2022] DELETE /identity/v3/projects/b2e3bceea2f34ca0a5a65c8a93e17327 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:33.141306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0fd3843b19248e4aaca61989559b63b', 'request_id': 'req-41787c03-ed30-47f4-b545-55c1771b4837'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.143523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5d744-5449-491f-ad27-80c406d29a25 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.144437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5d744-5449-491f-ad27-80c406d29a25 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.144698 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5d744-5449-491f-ad27-80c406d29a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.166138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-0ed5d744-5449-491f-ad27-80c406d29a25 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:33.166399 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] The token cache is being invalidate because project b0fd3843b19248e4aaca61989559b63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:33.166861 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.167430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0ed5d744-5449-491f-ad27-80c406d29a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:33.167959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.173601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1001/1989] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:32 2022] DELETE /identity/v3/projects/b0fd3843b19248e4aaca61989559b63b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:33.175576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:33.177206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:33.243369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 989/1990] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:33.252125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1049f2-8f1d-4d98-883d-9bfc3a14f514 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.252505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1049f2-8f1d-4d98-883d-9bfc3a14f514 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.252796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1049f2-8f1d-4d98-883d-9bfc3a14f514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.253429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41787c03-ed30-47f4-b545-55c1771b4837 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:33.258833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:33.260024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.260469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.260812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] PATH_INFO: `/v3/users/b5cb2d3a596645aaad7d3cf2dee7de02` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.262180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5cb2d3a596645aaad7d3cf2dee7de02)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:33.264227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:33.273902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-3a1049f2-8f1d-4d98-883d-9bfc3a14f514 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:33.275202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3a1049f2-8f1d-4d98-883d-9bfc3a14f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:33.285516 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 990/1991] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:33.289804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1049f2-8f1d-4d98-883d-9bfc3a14f514 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:33.301877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1049f2-8f1d-4d98-883d-9bfc3a14f514 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:33.308911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9d9e-c7c5-446b-9366-6d3ff7530e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:33.309846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9d9e-c7c5-446b-9366-6d3ff7530e37 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.310131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9d9e-c7c5-446b-9366-6d3ff7530e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.310681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9d9e-c7c5-446b-9366-6d3ff7530e37 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.316058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec9d9e-c7c5-446b-9366-6d3ff7530e37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:33.316753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec9d9e-c7c5-446b-9366-6d3ff7530e37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:33.319428 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec9d9e-c7c5-446b-9366-6d3ff7530e37 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:33.324302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5cb2d3a596645aaad7d3cf2dee7de02'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.328205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:33.335122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 991/1992] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:54:33.336184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5cb2d3a596645aaad7d3cf2dee7de02'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.340591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9d9e-c7c5-446b-9366-6d3ff7530e37 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:33.345527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5cb2d3a596645aaad7d3cf2dee7de02'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.346224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5cb2d3a596645aaad7d3cf2dee7de02'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.346853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5cb2d3a596645aaad7d3cf2dee7de02'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.350543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9d9e-c7c5-446b-9366-6d3ff7530e37 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:33.355219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7e426-13c2-452d-ab78-7fefb32ed282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:33.355836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7e426-13c2-452d-ab78-7fefb32ed282 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.356116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7e426-13c2-452d-ab78-7fefb32ed282 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.356389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7e426-13c2-452d-ab78-7fefb32ed282 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.357055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7e426-13c2-452d-ab78-7fefb32ed282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:33.359076 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7e426-13c2-452d-ab78-7fefb32ed282 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:33.364784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1002/1993] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:33 2022] DELETE /identity/v3/users/b5cb2d3a596645aaad7d3cf2dee7de02 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:33.398014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 992/1994] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:33 2022] POST /identity/v3/projects => generated 374 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:33.402214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:33.404070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:33.487080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d28ce-6ce8-4d07-8071-e62826fafb07 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:33.570167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476b26e-f954-4050-8f7c-d0eb101233d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:33.572430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b26e-f954-4050-8f7c-d0eb101233d2 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.572587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b26e-f954-4050-8f7c-d0eb101233d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.572767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b26e-f954-4050-8f7c-d0eb101233d2 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.573649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476b26e-f954-4050-8f7c-d0eb101233d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:33.576121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476b26e-f954-4050-8f7c-d0eb101233d2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:33.607024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1003/1995] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:33 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:33.610233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7e426-13c2-452d-ab78-7fefb32ed282 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:33.621370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7e426-13c2-452d-ab78-7fefb32ed282 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:33.628831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbe8a5-6dbe-47fc-b4be-9133d0789eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:33.630195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbe8a5-6dbe-47fc-b4be-9133d0789eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.630195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbe8a5-6dbe-47fc-b4be-9133d0789eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.630195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbe8a5-6dbe-47fc-b4be-9133d0789eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.630816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbe8a5-6dbe-47fc-b4be-9133d0789eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:33.632542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbe8a5-6dbe-47fc-b4be-9133d0789eb9 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:33.645461 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 993/1996] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:33 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:33.649608 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476b26e-f954-4050-8f7c-d0eb101233d2 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:33.661941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476b26e-f954-4050-8f7c-d0eb101233d2 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:33.666701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2611cb-ae23-419c-9eba-c93c41c551aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:33.667830 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2611cb-ae23-419c-9eba-c93c41c551aa admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.667830 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2611cb-ae23-419c-9eba-c93c41c551aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.668051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2611cb-ae23-419c-9eba-c93c41c551aa admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.668625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2611cb-ae23-419c-9eba-c93c41c551aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:33.670297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2611cb-ae23-419c-9eba-c93c41c551aa admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:33.681824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1004/1997] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:33 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:33.686789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbe8a5-6dbe-47fc-b4be-9133d0789eb9 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:33.698790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbe8a5-6dbe-47fc-b4be-9133d0789eb9 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:33.703748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9392220-b1ca-4105-aca8-842fbdc95add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:33.704422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9392220-b1ca-4105-aca8-842fbdc95add admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.704712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9392220-b1ca-4105-aca8-842fbdc95add admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.705036 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9392220-b1ca-4105-aca8-842fbdc95add admin admin] PATH_INFO: `/v3/projects/01171ed3343b4f8da2f733289b08c1be/users/0f067c5dc1fb4539b0606a699e302a0f/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.714040 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2611cb-ae23-419c-9eba-c93c41c551aa admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:33.715962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3c2611cb-ae23-419c-9eba-c93c41c551aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:33.730586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2611cb-ae23-419c-9eba-c93c41c551aa admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:33.733507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9392220-b1ca-4105-aca8-842fbdc95add admin admin] RBAC: Authorizing `identity:create_grant(project_id=01171ed3343b4f8da2f733289b08c1be, user_id=0f067c5dc1fb4539b0606a699e302a0f, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:33.736589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:33.737162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9392220-b1ca-4105-aca8-842fbdc95add admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:33.737348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.737683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.738019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] PATH_INFO: `/v3/projects/a0c09fdaa0f949bd9e95e980056a45e6` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.739415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c09fdaa0f949bd9e95e980056a45e6)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:33.741401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:33.769460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 994/1998] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:33 2022] PUT /identity/v3/projects/01171ed3343b4f8da2f733289b08c1be/users/0f067c5dc1fb4539b0606a699e302a0f/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:33.781546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c3157-0a58-44a9-a875-7e4f0380e675 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.781996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c3157-0a58-44a9-a875-7e4f0380e675 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.782298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c3157-0a58-44a9-a875-7e4f0380e675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.800177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c09fdaa0f949bd9e95e980056a45e6', 'request_id': 'req-6c8b50e4-0800-4895-b047-e644b95b1374'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.802394 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:33.809880 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:33.811813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c09fdaa0f949bd9e95e980056a45e6', 'request_id': 'req-6c8b50e4-0800-4895-b047-e644b95b1374'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.814081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-440c3157-0a58-44a9-a875-7e4f0380e675 None None] MFA Rules not processed for user `0f067c5dc1fb4539b0606a699e302a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:33.816176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-440c3157-0a58-44a9-a875-7e4f0380e675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:33.819733 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c09fdaa0f949bd9e95e980056a45e6', 'request_id': 'req-6c8b50e4-0800-4895-b047-e644b95b1374'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.843871 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] The token cache is being invalidate because project a0c09fdaa0f949bd9e95e980056a45e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:33.843871 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.843871 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6c8b50e4-0800-4895-b047-e644b95b1374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:33.846864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1005/1999] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:33 2022] DELETE /identity/v3/projects/a0c09fdaa0f949bd9e95e980056a45e6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:33.854178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e6d23-fc8b-4d10-b2af-c7b2c8665a74 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:33.854482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e6d23-fc8b-4d10-b2af-c7b2c8665a74 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:33.854733 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e6d23-fc8b-4d10-b2af-c7b2c8665a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:33.886029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-8a4e6d23-fc8b-4d10-b2af-c7b2c8665a74 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:33.888312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8a4e6d23-fc8b-4d10-b2af-c7b2c8665a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:33.947413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 995/2000] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:33.960201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c3157-0a58-44a9-a875-7e4f0380e675 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:33.964177 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-440c3157-0a58-44a9-a875-7e4f0380e675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:34.012480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1006/2001] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:34.020041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79748-6294-4829-94c4-4013b05d4364 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.020354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79748-6294-4829-94c4-4013b05d4364 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.020636 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79748-6294-4829-94c4-4013b05d4364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.042344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-48d79748-6294-4829-94c4-4013b05d4364 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:34.043705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-48d79748-6294-4829-94c4-4013b05d4364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:34.054924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1007/2002] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:34.059917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d79748-6294-4829-94c4-4013b05d4364 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:34.062465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-48d79748-6294-4829-94c4-4013b05d4364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:34.086867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c3157-0a58-44a9-a875-7e4f0380e675 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:34.088103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d79748-6294-4829-94c4-4013b05d4364 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:34.092201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03422afc-fe7b-4e5f-8c20-efd67c82f2b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:34.093406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422afc-fe7b-4e5f-8c20-efd67c82f2b7 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.093406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422afc-fe7b-4e5f-8c20-efd67c82f2b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.093673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422afc-fe7b-4e5f-8c20-efd67c82f2b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.100418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc8931-604e-47ff-8df3-25d095e079df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:34.101272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc8931-604e-47ff-8df3-25d095e079df admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.101567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc8931-604e-47ff-8df3-25d095e079df admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.101822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc8931-604e-47ff-8df3-25d095e079df admin admin] PATH_INFO: `/v3/users/aa709088cee34f9fad445b32736be56d` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.103146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc8931-604e-47ff-8df3-25d095e079df admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa709088cee34f9fad445b32736be56d)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:34.105221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc8931-604e-47ff-8df3-25d095e079df admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:34.121151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03422afc-fe7b-4e5f-8c20-efd67c82f2b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:34.123099 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03422afc-fe7b-4e5f-8c20-efd67c82f2b7 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:34.136564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 996/2003] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:54:34.141735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03422afc-fe7b-4e5f-8c20-efd67c82f2b7 service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:34.163444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03422afc-fe7b-4e5f-8c20-efd67c82f2b7 service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:34.175957 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf1493-1534-47f1-a7af-0aa3f7dabfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:34.177424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf1493-1534-47f1-a7af-0aa3f7dabfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.178310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf1493-1534-47f1-a7af-0aa3f7dabfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.179459 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf1493-1534-47f1-a7af-0aa3f7dabfe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.180631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-78cc8931-604e-47ff-8df3-25d095e079df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa709088cee34f9fad445b32736be56d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:34.181183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf1493-1534-47f1-a7af-0aa3f7dabfe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:34.183271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf1493-1534-47f1-a7af-0aa3f7dabfe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:34.185190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf1493-1534-47f1-a7af-0aa3f7dabfe5 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:34.191460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-78cc8931-604e-47ff-8df3-25d095e079df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa709088cee34f9fad445b32736be56d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:34.204545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-78cc8931-604e-47ff-8df3-25d095e079df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa709088cee34f9fad445b32736be56d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:34.205654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-78cc8931-604e-47ff-8df3-25d095e079df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa709088cee34f9fad445b32736be56d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:34.206533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-78cc8931-604e-47ff-8df3-25d095e079df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa709088cee34f9fad445b32736be56d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:34.208830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 997/2004] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:54:34.214846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf1493-1534-47f1-a7af-0aa3f7dabfe5 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:34.217672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-97bf1493-1534-47f1-a7af-0aa3f7dabfe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:34.233159 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf1493-1534-47f1-a7af-0aa3f7dabfe5 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:34.234109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1008/2005] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:34 2022] DELETE /identity/v3/users/aa709088cee34f9fad445b32736be56d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:34.239463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f1ff-0326-4dcb-8333-676b539e5b36 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.239765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f1ff-0326-4dcb-8333-676b539e5b36 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.240048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f1ff-0326-4dcb-8333-676b539e5b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.293780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-5487f1ff-0326-4dcb-8333-676b539e5b36 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:34.295304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5487f1ff-0326-4dcb-8333-676b539e5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:34.307028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c74ef1-aecd-46ab-85e0-e70118fee3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:34.307705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c74ef1-aecd-46ab-85e0-e70118fee3fd admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.309996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c74ef1-aecd-46ab-85e0-e70118fee3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.310365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c74ef1-aecd-46ab-85e0-e70118fee3fd admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.311160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c74ef1-aecd-46ab-85e0-e70118fee3fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:34.313363 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c74ef1-aecd-46ab-85e0-e70118fee3fd admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:34.365420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:34.380687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 998/2006] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:34 2022] POST /identity/v3/projects => generated 382 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:34.382235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c74ef1-aecd-46ab-85e0-e70118fee3fd admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:34.410481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1009/2007] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:34.418098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:34.423487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487f1ff-0326-4dcb-8333-676b539e5b36 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:34.425225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5487f1ff-0326-4dcb-8333-676b539e5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:34.501386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487f1ff-0326-4dcb-8333-676b539e5b36 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:34.504287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c74ef1-aecd-46ab-85e0-e70118fee3fd admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:34.513021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c0eef-25d3-42f9-bfce-e329346d4f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:34.513785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c0eef-25d3-42f9-bfce-e329346d4f48 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.514155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c0eef-25d3-42f9-bfce-e329346d4f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.514404 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c0eef-25d3-42f9-bfce-e329346d4f48 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.515489 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c0eef-25d3-42f9-bfce-e329346d4f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:34.522883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c0eef-25d3-42f9-bfce-e329346d4f48 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:34.565795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 999/2008] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:34 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:34.567012 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c0eef-25d3-42f9-bfce-e329346d4f48 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:34.569222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17f55a-b365-4cc5-8e15-7612120dd6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:34.569885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f55a-b365-4cc5-8e15-7612120dd6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.570171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f55a-b365-4cc5-8e15-7612120dd6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.570449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f55a-b365-4cc5-8e15-7612120dd6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.578728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c0eef-25d3-42f9-bfce-e329346d4f48 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:34.581774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17f55a-b365-4cc5-8e15-7612120dd6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:34.583992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17f55a-b365-4cc5-8e15-7612120dd6d0 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:34.584649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57329d7f-0c2b-47f5-8f7d-2c313d5f14a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:34.585283 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57329d7f-0c2b-47f5-8f7d-2c313d5f14a7 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.585895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57329d7f-0c2b-47f5-8f7d-2c313d5f14a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.586171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57329d7f-0c2b-47f5-8f7d-2c313d5f14a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.586878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57329d7f-0c2b-47f5-8f7d-2c313d5f14a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:34.589680 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57329d7f-0c2b-47f5-8f7d-2c313d5f14a7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:34.602568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1000/2009] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:34 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:34.607176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57329d7f-0c2b-47f5-8f7d-2c313d5f14a7 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:34.607907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1010/2010] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:34.620045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57329d7f-0c2b-47f5-8f7d-2c313d5f14a7 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:34.625883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4b683-dad5-44d8-a655-c105c5368071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:34.626492 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4b683-dad5-44d8-a655-c105c5368071 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.626819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4b683-dad5-44d8-a655-c105c5368071 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.627232 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4b683-dad5-44d8-a655-c105c5368071 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.627948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4b683-dad5-44d8-a655-c105c5368071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:34.630190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4b683-dad5-44d8-a655-c105c5368071 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:34.643134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1001/2011] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:34 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:34.645954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17f55a-b365-4cc5-8e15-7612120dd6d0 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:34.658454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17f55a-b365-4cc5-8e15-7612120dd6d0 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:34.665541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2562c4-7930-4204-8fdc-54d5154b916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:34.666246 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2562c4-7930-4204-8fdc-54d5154b916a admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.666651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2562c4-7930-4204-8fdc-54d5154b916a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.667081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2562c4-7930-4204-8fdc-54d5154b916a admin admin] PATH_INFO: `/v3/projects/445ab9a7d718427f97c86a3a5491cb00/users/e72db73a2364434a934b1188b8db5fb8/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.687041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2562c4-7930-4204-8fdc-54d5154b916a admin admin] RBAC: Authorizing `identity:create_grant(project_id=445ab9a7d718427f97c86a3a5491cb00, user_id=e72db73a2364434a934b1188b8db5fb8, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:34.689677 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2562c4-7930-4204-8fdc-54d5154b916a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:34.704206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1011/2012] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:34 2022] PUT /identity/v3/projects/445ab9a7d718427f97c86a3a5491cb00/users/e72db73a2364434a934b1188b8db5fb8/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:34.720248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f955-a8d2-48ae-b48e-ecc4c099148e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.720580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f955-a8d2-48ae-b48e-ecc4c099148e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.720858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f955-a8d2-48ae-b48e-ecc4c099148e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.751137 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-3f40f955-a8d2-48ae-b48e-ecc4c099148e None None] MFA Rules not processed for user `e72db73a2364434a934b1188b8db5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:34.752387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3f40f955-a8d2-48ae-b48e-ecc4c099148e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:34.826348 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1002/2013] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:34.831357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2562c4-7930-4204-8fdc-54d5154b916a admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:34.903718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2562c4-7930-4204-8fdc-54d5154b916a admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:34.904796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40f955-a8d2-48ae-b48e-ecc4c099148e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:34.906864 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3f40f955-a8d2-48ae-b48e-ecc4c099148e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:34.915048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e350c7-d6a1-499d-b25f-bd2f63dfeffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:34.916055 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e350c7-d6a1-499d-b25f-bd2f63dfeffc admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.916722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e350c7-d6a1-499d-b25f-bd2f63dfeffc admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.917041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e350c7-d6a1-499d-b25f-bd2f63dfeffc admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.918698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e350c7-d6a1-499d-b25f-bd2f63dfeffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:34.921099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e350c7-d6a1-499d-b25f-bd2f63dfeffc admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:34.930667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40f955-a8d2-48ae-b48e-ecc4c099148e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:34.937056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:34.938003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:34.938277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:34.938628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] PATH_INFO: `/v3/projects/4c12ba70cde84a4eb69cbf718660942a` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:34.941370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c12ba70cde84a4eb69cbf718660942a)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:34.946128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:34.963305 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1012/2014] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:34 2022] POST /identity/v3/projects => generated 384 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:34.968646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e350c7-d6a1-499d-b25f-bd2f63dfeffc admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:34.977046 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:35.024311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c12ba70cde84a4eb69cbf718660942a', 'request_id': 'req-04b6e858-ee46-4709-bce3-9c1803cf05e5'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.030804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c12ba70cde84a4eb69cbf718660942a', 'request_id': 'req-04b6e858-ee46-4709-bce3-9c1803cf05e5'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.036905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c12ba70cde84a4eb69cbf718660942a', 'request_id': 'req-04b6e858-ee46-4709-bce3-9c1803cf05e5'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.043134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e350c7-d6a1-499d-b25f-bd2f63dfeffc admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:35.046904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:35.051942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] The token cache is being invalidate because project 4c12ba70cde84a4eb69cbf718660942a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:35.052354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.053449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.055269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1003/2015] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:34 2022] DELETE /identity/v3/projects/4c12ba70cde84a4eb69cbf718660942a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:35.060454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:35.062093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:35.122380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37988ecd-ce2d-43df-8c8f-a63e634deb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:35.122622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37988ecd-ce2d-43df-8c8f-a63e634deb46 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:35.122907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37988ecd-ce2d-43df-8c8f-a63e634deb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:35.123316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37988ecd-ce2d-43df-8c8f-a63e634deb46 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:35.123996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37988ecd-ce2d-43df-8c8f-a63e634deb46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:35.126234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37988ecd-ce2d-43df-8c8f-a63e634deb46 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:35.142668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e858-ee46-4709-bce3-9c1803cf05e5 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:35.150336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:35.150336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:35.150336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:35.150336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] PATH_INFO: `/v3/users/c2d168b8bb404b659ffb6d3bfb993049` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:35.151954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d168b8bb404b659ffb6d3bfb993049)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:35.154093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:35.160462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1013/2016] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:34 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:35.163366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37988ecd-ce2d-43df-8c8f-a63e634deb46 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:35.165268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-37988ecd-ce2d-43df-8c8f-a63e634deb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:35.183925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37988ecd-ce2d-43df-8c8f-a63e634deb46 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:35.192171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a4c2e-4a57-42bb-95e4-83bdc165b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:35.193347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4c2e-4a57-42bb-95e4-83bdc165b081 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:35.193877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4c2e-4a57-42bb-95e4-83bdc165b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:35.194413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4c2e-4a57-42bb-95e4-83bdc165b081 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:35.195334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a4c2e-4a57-42bb-95e4-83bdc165b081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:35.197358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a4c2e-4a57-42bb-95e4-83bdc165b081 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:35.212808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1014/2017] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:35 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:35.221599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a4c2e-4a57-42bb-95e4-83bdc165b081 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:35.238457 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d168b8bb404b659ffb6d3bfb993049'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.239585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d168b8bb404b659ffb6d3bfb993049'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.240725 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a4c2e-4a57-42bb-95e4-83bdc165b081 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:35.245920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaeb37-f541-40ef-a364-10474ca74821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:35.246620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaeb37-f541-40ef-a364-10474ca74821 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:35.246904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaeb37-f541-40ef-a364-10474ca74821 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:35.247228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaeb37-f541-40ef-a364-10474ca74821 admin admin] PATH_INFO: `/v3/projects/e268621e4b8b4215a6757d06e5845dba/users/6b24048c452d4e9ba3dce676a6846a92/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:35.258084 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d168b8bb404b659ffb6d3bfb993049'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.260049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d168b8bb404b659ffb6d3bfb993049'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.266648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeaeb37-f541-40ef-a364-10474ca74821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e268621e4b8b4215a6757d06e5845dba, user_id=6b24048c452d4e9ba3dce676a6846a92, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:35.270096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeaeb37-f541-40ef-a364-10474ca74821 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:35.271636 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d168b8bb404b659ffb6d3bfb993049'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.288012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1015/2018] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:35 2022] PUT /identity/v3/projects/e268621e4b8b4215a6757d06e5845dba/users/6b24048c452d4e9ba3dce676a6846a92/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:35.292383 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaeb37-f541-40ef-a364-10474ca74821 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:35.294221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3aeaeb37-f541-40ef-a364-10474ca74821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:35.297573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1004/2019] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:35 2022] DELETE /identity/v3/users/c2d168b8bb404b659ffb6d3bfb993049 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:35.394615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaeb37-f541-40ef-a364-10474ca74821 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:35.411219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:35.482179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b516-03ac-49ac-a3f6-1be7c111f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:35.483152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b516-03ac-49ac-a3f6-1be7c111f2db admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:35.483474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b516-03ac-49ac-a3f6-1be7c111f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:35.483865 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b516-03ac-49ac-a3f6-1be7c111f2db admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:35.484728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8b516-03ac-49ac-a3f6-1be7c111f2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:35.486845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8b516-03ac-49ac-a3f6-1be7c111f2db admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:35.510005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1016/2020] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:35 2022] GET /identity/v3/roles => generated 1427 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:35.513647 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:35.525255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6e478-2545-4f35-ad86-034d6428d78d admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:35.531133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd3642-8147-41cd-8362-7e4993b12ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:35.531903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3642-8147-41cd-8362-7e4993b12ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:35.532347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3642-8147-41cd-8362-7e4993b12ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:35.532640 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3642-8147-41cd-8362-7e4993b12ffe admin admin] PATH_INFO: `/v3/projects/e268621e4b8b4215a6757d06e5845dba/users/6b24048c452d4e9ba3dce676a6846a92/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:35.536280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd3642-8147-41cd-8362-7e4993b12ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e268621e4b8b4215a6757d06e5845dba, user_id=6b24048c452d4e9ba3dce676a6846a92, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:35.539685 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd3642-8147-41cd-8362-7e4993b12ffe admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:35.565031 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1005/2021] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:35 2022] PUT /identity/v3/projects/e268621e4b8b4215a6757d06e5845dba/users/6b24048c452d4e9ba3dce676a6846a92/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:35.566798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20731d-b7f4-4d5e-9eb8-c67c8ddc7a3c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:35.567259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20731d-b7f4-4d5e-9eb8-c67c8ddc7a3c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:35.567606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20731d-b7f4-4d5e-9eb8-c67c8ddc7a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:35.606029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-1e20731d-b7f4-4d5e-9eb8-c67c8ddc7a3c None None] MFA Rules not processed for user `6b24048c452d4e9ba3dce676a6846a92`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:35.607342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1e20731d-b7f4-4d5e-9eb8-c67c8ddc7a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:35.771811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1017/2022] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:35.772391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd3642-8147-41cd-8362-7e4993b12ffe admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:35.776148 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20731d-b7f4-4d5e-9eb8-c67c8ddc7a3c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:35.776426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-dafd3642-8147-41cd-8362-7e4993b12ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:35.776527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1e20731d-b7f4-4d5e-9eb8-c67c8ddc7a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:35.848972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd3642-8147-41cd-8362-7e4993b12ffe admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:35.852598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c0de1-ceb7-4022-83c2-1a6b8e7dbe81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:35.853378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c0de1-ceb7-4022-83c2-1a6b8e7dbe81 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:35.853686 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c0de1-ceb7-4022-83c2-1a6b8e7dbe81 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:35.853957 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c0de1-ceb7-4022-83c2-1a6b8e7dbe81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:35.858373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20731d-b7f4-4d5e-9eb8-c67c8ddc7a3c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:35.863702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:35.865242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:35.865588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:35.865927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] PATH_INFO: `/v3/projects/14ab26de6a0a437b8b7386a42e2ab2f0` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:35.867337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ab26de6a0a437b8b7386a42e2ab2f0)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:35.868314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c0de1-ceb7-4022-83c2-1a6b8e7dbe81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:35.869479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:35.870504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c0de1-ceb7-4022-83c2-1a6b8e7dbe81 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:35.884473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1006/2023] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:35.886430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef67f33-2da2-4b92-9c98-9fa0d32e4bf4 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:35.887155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef67f33-2da2-4b92-9c98-9fa0d32e4bf4 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:35.887540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef67f33-2da2-4b92-9c98-9fa0d32e4bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:35.904785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:35.924296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-cef67f33-2da2-4b92-9c98-9fa0d32e4bf4 None None] MFA Rules not processed for user `0f067c5dc1fb4539b0606a699e302a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:35.927445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cef67f33-2da2-4b92-9c98-9fa0d32e4bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:35.949633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:35.956496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ab26de6a0a437b8b7386a42e2ab2f0', 'request_id': 'req-b88eba68-52c1-4c84-9371-69855251b1de'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.967492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ab26de6a0a437b8b7386a42e2ab2f0', 'request_id': 'req-b88eba68-52c1-4c84-9371-69855251b1de'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.975505 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ab26de6a0a437b8b7386a42e2ab2f0', 'request_id': 'req-b88eba68-52c1-4c84-9371-69855251b1de'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:35.999256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] The token cache is being invalidate because project 14ab26de6a0a437b8b7386a42e2ab2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:35.999569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:36.001267 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b88eba68-52c1-4c84-9371-69855251b1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:36.007955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1018/2024] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:35 2022] DELETE /identity/v3/projects/14ab26de6a0a437b8b7386a42e2ab2f0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:36.012497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8e3c4-f0b5-4aa3-bcfa-9b7dbd432cf7 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:36.012947 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8e3c4-f0b5-4aa3-bcfa-9b7dbd432cf7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:36.013529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8e3c4-f0b5-4aa3-bcfa-9b7dbd432cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:36.035378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-27e8e3c4-f0b5-4aa3-bcfa-9b7dbd432cf7 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:36.042466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1007/2025] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:36.042466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef67f33-2da2-4b92-9c98-9fa0d32e4bf4 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:36.042466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cef67f33-2da2-4b92-9c98-9fa0d32e4bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:36.043497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-27e8e3c4-f0b5-4aa3-bcfa-9b7dbd432cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:36.112340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef67f33-2da2-4b92-9c98-9fa0d32e4bf4 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:36.121685 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33098172-2cf8-4dba-957f-2ef162d93eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:36.122728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098172-2cf8-4dba-957f-2ef162d93eca service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:36.122728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098172-2cf8-4dba-957f-2ef162d93eca service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:36.122986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098172-2cf8-4dba-957f-2ef162d93eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:36.124888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-33098172-2cf8-4dba-957f-2ef162d93eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:36.151826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1019/2026] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:36.161207 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01cafe-5850-4f1f-859b-6fda2a160c6c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:36.161699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01cafe-5850-4f1f-859b-6fda2a160c6c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:36.162077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01cafe-5850-4f1f-859b-6fda2a160c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:36.195970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-1e01cafe-5850-4f1f-859b-6fda2a160c6c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:36.197647 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1e01cafe-5850-4f1f-859b-6fda2a160c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:36.208481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1020/2027] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:36.213754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01cafe-5850-4f1f-859b-6fda2a160c6c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:36.224950 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01cafe-5850-4f1f-859b-6fda2a160c6c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:36.225347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33098172-2cf8-4dba-957f-2ef162d93eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:36.227135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33098172-2cf8-4dba-957f-2ef162d93eca service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:36.230332 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac6bb-fac9-4268-b501-77ff73488e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:36.231142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac6bb-fac9-4268-b501-77ff73488e2c admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:36.231445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac6bb-fac9-4268-b501-77ff73488e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:36.231715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac6bb-fac9-4268-b501-77ff73488e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:36.232437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ac6bb-fac9-4268-b501-77ff73488e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:36.232798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ac6bb-fac9-4268-b501-77ff73488e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:36.234501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ac6bb-fac9-4268-b501-77ff73488e2c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:36.238494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1008/2028] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:36.251250 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1021/2029] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:54:36.253086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33098172-2cf8-4dba-957f-2ef162d93eca service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:36.264783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33098172-2cf8-4dba-957f-2ef162d93eca service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:36.270034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87abfe9-54cf-4f54-a3a5-84de3b3cf89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:36.270729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87abfe9-54cf-4f54-a3a5-84de3b3cf89e admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:36.271105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87abfe9-54cf-4f54-a3a5-84de3b3cf89e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:36.271429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87abfe9-54cf-4f54-a3a5-84de3b3cf89e admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:36.272247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87abfe9-54cf-4f54-a3a5-84de3b3cf89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:36.274212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87abfe9-54cf-4f54-a3a5-84de3b3cf89e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:36.310530 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1009/2030] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:36 2022] POST /identity/v3/projects => generated 384 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:36.311813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac6bb-fac9-4268-b501-77ff73488e2c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:36.323368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac6bb-fac9-4268-b501-77ff73488e2c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:36.401297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab188a4e-a169-45b8-b335-fc06ac154fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:36.402646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab188a4e-a169-45b8-b335-fc06ac154fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:36.403199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab188a4e-a169-45b8-b335-fc06ac154fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:36.403734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab188a4e-a169-45b8-b335-fc06ac154fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:36.404602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab188a4e-a169-45b8-b335-fc06ac154fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:36.407154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab188a4e-a169-45b8-b335-fc06ac154fd3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:36.438806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1022/2031] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:36 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:36.440725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87abfe9-54cf-4f54-a3a5-84de3b3cf89e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:36.454660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87abfe9-54cf-4f54-a3a5-84de3b3cf89e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:36.460945 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803aa01-4449-4673-87f4-52647268b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:36.461892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803aa01-4449-4673-87f4-52647268b7bb admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:36.462393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803aa01-4449-4673-87f4-52647268b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:36.462841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803aa01-4449-4673-87f4-52647268b7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:36.463906 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803aa01-4449-4673-87f4-52647268b7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:36.466315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803aa01-4449-4673-87f4-52647268b7bb admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:36.483622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1010/2032] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:36 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:36.488115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab188a4e-a169-45b8-b335-fc06ac154fd3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:36.504217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab188a4e-a169-45b8-b335-fc06ac154fd3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:36.522611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85c8b9-bf02-4fdc-9cc2-b47f7d788855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:36.523306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85c8b9-bf02-4fdc-9cc2-b47f7d788855 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:36.523581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85c8b9-bf02-4fdc-9cc2-b47f7d788855 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:36.523855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85c8b9-bf02-4fdc-9cc2-b47f7d788855 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:36.524675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85c8b9-bf02-4fdc-9cc2-b47f7d788855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:36.533367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85c8b9-bf02-4fdc-9cc2-b47f7d788855 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:36.566394 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1023/2033] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:36 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:36.568055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803aa01-4449-4673-87f4-52647268b7bb admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:36.591592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803aa01-4449-4673-87f4-52647268b7bb admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:36.611707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafebf92-8309-4063-83be-76b930d25181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:36.612408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafebf92-8309-4063-83be-76b930d25181 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:36.612687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafebf92-8309-4063-83be-76b930d25181 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:36.612962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafebf92-8309-4063-83be-76b930d25181 admin admin] PATH_INFO: `/v3/projects/b98d82968b7541f586fc3ddfb7038b88/users/1921dc8a7f454d19bb678c50285eaf0e/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:36.635344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafebf92-8309-4063-83be-76b930d25181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98d82968b7541f586fc3ddfb7038b88, user_id=1921dc8a7f454d19bb678c50285eaf0e, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:36.638480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafebf92-8309-4063-83be-76b930d25181 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:36.665162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1011/2034] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:36 2022] PUT /identity/v3/projects/b98d82968b7541f586fc3ddfb7038b88/users/1921dc8a7f454d19bb678c50285eaf0e/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:36.680574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562f44d-32f3-4380-a10d-dce728f5ddda None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:36.680892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562f44d-32f3-4380-a10d-dce728f5ddda None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:36.681310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562f44d-32f3-4380-a10d-dce728f5ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:36.726330 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-2562f44d-32f3-4380-a10d-dce728f5ddda None None] MFA Rules not processed for user `1921dc8a7f454d19bb678c50285eaf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:36.729837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2562f44d-32f3-4380-a10d-dce728f5ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:36.750921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:36.856915 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1024/2035] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:36.862406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafebf92-8309-4063-83be-76b930d25181 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:36.891806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:37.062248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafebf92-8309-4063-83be-76b930d25181 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:37.071437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73806ecd-c5d9-4c2d-924f-3eed429dd0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:37.072611 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806ecd-c5d9-4c2d-924f-3eed429dd0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:37.073145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806ecd-c5d9-4c2d-924f-3eed429dd0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:37.073723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806ecd-c5d9-4c2d-924f-3eed429dd0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:37.074665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73806ecd-c5d9-4c2d-924f-3eed429dd0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:37.077406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73806ecd-c5d9-4c2d-924f-3eed429dd0c1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:37.191168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1012/2036] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:36 2022] POST /identity/v3/projects => generated 386 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:37.191485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562f44d-32f3-4380-a10d-dce728f5ddda None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:37.207425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562f44d-32f3-4380-a10d-dce728f5ddda None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:37.325735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a954fcc-275f-4986-aa77-63e89aaed8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:37.326400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954fcc-275f-4986-aa77-63e89aaed8eb admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:37.326680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954fcc-275f-4986-aa77-63e89aaed8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:37.326980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954fcc-275f-4986-aa77-63e89aaed8eb admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:37.327658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a954fcc-275f-4986-aa77-63e89aaed8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:37.329758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a954fcc-275f-4986-aa77-63e89aaed8eb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:37.373887 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1025/2037] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:37 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:37.378910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73806ecd-c5d9-4c2d-924f-3eed429dd0c1 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:37.396144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73806ecd-c5d9-4c2d-924f-3eed429dd0c1 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:37.407356 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed54c8-1216-44c9-8708-7bcdf154b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:37.408078 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed54c8-1216-44c9-8708-7bcdf154b1db admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:37.410383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed54c8-1216-44c9-8708-7bcdf154b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:37.410833 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed54c8-1216-44c9-8708-7bcdf154b1db admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:37.411748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed54c8-1216-44c9-8708-7bcdf154b1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:37.413415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed54c8-1216-44c9-8708-7bcdf154b1db admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:37.432961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1013/2038] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:37 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:37.437728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a954fcc-275f-4986-aa77-63e89aaed8eb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:37.450895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a954fcc-275f-4986-aa77-63e89aaed8eb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:37.457987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165610-6bd6-4c2d-9ab4-af17244f1b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:37.458790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165610-6bd6-4c2d-9ab4-af17244f1b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:37.459108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165610-6bd6-4c2d-9ab4-af17244f1b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:37.459620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165610-6bd6-4c2d-9ab4-af17244f1b0a admin admin] PATH_INFO: `/v3/projects/ae41a3d7d18847e2aae34c16324919f4/users/d212d61bdc5d478db7de527cff4d9719/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:37.482682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165610-6bd6-4c2d-9ab4-af17244f1b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae41a3d7d18847e2aae34c16324919f4, user_id=d212d61bdc5d478db7de527cff4d9719, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:37.485953 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165610-6bd6-4c2d-9ab4-af17244f1b0a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:37.510538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1026/2039] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:37 2022] PUT /identity/v3/projects/ae41a3d7d18847e2aae34c16324919f4/users/d212d61bdc5d478db7de527cff4d9719/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:37.512155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed54c8-1216-44c9-8708-7bcdf154b1db admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:37.525884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed54c8-1216-44c9-8708-7bcdf154b1db admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:37.638237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3dd6b2-8343-47e7-9931-bfceb42ecaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:37.639230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dd6b2-8343-47e7-9931-bfceb42ecaef admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:37.639687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dd6b2-8343-47e7-9931-bfceb42ecaef admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:37.640138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dd6b2-8343-47e7-9931-bfceb42ecaef admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:37.640889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3dd6b2-8343-47e7-9931-bfceb42ecaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:37.642551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3dd6b2-8343-47e7-9931-bfceb42ecaef admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:37.656944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1014/2040] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:37 2022] GET /identity/v3/roles => generated 1427 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:37.662666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165610-6bd6-4c2d-9ab4-af17244f1b0a admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:37.682219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165610-6bd6-4c2d-9ab4-af17244f1b0a admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:37.690239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8f507-1ae3-4403-848d-051450436acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:37.691256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f507-1ae3-4403-848d-051450436acb admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:37.691584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f507-1ae3-4403-848d-051450436acb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:37.691863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f507-1ae3-4403-848d-051450436acb admin admin] PATH_INFO: `/v3/projects/ae41a3d7d18847e2aae34c16324919f4/users/d212d61bdc5d478db7de527cff4d9719/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:37.695228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8f507-1ae3-4403-848d-051450436acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae41a3d7d18847e2aae34c16324919f4, user_id=d212d61bdc5d478db7de527cff4d9719, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:37.698128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8f507-1ae3-4403-848d-051450436acb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:37.711220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1027/2041] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:37 2022] PUT /identity/v3/projects/ae41a3d7d18847e2aae34c16324919f4/users/d212d61bdc5d478db7de527cff4d9719/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:37.722468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9e924-a73c-422a-b226-000cdc9c056d None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:37.722875 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9e924-a73c-422a-b226-000cdc9c056d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:37.723937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9e924-a73c-422a-b226-000cdc9c056d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:37.767571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-52b9e924-a73c-422a-b226-000cdc9c056d None None] MFA Rules not processed for user `d212d61bdc5d478db7de527cff4d9719`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:37.768814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-52b9e924-a73c-422a-b226-000cdc9c056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:37.850025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1015/2042] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:37.858485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8f507-1ae3-4403-848d-051450436acb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:37.860958 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-03b8f507-1ae3-4403-848d-051450436acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:37.984958 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8f507-1ae3-4403-848d-051450436acb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:37.993661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88e83f-5d0e-4ef9-94d8-f8a833b78106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:37.995170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88e83f-5d0e-4ef9-94d8-f8a833b78106 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:37.996094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88e83f-5d0e-4ef9-94d8-f8a833b78106 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:37.996749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88e83f-5d0e-4ef9-94d8-f8a833b78106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:38.063661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:38.156700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88e83f-5d0e-4ef9-94d8-f8a833b78106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:38.159025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88e83f-5d0e-4ef9-94d8-f8a833b78106 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:38.195443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1028/2043] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:39.176438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9e924-a73c-422a-b226-000cdc9c056d None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:39.178090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-52b9e924-a73c-422a-b226-000cdc9c056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:39.185249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:39.281652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9e924-a73c-422a-b226-000cdc9c056d None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:39.287083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:39.287785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:39.288125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:39.288465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] PATH_INFO: `/v3/users/e72db73a2364434a934b1188b8db5fb8` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:39.289896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72db73a2364434a934b1188b8db5fb8)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:39.291982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:39.352325 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72db73a2364434a934b1188b8db5fb8'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:39.353092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72db73a2364434a934b1188b8db5fb8'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:39.365451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72db73a2364434a934b1188b8db5fb8'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:39.366167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72db73a2364434a934b1188b8db5fb8'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:39.373118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72db73a2364434a934b1188b8db5fb8'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:39.388537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1016/2044] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:39 2022] DELETE /identity/v3/users/e72db73a2364434a934b1188b8db5fb8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:39.393203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb7bfd-32e9-4259-9c4b-99e01e646028 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:39.393697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb7bfd-32e9-4259-9c4b-99e01e646028 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:39.393776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb7bfd-32e9-4259-9c4b-99e01e646028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:39.413343 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-3cdb7bfd-32e9-4259-9c4b-99e01e646028 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:39.414581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3cdb7bfd-32e9-4259-9c4b-99e01e646028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:39.488154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1029/2045] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:39.501298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:39.503089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:39.586164 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459df90-b99c-43c6-8b61-53904af859be admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:39.592856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda12a2f-8853-4583-b75f-3fce0ce5cca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:39.593534 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda12a2f-8853-4583-b75f-3fce0ce5cca6 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:39.593842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda12a2f-8853-4583-b75f-3fce0ce5cca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:39.594121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda12a2f-8853-4583-b75f-3fce0ce5cca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:39.606455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda12a2f-8853-4583-b75f-3fce0ce5cca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:39.608355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda12a2f-8853-4583-b75f-3fce0ce5cca6 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:39.618821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1017/2046] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:39.885290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb7bfd-32e9-4259-9c4b-99e01e646028 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:39.888162 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3cdb7bfd-32e9-4259-9c4b-99e01e646028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:39.916792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb7bfd-32e9-4259-9c4b-99e01e646028 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:39.923868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5cd4e-9472-44d9-81ac-48814c895aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:39.925209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5cd4e-9472-44d9-81ac-48814c895aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:39.925710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5cd4e-9472-44d9-81ac-48814c895aab admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:39.926183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5cd4e-9472-44d9-81ac-48814c895aab admin admin] PATH_INFO: `/v3/users/60b9b092d4b94440951e09c3bfef180b` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:39.927658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5cd4e-9472-44d9-81ac-48814c895aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b9b092d4b94440951e09c3bfef180b)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:39.930652 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5cd4e-9472-44d9-81ac-48814c895aab admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:40.018525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-21f5cd4e-9472-44d9-81ac-48814c895aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b9b092d4b94440951e09c3bfef180b'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.031599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-21f5cd4e-9472-44d9-81ac-48814c895aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b9b092d4b94440951e09c3bfef180b'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.053549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-21f5cd4e-9472-44d9-81ac-48814c895aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b9b092d4b94440951e09c3bfef180b'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.054663 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-21f5cd4e-9472-44d9-81ac-48814c895aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b9b092d4b94440951e09c3bfef180b'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.055425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-21f5cd4e-9472-44d9-81ac-48814c895aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b9b092d4b94440951e09c3bfef180b'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.083069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda12a2f-8853-4583-b75f-3fce0ce5cca6 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:40.084621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fda12a2f-8853-4583-b75f-3fce0ce5cca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:40.099177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1030/2047] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:39 2022] DELETE /identity/v3/users/60b9b092d4b94440951e09c3bfef180b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:40.104648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f354a-cead-4dad-983f-69292d1bab43 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:40.104944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f354a-cead-4dad-983f-69292d1bab43 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:40.105166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f354a-cead-4dad-983f-69292d1bab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:40.107650 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda12a2f-8853-4583-b75f-3fce0ce5cca6 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:40.132938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-e99f354a-cead-4dad-983f-69292d1bab43 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:40.135193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e99f354a-cead-4dad-983f-69292d1bab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:40.155131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:40.189483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:40.212993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:40.215551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:40.216377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:40.217431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] PATH_INFO: `/v3/projects/445ab9a7d718427f97c86a3a5491cb00` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:40.219454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=445ab9a7d718427f97c86a3a5491cb00)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:40.222725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:40.247261 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1031/2048] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:40.256487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f354a-cead-4dad-983f-69292d1bab43 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:40.258432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e99f354a-cead-4dad-983f-69292d1bab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:40.317770 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445ab9a7d718427f97c86a3a5491cb00', 'request_id': 'req-47e808e2-55f3-42f9-a15e-cd87de1e0eab'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.327775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445ab9a7d718427f97c86a3a5491cb00', 'request_id': 'req-47e808e2-55f3-42f9-a15e-cd87de1e0eab'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.330336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f354a-cead-4dad-983f-69292d1bab43 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:40.343075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445ab9a7d718427f97c86a3a5491cb00', 'request_id': 'req-47e808e2-55f3-42f9-a15e-cd87de1e0eab'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.362532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] The token cache is being invalidate because project 445ab9a7d718427f97c86a3a5491cb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:40.363364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.364184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.370538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1018/2049] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:40 2022] DELETE /identity/v3/projects/445ab9a7d718427f97c86a3a5491cb00 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:40.371672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:40.373194 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:40.427671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70626538-676d-4d6c-886e-73436f21cd0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:40.428443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70626538-676d-4d6c-886e-73436f21cd0a service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:40.428585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70626538-676d-4d6c-886e-73436f21cd0a service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:40.428862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70626538-676d-4d6c-886e-73436f21cd0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:40.434704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-70626538-676d-4d6c-886e-73436f21cd0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:40.531632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e808e2-55f3-42f9-a15e-cd87de1e0eab admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:40.537441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:40.538222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:40.538502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:40.538710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] PATH_INFO: `/v3/users/6b24048c452d4e9ba3dce676a6846a92` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:40.540717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b24048c452d4e9ba3dce676a6846a92)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:40.542105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70626538-676d-4d6c-886e-73436f21cd0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:40.543355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:40.543594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70626538-676d-4d6c-886e-73436f21cd0a service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:40.555756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1032/2050] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:40.609334 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b24048c452d4e9ba3dce676a6846a92'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.610137 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b24048c452d4e9ba3dce676a6846a92'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.621584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:40.630025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b24048c452d4e9ba3dce676a6846a92'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.631280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b24048c452d4e9ba3dce676a6846a92'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.642523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b24048c452d4e9ba3dce676a6846a92'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:40.659334 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1019/2051] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:40 2022] DELETE /identity/v3/users/6b24048c452d4e9ba3dce676a6846a92 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:40.947447 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70626538-676d-4d6c-886e-73436f21cd0a service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:40.948910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-70626538-676d-4d6c-886e-73436f21cd0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:40.963066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70626538-676d-4d6c-886e-73436f21cd0a service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:41.037353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:41.060467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:41.061534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.061534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.061751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] PATH_INFO: `/v3/projects/50b5a5819e254d429d43786bb20fd904` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.062869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b5a5819e254d429d43786bb20fd904)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:41.064868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:41.117073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:41.121118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:41.130786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b5a5819e254d429d43786bb20fd904', 'request_id': 'req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:41.141166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257936f2-158e-48c7-8b60-bc37c26241e9 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:41.142980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b5a5819e254d429d43786bb20fd904', 'request_id': 'req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:41.153411 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b5a5819e254d429d43786bb20fd904', 'request_id': 'req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:41.166522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] The token cache is being invalidate because project 50b5a5819e254d429d43786bb20fd904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:41.166819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:41.167523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a9d2ca37-a8e3-4649-b5e6-a975d6a05ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:41.169364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1033/2052] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:40 2022] DELETE /identity/v3/projects/50b5a5819e254d429d43786bb20fd904 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:41.174510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12757e7-32ee-4115-8b3d-a38b84f4544c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.174872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12757e7-32ee-4115-8b3d-a38b84f4544c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.175259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12757e7-32ee-4115-8b3d-a38b84f4544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.195892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a12757e7-32ee-4115-8b3d-a38b84f4544c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:41.197581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a12757e7-32ee-4115-8b3d-a38b84f4544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:41.226270 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:41.227117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.227770 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.228204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] PATH_INFO: `/v3/projects/e268621e4b8b4215a6757d06e5845dba` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.229591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e268621e4b8b4215a6757d06e5845dba)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:41.231726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:41.303469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1034/2053] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:41.311784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2cff0-398b-4e3e-b126-17c8a4c2f039 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.312227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2cff0-398b-4e3e-b126-17c8a4c2f039 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.312606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2cff0-398b-4e3e-b126-17c8a4c2f039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.321581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e268621e4b8b4215a6757d06e5845dba', 'request_id': 'req-0c3fcb8a-ff4e-404b-8566-89256352df09'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:41.331146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e268621e4b8b4215a6757d06e5845dba', 'request_id': 'req-0c3fcb8a-ff4e-404b-8566-89256352df09'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:41.342068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e268621e4b8b4215a6757d06e5845dba', 'request_id': 'req-0c3fcb8a-ff4e-404b-8566-89256352df09'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:41.349641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-e1a2cff0-398b-4e3e-b126-17c8a4c2f039 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:41.351271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e1a2cff0-398b-4e3e-b126-17c8a4c2f039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:41.367047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] The token cache is being invalidate because project e268621e4b8b4215a6757d06e5845dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:41.367346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:41.369299 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0c3fcb8a-ff4e-404b-8566-89256352df09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:41.374265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1020/2054] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:41 2022] DELETE /identity/v3/projects/e268621e4b8b4215a6757d06e5845dba => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:41.379570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b488900-608e-4057-bfa2-5671ba50fc10 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.379570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b488900-608e-4057-bfa2-5671ba50fc10 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.380050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b488900-608e-4057-bfa2-5671ba50fc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.408857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-4b488900-608e-4057-bfa2-5671ba50fc10 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:41.410765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4b488900-608e-4057-bfa2-5671ba50fc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:41.469308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1035/2055] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:41.474445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2cff0-398b-4e3e-b126-17c8a4c2f039 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:41.486782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2cff0-398b-4e3e-b126-17c8a4c2f039 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:41.492485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd2d4-a2e6-4ed7-991b-c36681773c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:41.493191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd2d4-a2e6-4ed7-991b-c36681773c7f admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.493404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd2d4-a2e6-4ed7-991b-c36681773c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.494074 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd2d4-a2e6-4ed7-991b-c36681773c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.495199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cd2d4-a2e6-4ed7-991b-c36681773c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:41.495612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cd2d4-a2e6-4ed7-991b-c36681773c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:41.497380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cd2d4-a2e6-4ed7-991b-c36681773c7f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:41.507328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:41.514972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1036/2056] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:54:41.520292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd2d4-a2e6-4ed7-991b-c36681773c7f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:41.520939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1021/2057] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:41.529707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8ac87-8f97-48d7-a48c-68b12d043598 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.530219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8ac87-8f97-48d7-a48c-68b12d043598 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.530358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8ac87-8f97-48d7-a48c-68b12d043598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.538537 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd2d4-a2e6-4ed7-991b-c36681773c7f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:41.549962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2ab28-5bbd-4206-afe9-ec765d0e68bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:41.549962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2ab28-5bbd-4206-afe9-ec765d0e68bb admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.549962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2ab28-5bbd-4206-afe9-ec765d0e68bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.549962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2ab28-5bbd-4206-afe9-ec765d0e68bb admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.550451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2ab28-5bbd-4206-afe9-ec765d0e68bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:41.550451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2ab28-5bbd-4206-afe9-ec765d0e68bb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:41.572423 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:41.581699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-17a8ac87-8f97-48d7-a48c-68b12d043598 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:41.582942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-17a8ac87-8f97-48d7-a48c-68b12d043598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:41.596774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1037/2058] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:41 2022] POST /identity/v3/projects => generated 376 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:41.602439 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2ab28-5bbd-4206-afe9-ec765d0e68bb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:41.608975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1022/2059] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:41.615105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8ac87-8f97-48d7-a48c-68b12d043598 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:41.629506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8ac87-8f97-48d7-a48c-68b12d043598 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:41.693759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2ab28-5bbd-4206-afe9-ec765d0e68bb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:41.698877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7f4c4-e1c2-4ea8-b525-d4c4e95e8ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:41.699905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f4c4-e1c2-4ea8-b525-d4c4e95e8ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.700193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f4c4-e1c2-4ea8-b525-d4c4e95e8ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.700476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f4c4-e1c2-4ea8-b525-d4c4e95e8ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.701156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7f4c4-e1c2-4ea8-b525-d4c4e95e8ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:41.703456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7f4c4-e1c2-4ea8-b525-d4c4e95e8ac0 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:41.707893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750bdd-37c3-4077-b96c-2b7b6b57fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:41.708543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750bdd-37c3-4077-b96c-2b7b6b57fa20 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.708825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750bdd-37c3-4077-b96c-2b7b6b57fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.709104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750bdd-37c3-4077-b96c-2b7b6b57fa20 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.709821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750bdd-37c3-4077-b96c-2b7b6b57fa20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:41.710131 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750bdd-37c3-4077-b96c-2b7b6b57fa20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:41.712146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750bdd-37c3-4077-b96c-2b7b6b57fa20 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:41.727951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1023/2060] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:54:41.729086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1038/2061] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:41 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:41.733403 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750bdd-37c3-4077-b96c-2b7b6b57fa20 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:41.733589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7f4c4-e1c2-4ea8-b525-d4c4e95e8ac0 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:41.745254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750bdd-37c3-4077-b96c-2b7b6b57fa20 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:41.745699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7f4c4-e1c2-4ea8-b525-d4c4e95e8ac0 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:41.750584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4bca6-85fe-4e46-b042-361e1fd8c05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:41.751337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4bca6-85fe-4e46-b042-361e1fd8c05e admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.751539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc0773-3743-4185-9b70-373a56b2e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:41.751643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4bca6-85fe-4e46-b042-361e1fd8c05e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.751927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4bca6-85fe-4e46-b042-361e1fd8c05e admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.752038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0773-3743-4185-9b70-373a56b2e90d admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.752326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0773-3743-4185-9b70-373a56b2e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.752579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc0773-3743-4185-9b70-373a56b2e90d admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.752672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4bca6-85fe-4e46-b042-361e1fd8c05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:41.753320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc0773-3743-4185-9b70-373a56b2e90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:41.754681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4bca6-85fe-4e46-b042-361e1fd8c05e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:41.755146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc0773-3743-4185-9b70-373a56b2e90d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:41.767736 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1039/2062] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:41 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:41.771913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc0773-3743-4185-9b70-373a56b2e90d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:41.785059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc0773-3743-4185-9b70-373a56b2e90d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:41.790524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4469b-d14a-42f1-8035-ff5090e8a5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:41.791200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4469b-d14a-42f1-8035-ff5090e8a5bc admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.791623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4469b-d14a-42f1-8035-ff5090e8a5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.791753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4469b-d14a-42f1-8035-ff5090e8a5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.792657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4469b-d14a-42f1-8035-ff5090e8a5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:41.794072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4469b-d14a-42f1-8035-ff5090e8a5bc admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:41.795527 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1024/2063] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:41 2022] POST /identity/v3/projects => generated 388 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:41.800260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4bca6-85fe-4e46-b042-361e1fd8c05e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:41.807854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1040/2064] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:41 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:41.813836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4469b-d14a-42f1-8035-ff5090e8a5bc admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:41.825575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4469b-d14a-42f1-8035-ff5090e8a5bc admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:41.920070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4bca6-85fe-4e46-b042-361e1fd8c05e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:41.926497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0517c6-e80e-45b3-b327-58b6a7765a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:41.927333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0517c6-e80e-45b3-b327-58b6a7765a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.927682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0517c6-e80e-45b3-b327-58b6a7765a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.928859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0517c6-e80e-45b3-b327-58b6a7765a67 admin admin] PATH_INFO: `/v3/projects/546696ef293f43f2bbd524900e91f01b/users/1d8b6f25629e4fbd8518a2802bc24979/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.939057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78967-5fae-4f89-8a32-8ee1e413165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:41.939715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78967-5fae-4f89-8a32-8ee1e413165f admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:41.939898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78967-5fae-4f89-8a32-8ee1e413165f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:41.940171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78967-5fae-4f89-8a32-8ee1e413165f admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:41.942251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d78967-5fae-4f89-8a32-8ee1e413165f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:41.948511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d78967-5fae-4f89-8a32-8ee1e413165f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:41.974844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0517c6-e80e-45b3-b327-58b6a7765a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546696ef293f43f2bbd524900e91f01b, user_id=1d8b6f25629e4fbd8518a2802bc24979, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:41.989977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1025/2065] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:41 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:41.990183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0517c6-e80e-45b3-b327-58b6a7765a67 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:41.992606 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78967-5fae-4f89-8a32-8ee1e413165f admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.007565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78967-5fae-4f89-8a32-8ee1e413165f admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.014937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1041/2066] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:41 2022] PUT /identity/v3/projects/546696ef293f43f2bbd524900e91f01b/users/1d8b6f25629e4fbd8518a2802bc24979/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:42.026598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac66e-0c06-4fc6-89f5-7c1c70c14565 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.026920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac66e-0c06-4fc6-89f5-7c1c70c14565 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.027189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac66e-0c06-4fc6-89f5-7c1c70c14565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.065414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-7b6ac66e-0c06-4fc6-89f5-7c1c70c14565 None None] MFA Rules not processed for user `1d8b6f25629e4fbd8518a2802bc24979`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:42.066677 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7b6ac66e-0c06-4fc6-89f5-7c1c70c14565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:42.088247 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:42.118970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadffb06-2aed-4610-be49-26cca02f1b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.119739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadffb06-2aed-4610-be49-26cca02f1b41 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.119989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadffb06-2aed-4610-be49-26cca02f1b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.120264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadffb06-2aed-4610-be49-26cca02f1b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.120982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadffb06-2aed-4610-be49-26cca02f1b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.122858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadffb06-2aed-4610-be49-26cca02f1b41 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:42.125418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:42.136440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1026/2067] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:41 2022] GET /identity/v3/roles => generated 1427 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:42.140275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadffb06-2aed-4610-be49-26cca02f1b41 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.153801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadffb06-2aed-4610-be49-26cca02f1b41 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.160923 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558df8-9710-4537-907f-136500263bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.161669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558df8-9710-4537-907f-136500263bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.161963 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558df8-9710-4537-907f-136500263bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.162244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558df8-9710-4537-907f-136500263bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.162990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb558df8-9710-4537-907f-136500263bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.164647 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb558df8-9710-4537-907f-136500263bc1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:42.176401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1042/2068] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:42.180628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac66e-0c06-4fc6-89f5-7c1c70c14565 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.182094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1027/2069] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:42 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:42.186345 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558df8-9710-4537-907f-136500263bc1 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.192820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac66e-0c06-4fc6-89f5-7c1c70c14565 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.197894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10a827-e730-4774-a417-fc8003d37ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.198612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10a827-e730-4774-a417-fc8003d37ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.198891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10a827-e730-4774-a417-fc8003d37ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.199193 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10a827-e730-4774-a417-fc8003d37ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.199923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10a827-e730-4774-a417-fc8003d37ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.201825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10a827-e730-4774-a417-fc8003d37ad0 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:42.202482 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558df8-9710-4537-907f-136500263bc1 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.208911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb17d8a-1742-4792-841b-5a2068b0d2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.209886 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17d8a-1742-4792-841b-5a2068b0d2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.210247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17d8a-1742-4792-841b-5a2068b0d2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.210964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17d8a-1742-4792-841b-5a2068b0d2c6 admin admin] PATH_INFO: `/v3/projects/dbed0bcb70df4fed9f38b11c2051dff6/users/db13c861d2b64ee4a01b7ca18cc3f666/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.230305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17d8a-1742-4792-841b-5a2068b0d2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbed0bcb70df4fed9f38b11c2051dff6, user_id=db13c861d2b64ee4a01b7ca18cc3f666, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.236892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17d8a-1742-4792-841b-5a2068b0d2c6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:42.237082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1043/2070] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:42 2022] POST /identity/v3/projects => generated 374 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:42.237957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10a827-e730-4774-a417-fc8003d37ad0 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.261397 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1028/2071] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:42 2022] PUT /identity/v3/projects/dbed0bcb70df4fed9f38b11c2051dff6/users/db13c861d2b64ee4a01b7ca18cc3f666/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:42.279126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe3db-fa14-4e11-b523-26c65b7e1e40 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.279474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe3db-fa14-4e11-b523-26c65b7e1e40 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.279753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe3db-fa14-4e11-b523-26c65b7e1e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.318012 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-c26fe3db-fa14-4e11-b523-26c65b7e1e40 None None] MFA Rules not processed for user `db13c861d2b64ee4a01b7ca18cc3f666`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:42.319493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c26fe3db-fa14-4e11-b523-26c65b7e1e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:42.381905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10a827-e730-4774-a417-fc8003d37ad0 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.407215 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1029/2072] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:42.411951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fe3db-fa14-4e11-b523-26c65b7e1e40 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.515950 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fe3db-fa14-4e11-b523-26c65b7e1e40 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.520753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebaf87d-e061-4142-968d-0db7eea0f597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.521281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f73d8-6385-4e8a-8827-1ea856ae164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.521465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaf87d-e061-4142-968d-0db7eea0f597 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.521566 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f73d8-6385-4e8a-8827-1ea856ae164b admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.521723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaf87d-e061-4142-968d-0db7eea0f597 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.521820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f73d8-6385-4e8a-8827-1ea856ae164b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.522442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaf87d-e061-4142-968d-0db7eea0f597 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.522550 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f73d8-6385-4e8a-8827-1ea856ae164b admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.522625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebaf87d-e061-4142-968d-0db7eea0f597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.522752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f73d8-6385-4e8a-8827-1ea856ae164b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.524583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebaf87d-e061-4142-968d-0db7eea0f597 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:42.525306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f73d8-6385-4e8a-8827-1ea856ae164b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:42.564891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1030/2073] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:42 2022] POST /identity/v3/projects => generated 384 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:42.569629 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f73d8-6385-4e8a-8827-1ea856ae164b admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.592657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1044/2074] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:42 2022] POST /identity/v3/users => generated 294 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:42.596331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebaf87d-e061-4142-968d-0db7eea0f597 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.617330 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebaf87d-e061-4142-968d-0db7eea0f597 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.624071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:42.666531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:42.668476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f73d8-6385-4e8a-8827-1ea856ae164b admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.681828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c6ed2-5026-4c3d-af0a-72505249cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.682576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c6ed2-5026-4c3d-af0a-72505249cc57 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.682927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c6ed2-5026-4c3d-af0a-72505249cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.683231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c6ed2-5026-4c3d-af0a-72505249cc57 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.683922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c6ed2-5026-4c3d-af0a-72505249cc57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.685909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c6ed2-5026-4c3d-af0a-72505249cc57 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:42.721151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90bf3a-f895-4d2e-aa99-03c3c66f7e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.721850 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90bf3a-f895-4d2e-aa99-03c3c66f7e4d admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.722136 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90bf3a-f895-4d2e-aa99-03c3c66f7e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.722413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90bf3a-f895-4d2e-aa99-03c3c66f7e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.723336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90bf3a-f895-4d2e-aa99-03c3c66f7e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.729750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90bf3a-f895-4d2e-aa99-03c3c66f7e4d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:42.737567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1031/2075] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:42 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:42.738619 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c6ed2-5026-4c3d-af0a-72505249cc57 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.753731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1045/2076] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:42 2022] GET /identity/v3/roles => generated 1427 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:42.763092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c6ed2-5026-4c3d-af0a-72505249cc57 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.763307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90bf3a-f895-4d2e-aa99-03c3c66f7e4d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.777461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90bf3a-f895-4d2e-aa99-03c3c66f7e4d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.778435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0164208-cd92-49d1-a00f-2448f52e095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.779372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0164208-cd92-49d1-a00f-2448f52e095b admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.779807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0164208-cd92-49d1-a00f-2448f52e095b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.780374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0164208-cd92-49d1-a00f-2448f52e095b admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.781291 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0164208-cd92-49d1-a00f-2448f52e095b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.783722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2380fa-ba1d-44fd-80b1-f70e638cf167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.784869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2380fa-ba1d-44fd-80b1-f70e638cf167 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.785254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2380fa-ba1d-44fd-80b1-f70e638cf167 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.785551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2380fa-ba1d-44fd-80b1-f70e638cf167 admin admin] PATH_INFO: `/v3/projects/c6fc6856728842bd9c65b1d4cd25eb3d/users/47ef2f308cad42e1896a029f95d50d29/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.785683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0164208-cd92-49d1-a00f-2448f52e095b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:42.806475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2380fa-ba1d-44fd-80b1-f70e638cf167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6fc6856728842bd9c65b1d4cd25eb3d, user_id=47ef2f308cad42e1896a029f95d50d29, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.810557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2380fa-ba1d-44fd-80b1-f70e638cf167 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:42.818733 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1032/2077] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:42 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:42.824416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0164208-cd92-49d1-a00f-2448f52e095b admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.832543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1046/2078] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:42 2022] PUT /identity/v3/projects/c6fc6856728842bd9c65b1d4cd25eb3d/users/47ef2f308cad42e1896a029f95d50d29/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:42.838779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2380fa-ba1d-44fd-80b1-f70e638cf167 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:42.844101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0164208-cd92-49d1-a00f-2448f52e095b admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.950103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c542a-3251-46ed-9490-8e076df45dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.951280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c542a-3251-46ed-9490-8e076df45dde admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.951638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c542a-3251-46ed-9490-8e076df45dde admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.952363 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c542a-3251-46ed-9490-8e076df45dde admin admin] PATH_INFO: `/v3/projects/e459669e5cce4ecda3f394319cd518d3/users/db04e287a55e445c97dba0ca6b34e034/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.971691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c542a-3251-46ed-9490-8e076df45dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=e459669e5cce4ecda3f394319cd518d3, user_id=db04e287a55e445c97dba0ca6b34e034, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.974725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c542a-3251-46ed-9490-8e076df45dde admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:42.980775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2380fa-ba1d-44fd-80b1-f70e638cf167 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:42.988954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaabb0-1bb0-417c-9d02-33416916a876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:42.990090 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaabb0-1bb0-417c-9d02-33416916a876 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.990379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaabb0-1bb0-417c-9d02-33416916a876 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.990941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaabb0-1bb0-417c-9d02-33416916a876 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.991808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaabb0-1bb0-417c-9d02-33416916a876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:42.993437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaabb0-1bb0-417c-9d02-33416916a876 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:43.031006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1047/2079] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:42 2022] GET /identity/v3/roles => generated 1427 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:43.034694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaabb0-1bb0-417c-9d02-33416916a876 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:43.055632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaabb0-1bb0-417c-9d02-33416916a876 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:43.066079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1033/2080] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:42 2022] PUT /identity/v3/projects/e459669e5cce4ecda3f394319cd518d3/users/db04e287a55e445c97dba0ca6b34e034/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:43.067360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c542a-3251-46ed-9490-8e076df45dde admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:43.150280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b0e41-b5cf-4700-a2b1-f6746e6f525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:43.151647 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0e41-b5cf-4700-a2b1-f6746e6f525e admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:43.151647 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0e41-b5cf-4700-a2b1-f6746e6f525e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:43.151647 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0e41-b5cf-4700-a2b1-f6746e6f525e admin admin] PATH_INFO: `/v3/projects/c6fc6856728842bd9c65b1d4cd25eb3d/users/47ef2f308cad42e1896a029f95d50d29/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:43.154069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b0e41-b5cf-4700-a2b1-f6746e6f525e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6fc6856728842bd9c65b1d4cd25eb3d, user_id=47ef2f308cad42e1896a029f95d50d29, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:43.157171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b0e41-b5cf-4700-a2b1-f6746e6f525e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:43.168225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c542a-3251-46ed-9490-8e076df45dde admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:43.173705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c3141-e4aa-41d9-a5b8-2a691c8521f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:43.174455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c3141-e4aa-41d9-a5b8-2a691c8521f4 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:43.174739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c3141-e4aa-41d9-a5b8-2a691c8521f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:43.175038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c3141-e4aa-41d9-a5b8-2a691c8521f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:43.175763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c3141-e4aa-41d9-a5b8-2a691c8521f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:43.177447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c3141-e4aa-41d9-a5b8-2a691c8521f4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:43.183725 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1048/2081] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:43 2022] PUT /identity/v3/projects/c6fc6856728842bd9c65b1d4cd25eb3d/users/47ef2f308cad42e1896a029f95d50d29/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:43.185414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b0e41-b5cf-4700-a2b1-f6746e6f525e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:43.187289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c29b0e41-b5cf-4700-a2b1-f6746e6f525e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:43.199499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1034/2082] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:43 2022] GET /identity/v3/roles => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:43.201343 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d97bb-e7f7-4a7f-bed4-1e8256ae38dc None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:43.201626 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d97bb-e7f7-4a7f-bed4-1e8256ae38dc None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:43.201897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d97bb-e7f7-4a7f-bed4-1e8256ae38dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:43.234052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-076d97bb-e7f7-4a7f-bed4-1e8256ae38dc None None] MFA Rules not processed for user `47ef2f308cad42e1896a029f95d50d29`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:43.235138 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:43.235347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-076d97bb-e7f7-4a7f-bed4-1e8256ae38dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:43.261499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:43.266400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b0e41-b5cf-4700-a2b1-f6746e6f525e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:43.271531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd52aed-45d0-4739-b499-558659bc5f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:43.272172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd52aed-45d0-4739-b499-558659bc5f39 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:43.272915 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd52aed-45d0-4739-b499-558659bc5f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:43.273198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd52aed-45d0-4739-b499-558659bc5f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:43.276430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7fd52aed-45d0-4739-b499-558659bc5f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:43.320077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1035/2083] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:43.320995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d97bb-e7f7-4a7f-bed4-1e8256ae38dc None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:43.392160 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd52aed-45d0-4739-b499-558659bc5f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:43.394162 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd52aed-45d0-4739-b499-558659bc5f39 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:43.409574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1049/2084] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:43.412835 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd52aed-45d0-4739-b499-558659bc5f39 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:43.414338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7fd52aed-45d0-4739-b499-558659bc5f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:43.430117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d97bb-e7f7-4a7f-bed4-1e8256ae38dc None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:43.430988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd52aed-45d0-4739-b499-558659bc5f39 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:43.437367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdba5c5-c7db-40ba-93ae-91447b381c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:43.438169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdba5c5-c7db-40ba-93ae-91447b381c49 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:43.438530 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdba5c5-c7db-40ba-93ae-91447b381c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:43.438988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdba5c5-c7db-40ba-93ae-91447b381c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:43.448848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c77c4d-1197-4161-a54f-a63f6935df21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:43.450139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c77c4d-1197-4161-a54f-a63f6935df21 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:43.450579 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c77c4d-1197-4161-a54f-a63f6935df21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:43.451033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c77c4d-1197-4161-a54f-a63f6935df21 admin admin] PATH_INFO: `/v3/projects/e459669e5cce4ecda3f394319cd518d3/users/db04e287a55e445c97dba0ca6b34e034/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:43.454385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c77c4d-1197-4161-a54f-a63f6935df21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e459669e5cce4ecda3f394319cd518d3, user_id=db04e287a55e445c97dba0ca6b34e034, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:43.458664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c77c4d-1197-4161-a54f-a63f6935df21 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:43.476374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1036/2085] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:43 2022] PUT /identity/v3/projects/e459669e5cce4ecda3f394319cd518d3/users/db04e287a55e445c97dba0ca6b34e034/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:43.488045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117f1fe-3b3d-4fa8-bfc5-c3460e1ccee2 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:43.489409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117f1fe-3b3d-4fa8-bfc5-c3460e1ccee2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:43.489703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117f1fe-3b3d-4fa8-bfc5-c3460e1ccee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:43.549025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdba5c5-c7db-40ba-93ae-91447b381c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:43.551422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdba5c5-c7db-40ba-93ae-91447b381c49 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:43.562412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a117f1fe-3b3d-4fa8-bfc5-c3460e1ccee2 None None] MFA Rules not processed for user `db04e287a55e445c97dba0ca6b34e034`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:43.563867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a117f1fe-3b3d-4fa8-bfc5-c3460e1ccee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:43.568814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1050/2086] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:43.701293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1037/2087] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:44.048402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdba5c5-c7db-40ba-93ae-91447b381c49 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:44.062233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdba5c5-c7db-40ba-93ae-91447b381c49 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:44.169076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0688e7-361a-4786-8332-418fada5bbc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:44.170164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0688e7-361a-4786-8332-418fada5bbc4 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:44.170724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0688e7-361a-4786-8332-418fada5bbc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:44.171249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0688e7-361a-4786-8332-418fada5bbc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:44.188897 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0688e7-361a-4786-8332-418fada5bbc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:44.190929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0688e7-361a-4786-8332-418fada5bbc4 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:44.206236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1051/2088] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:44.518312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117f1fe-3b3d-4fa8-bfc5-c3460e1ccee2 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:44.572096 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:44.596147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117f1fe-3b3d-4fa8-bfc5-c3460e1ccee2 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:44.601263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:44.601931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:44.602280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:44.602687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] PATH_INFO: `/v3/users/db13c861d2b64ee4a01b7ca18cc3f666` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:44.604683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=db13c861d2b64ee4a01b7ca18cc3f666)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:44.606272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:44.677144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db13c861d2b64ee4a01b7ca18cc3f666'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:44.679631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db13c861d2b64ee4a01b7ca18cc3f666'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:44.695137 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db13c861d2b64ee4a01b7ca18cc3f666'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:44.695901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db13c861d2b64ee4a01b7ca18cc3f666'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:44.704593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db13c861d2b64ee4a01b7ca18cc3f666'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:44.721993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1038/2089] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:44 2022] DELETE /identity/v3/users/db13c861d2b64ee4a01b7ca18cc3f666 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:44.726371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab7a0c-6da5-4759-94eb-1c1f2dc0e281 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:44.726925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab7a0c-6da5-4759-94eb-1c1f2dc0e281 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:44.726925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab7a0c-6da5-4759-94eb-1c1f2dc0e281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:44.748542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-77ab7a0c-6da5-4759-94eb-1c1f2dc0e281 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:44.749809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-77ab7a0c-6da5-4759-94eb-1c1f2dc0e281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:44.774217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:44.824755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1052/2090] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:44.839995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:44.841946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:44.911280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67519a16-5d6a-4525-866a-6d6121cb6a2e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:44.915708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1d3b3-b333-4842-a1d7-a83aac6c70b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:44.916604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d3b3-b333-4842-a1d7-a83aac6c70b4 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:44.916959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d3b3-b333-4842-a1d7-a83aac6c70b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:44.917242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d3b3-b333-4842-a1d7-a83aac6c70b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:44.928631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1d3b3-b333-4842-a1d7-a83aac6c70b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:44.930475 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1d3b3-b333-4842-a1d7-a83aac6c70b4 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:44.943615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1039/2091] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:45.565095 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab7a0c-6da5-4759-94eb-1c1f2dc0e281 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:45.567325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-77ab7a0c-6da5-4759-94eb-1c1f2dc0e281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:45.600106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab7a0c-6da5-4759-94eb-1c1f2dc0e281 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:45.608880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:45.609814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:45.610158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:45.610440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] PATH_INFO: `/v3/projects/dbed0bcb70df4fed9f38b11c2051dff6` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:45.611688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbed0bcb70df4fed9f38b11c2051dff6)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:45.613659 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:45.758760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbed0bcb70df4fed9f38b11c2051dff6', 'request_id': 'req-5de1e2df-5962-4f96-9711-7da0ec24da60'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:45.778969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbed0bcb70df4fed9f38b11c2051dff6', 'request_id': 'req-5de1e2df-5962-4f96-9711-7da0ec24da60'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:45.786591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbed0bcb70df4fed9f38b11c2051dff6', 'request_id': 'req-5de1e2df-5962-4f96-9711-7da0ec24da60'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:45.803739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] The token cache is being invalidate because project dbed0bcb70df4fed9f38b11c2051dff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:45.803966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:45.804546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:45.811213 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1053/2092] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:45 2022] DELETE /identity/v3/projects/dbed0bcb70df4fed9f38b11c2051dff6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:45.813315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1d3b3-b333-4842-a1d7-a83aac6c70b4 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:45.840589 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1d3b3-b333-4842-a1d7-a83aac6c70b4 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:45.996377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:45.996945 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:45.997995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:45.998282 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] PATH_INFO: `/v3/users/db04e287a55e445c97dba0ca6b34e034` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:46.001702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db04e287a55e445c97dba0ca6b34e034)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:46.007445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:46.015401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:46.123180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db04e287a55e445c97dba0ca6b34e034'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.124088 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db04e287a55e445c97dba0ca6b34e034'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.167957 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db04e287a55e445c97dba0ca6b34e034'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.169161 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db04e287a55e445c97dba0ca6b34e034'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.194740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db04e287a55e445c97dba0ca6b34e034'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.234079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1040/2093] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:45 2022] DELETE /identity/v3/users/db04e287a55e445c97dba0ca6b34e034 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:46.614737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:46.616571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:46.661363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1e2df-5962-4f96-9711-7da0ec24da60 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:46.798241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:46.799495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:46.799793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:46.800060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] PATH_INFO: `/v3/projects/e459669e5cce4ecda3f394319cd518d3` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:46.809698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e459669e5cce4ecda3f394319cd518d3)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:46.811490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:46.822835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:46.824421 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:46.844802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932cc1a-ed42-433a-b7ab-520e26039741 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:46.851978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125356e1-6760-49e9-98d9-d33ee144d16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:46.852882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125356e1-6760-49e9-98d9-d33ee144d16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:46.853379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125356e1-6760-49e9-98d9-d33ee144d16f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:46.853851 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125356e1-6760-49e9-98d9-d33ee144d16f admin admin] PATH_INFO: `/v3/users/1d8b6f25629e4fbd8518a2802bc24979` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:46.855543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125356e1-6760-49e9-98d9-d33ee144d16f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d8b6f25629e4fbd8518a2802bc24979)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:46.857721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125356e1-6760-49e9-98d9-d33ee144d16f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:46.923594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e459669e5cce4ecda3f394319cd518d3', 'request_id': 'req-63469a2f-3e64-44d0-812b-93c8d105387b'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.926501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:46.937328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e459669e5cce4ecda3f394319cd518d3', 'request_id': 'req-63469a2f-3e64-44d0-812b-93c8d105387b'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.942246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-125356e1-6760-49e9-98d9-d33ee144d16f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d8b6f25629e4fbd8518a2802bc24979'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.943009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-125356e1-6760-49e9-98d9-d33ee144d16f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d8b6f25629e4fbd8518a2802bc24979'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.951196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e459669e5cce4ecda3f394319cd518d3', 'request_id': 'req-63469a2f-3e64-44d0-812b-93c8d105387b'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.964658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-125356e1-6760-49e9-98d9-d33ee144d16f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d8b6f25629e4fbd8518a2802bc24979'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.966668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-125356e1-6760-49e9-98d9-d33ee144d16f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d8b6f25629e4fbd8518a2802bc24979'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.970588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] The token cache is being invalidate because project e459669e5cce4ecda3f394319cd518d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:46.971089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.971903 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-63469a2f-3e64-44d0-812b-93c8d105387b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.977167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-125356e1-6760-49e9-98d9-d33ee144d16f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d8b6f25629e4fbd8518a2802bc24979'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:46.980891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1054/2094] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:46 2022] DELETE /identity/v3/projects/e459669e5cce4ecda3f394319cd518d3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:46.985604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacb105-7461-4823-9fee-67a4767e2735 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:46.985799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacb105-7461-4823-9fee-67a4767e2735 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:46.986044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacb105-7461-4823-9fee-67a4767e2735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.010206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1041/2095] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:46 2022] DELETE /identity/v3/users/1d8b6f25629e4fbd8518a2802bc24979 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:47.014332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea04478-5b38-4884-b057-5e14ca04570f None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.014628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea04478-5b38-4884-b057-5e14ca04570f None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.014926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea04478-5b38-4884-b057-5e14ca04570f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.018674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-aaacb105-7461-4823-9fee-67a4767e2735 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:47.020057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-aaacb105-7461-4823-9fee-67a4767e2735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:47.036741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-9ea04478-5b38-4884-b057-5e14ca04570f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:47.038651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9ea04478-5b38-4884-b057-5e14ca04570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:47.093785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:47.115447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1042/2096] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:47.120987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1055/2097] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:47.125891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea04478-5b38-4884-b057-5e14ca04570f None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:47.129203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9ea04478-5b38-4884-b057-5e14ca04570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:47.191806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c81ef-670f-4d75-8ec1-226871a7db0c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.192098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c81ef-670f-4d75-8ec1-226871a7db0c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.192310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c81ef-670f-4d75-8ec1-226871a7db0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.204471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea04478-5b38-4884-b057-5e14ca04570f None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:47.209255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907908a-784d-4ec7-b0ba-5bec12b2f619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:47.209888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907908a-784d-4ec7-b0ba-5bec12b2f619 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.210179 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907908a-784d-4ec7-b0ba-5bec12b2f619 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.210828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907908a-784d-4ec7-b0ba-5bec12b2f619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.214105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ff9c81ef-670f-4d75-8ec1-226871a7db0c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:47.215415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ff9c81ef-670f-4d75-8ec1-226871a7db0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:47.222336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907908a-784d-4ec7-b0ba-5bec12b2f619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:47.223771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907908a-784d-4ec7-b0ba-5bec12b2f619 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:47.224577 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1056/2098] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:47.228910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c81ef-670f-4d75-8ec1-226871a7db0c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:47.235052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1043/2099] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:47.239228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c81ef-670f-4d75-8ec1-226871a7db0c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:47.249263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2b5d-365d-446e-87d6-eac29a210ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:47.250200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2b5d-365d-446e-87d6-eac29a210ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.250480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2b5d-365d-446e-87d6-eac29a210ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.250745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2b5d-365d-446e-87d6-eac29a210ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.251483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2b5d-365d-446e-87d6-eac29a210ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:47.251792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2b5d-365d-446e-87d6-eac29a210ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:47.259693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2b5d-365d-446e-87d6-eac29a210ca9 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:47.272555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1057/2100] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:54:47.277060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907908a-784d-4ec7-b0ba-5bec12b2f619 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:47.286812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907908a-784d-4ec7-b0ba-5bec12b2f619 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:47.291932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f8ea6-08e8-45c6-8f3e-78abb1973cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:47.292564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f8ea6-08e8-45c6-8f3e-78abb1973cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.292844 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f8ea6-08e8-45c6-8f3e-78abb1973cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.293115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f8ea6-08e8-45c6-8f3e-78abb1973cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.293789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f8ea6-08e8-45c6-8f3e-78abb1973cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:47.295762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f8ea6-08e8-45c6-8f3e-78abb1973cb6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:47.332144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1044/2101] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:47 2022] POST /identity/v3/projects => generated 372 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:47.336779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2b5d-365d-446e-87d6-eac29a210ca9 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:47.347557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2b5d-365d-446e-87d6-eac29a210ca9 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:47.420347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fca9d-24bc-4f39-80fb-7c49d497eba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:47.420985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fca9d-24bc-4f39-80fb-7c49d497eba7 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.421261 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fca9d-24bc-4f39-80fb-7c49d497eba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.421531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fca9d-24bc-4f39-80fb-7c49d497eba7 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.422201 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fca9d-24bc-4f39-80fb-7c49d497eba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:47.425893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fca9d-24bc-4f39-80fb-7c49d497eba7 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:47.467312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1058/2102] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:47 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:47.467416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f8ea6-08e8-45c6-8f3e-78abb1973cb6 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:47.473997 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f8ea6-08e8-45c6-8f3e-78abb1973cb6 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:47.479309 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181ba1c-15f5-46c1-80ea-fbd165dfe6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:47.479958 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181ba1c-15f5-46c1-80ea-fbd165dfe6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.480246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181ba1c-15f5-46c1-80ea-fbd165dfe6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.480645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181ba1c-15f5-46c1-80ea-fbd165dfe6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.481402 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181ba1c-15f5-46c1-80ea-fbd165dfe6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:47.483241 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181ba1c-15f5-46c1-80ea-fbd165dfe6a4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:47.494171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1045/2103] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:47 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:47.498713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fca9d-24bc-4f39-80fb-7c49d497eba7 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:47.511754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fca9d-24bc-4f39-80fb-7c49d497eba7 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:47.516561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c02cf4-9edc-4b7b-b20b-c3eacece719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:47.517340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c02cf4-9edc-4b7b-b20b-c3eacece719b admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.517631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c02cf4-9edc-4b7b-b20b-c3eacece719b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.517908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c02cf4-9edc-4b7b-b20b-c3eacece719b admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.518620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c02cf4-9edc-4b7b-b20b-c3eacece719b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:47.520287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c02cf4-9edc-4b7b-b20b-c3eacece719b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:47.533191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1059/2104] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:47 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:47.538335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181ba1c-15f5-46c1-80ea-fbd165dfe6a4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:47.551737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181ba1c-15f5-46c1-80ea-fbd165dfe6a4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:47.556845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c02cf4-9edc-4b7b-b20b-c3eacece719b admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:47.557974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b1a22-4385-401f-a7b2-acaab165ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:47.558575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e0c02cf4-9edc-4b7b-b20b-c3eacece719b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:47.559052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1a22-4385-401f-a7b2-acaab165ac20 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.559480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1a22-4385-401f-a7b2-acaab165ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.559912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1a22-4385-401f-a7b2-acaab165ac20 admin admin] PATH_INFO: `/v3/projects/5a7ad2e9a7da4bf18c452a2ca1814ed4/users/d3040eee20664f3e83931ae9da71089d/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.573938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c02cf4-9edc-4b7b-b20b-c3eacece719b admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:47.580072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b1a22-4385-401f-a7b2-acaab165ac20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7ad2e9a7da4bf18c452a2ca1814ed4, user_id=d3040eee20664f3e83931ae9da71089d, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:47.580266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:47.581518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.581947 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.582376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] PATH_INFO: `/v3/projects/546696ef293f43f2bbd524900e91f01b` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.583273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b1a22-4385-401f-a7b2-acaab165ac20 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:47.583916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546696ef293f43f2bbd524900e91f01b)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:47.586772 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:47.602721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1046/2105] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:47 2022] PUT /identity/v3/projects/5a7ad2e9a7da4bf18c452a2ca1814ed4/users/d3040eee20664f3e83931ae9da71089d/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:47.608164 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa6315-0cf7-4838-bfe4-a42b32e8df93 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.608456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa6315-0cf7-4838-bfe4-a42b32e8df93 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.608739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa6315-0cf7-4838-bfe4-a42b32e8df93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.628522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d5fa6315-0cf7-4838-bfe4-a42b32e8df93 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:47.628923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:INSERT=4,keystone:DELETE=5,keystone:SELECT=91 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:47.629765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d5fa6315-0cf7-4838-bfe4-a42b32e8df93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:47.643649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546696ef293f43f2bbd524900e91f01b', 'request_id': 'req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:47.653543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546696ef293f43f2bbd524900e91f01b', 'request_id': 'req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:47.660204 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546696ef293f43f2bbd524900e91f01b', 'request_id': 'req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:47.675596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] The token cache is being invalidate because project 546696ef293f43f2bbd524900e91f01b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:47.675891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:47.676693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:47.678525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1060/2106] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:47 2022] DELETE /identity/v3/projects/546696ef293f43f2bbd524900e91f01b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:54:47.683067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:47.684954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:47.697252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1047/2107] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:47.707551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa6315-0cf7-4838-bfe4-a42b32e8df93 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:47.709006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d5fa6315-0cf7-4838-bfe4-a42b32e8df93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:47.757771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:47.760957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eeabd2-f0bd-47fa-8fa0-e7e421cf0175 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:47.766057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036885c7-5685-4875-b326-3a6ebb3caf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:47.766771 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036885c7-5685-4875-b326-3a6ebb3caf42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.767085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036885c7-5685-4875-b326-3a6ebb3caf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.767362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036885c7-5685-4875-b326-3a6ebb3caf42 admin admin] PATH_INFO: `/v3/users/47ef2f308cad42e1896a029f95d50d29` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.768723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036885c7-5685-4875-b326-3a6ebb3caf42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ef2f308cad42e1896a029f95d50d29)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:47.771391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036885c7-5685-4875-b326-3a6ebb3caf42 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:47.772846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa6315-0cf7-4838-bfe4-a42b32e8df93 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:47.777033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc39a8-4fb5-4f0d-8427-e9f2ed7bf62a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:47.777660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc39a8-4fb5-4f0d-8427-e9f2ed7bf62a service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:47.777938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc39a8-4fb5-4f0d-8427-e9f2ed7bf62a service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:47.778211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc39a8-4fb5-4f0d-8427-e9f2ed7bf62a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:47.787746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc39a8-4fb5-4f0d-8427-e9f2ed7bf62a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:47.789109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc39a8-4fb5-4f0d-8427-e9f2ed7bf62a service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:47.800085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1048/2108] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:54:47.825889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-036885c7-5685-4875-b326-3a6ebb3caf42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ef2f308cad42e1896a029f95d50d29'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:47.836576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-036885c7-5685-4875-b326-3a6ebb3caf42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ef2f308cad42e1896a029f95d50d29'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:47.846199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-036885c7-5685-4875-b326-3a6ebb3caf42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ef2f308cad42e1896a029f95d50d29'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:47.847145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-036885c7-5685-4875-b326-3a6ebb3caf42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ef2f308cad42e1896a029f95d50d29'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:47.847899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-036885c7-5685-4875-b326-3a6ebb3caf42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ef2f308cad42e1896a029f95d50d29'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:47.867484 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1061/2109] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:47 2022] DELETE /identity/v3/users/47ef2f308cad42e1896a029f95d50d29 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:48.271134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc39a8-4fb5-4f0d-8427-e9f2ed7bf62a service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:48.295158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc39a8-4fb5-4f0d-8427-e9f2ed7bf62a service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:48.372640 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:48.373303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:48.373586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:48.373863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] PATH_INFO: `/v3/projects/c6fc6856728842bd9c65b1d4cd25eb3d` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:48.375072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6fc6856728842bd9c65b1d4cd25eb3d)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:48.377341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:48.436490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6fc6856728842bd9c65b1d4cd25eb3d', 'request_id': 'req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:48.445279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6fc6856728842bd9c65b1d4cd25eb3d', 'request_id': 'req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:48.452519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6fc6856728842bd9c65b1d4cd25eb3d', 'request_id': 'req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:48.470290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] The token cache is being invalidate because project c6fc6856728842bd9c65b1d4cd25eb3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:48.470642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:48.473419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ed6c3324-d3d3-42ad-b05d-c25063d5afa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:48.475559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1049/2110] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:48 2022] DELETE /identity/v3/projects/c6fc6856728842bd9c65b1d4cd25eb3d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:48.481755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53276fd9-662d-4b0e-b3a9-ff797a1b950e None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:48.482131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53276fd9-662d-4b0e-b3a9-ff797a1b950e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:48.482995 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53276fd9-662d-4b0e-b3a9-ff797a1b950e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:48.523794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-53276fd9-662d-4b0e-b3a9-ff797a1b950e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:48.526250 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-53276fd9-662d-4b0e-b3a9-ff797a1b950e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:48.578656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:48.613574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1062/2111] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:48.635164 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645f0e4-bce5-4e09-88a9-bedcdef280a2 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:48.635498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645f0e4-bce5-4e09-88a9-bedcdef280a2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:48.635748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645f0e4-bce5-4e09-88a9-bedcdef280a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:48.656287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b645f0e4-bce5-4e09-88a9-bedcdef280a2 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:48.657594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b645f0e4-bce5-4e09-88a9-bedcdef280a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:48.666850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1050/2112] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:48.671530 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53276fd9-662d-4b0e-b3a9-ff797a1b950e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:48.686632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53276fd9-662d-4b0e-b3a9-ff797a1b950e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:48.691292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcb80f-ae94-4862-aeb6-8d7b6da98268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:48.691914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcb80f-ae94-4862-aeb6-8d7b6da98268 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:48.692192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcb80f-ae94-4862-aeb6-8d7b6da98268 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:48.692461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcb80f-ae94-4862-aeb6-8d7b6da98268 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:48.693164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcb80f-ae94-4862-aeb6-8d7b6da98268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:48.693470 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcb80f-ae94-4862-aeb6-8d7b6da98268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:48.695271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcb80f-ae94-4862-aeb6-8d7b6da98268 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:48.708931 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1063/2113] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:54:48.713960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645f0e4-bce5-4e09-88a9-bedcdef280a2 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:48.724101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645f0e4-bce5-4e09-88a9-bedcdef280a2 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:48.729273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5e92c-5034-423c-b52a-9b64f05a4e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:48.729918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5e92c-5034-423c-b52a-9b64f05a4e2e admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:48.730236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5e92c-5034-423c-b52a-9b64f05a4e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:48.730506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5e92c-5034-423c-b52a-9b64f05a4e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:48.731202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5e92c-5034-423c-b52a-9b64f05a4e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:48.733353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5e92c-5034-423c-b52a-9b64f05a4e2e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:48.768699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1051/2114] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:48 2022] POST /identity/v3/projects => generated 370 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:48.769999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcb80f-ae94-4862-aeb6-8d7b6da98268 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:48.781840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcb80f-ae94-4862-aeb6-8d7b6da98268 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:48.850904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91347405-2718-4246-9eb9-20c5e422bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:48.851621 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347405-2718-4246-9eb9-20c5e422bdff admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:48.851876 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347405-2718-4246-9eb9-20c5e422bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:48.852152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347405-2718-4246-9eb9-20c5e422bdff admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:48.852885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91347405-2718-4246-9eb9-20c5e422bdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:48.855490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91347405-2718-4246-9eb9-20c5e422bdff admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:48.884233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1064/2115] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:48 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:48.888725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5e92c-5034-423c-b52a-9b64f05a4e2e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:48.900222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5e92c-5034-423c-b52a-9b64f05a4e2e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:48.905251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ea2f-ce16-49bd-886b-d26c24e8d471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:48.905853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ea2f-ce16-49bd-886b-d26c24e8d471 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:48.906136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ea2f-ce16-49bd-886b-d26c24e8d471 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:48.906409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ea2f-ce16-49bd-886b-d26c24e8d471 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:48.907158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8ea2f-ce16-49bd-886b-d26c24e8d471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:48.908801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8ea2f-ce16-49bd-886b-d26c24e8d471 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:48.920118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1052/2116] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:48 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:48.925354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91347405-2718-4246-9eb9-20c5e422bdff admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:48.941211 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91347405-2718-4246-9eb9-20c5e422bdff admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:48.948086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd8cd2-54f8-4042-a55f-0cb0a9583bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:48.948767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd8cd2-54f8-4042-a55f-0cb0a9583bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:48.949049 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd8cd2-54f8-4042-a55f-0cb0a9583bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:48.949321 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd8cd2-54f8-4042-a55f-0cb0a9583bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:48.950037 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd8cd2-54f8-4042-a55f-0cb0a9583bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:48.951881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd8cd2-54f8-4042-a55f-0cb0a9583bf8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:48.966697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1065/2117] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:48 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:48.970917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ea2f-ce16-49bd-886b-d26c24e8d471 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:48.983120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ea2f-ce16-49bd-886b-d26c24e8d471 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:48.988910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001edb6-cb1b-481a-9e0d-94d5568ad515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:48.989623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001edb6-cb1b-481a-9e0d-94d5568ad515 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:48.989902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001edb6-cb1b-481a-9e0d-94d5568ad515 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:48.990162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001edb6-cb1b-481a-9e0d-94d5568ad515 admin admin] PATH_INFO: `/v3/projects/847f66d446a14706b69870be59f8f40b/users/f130bd3ef7264a06995a22d5fa76126e/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:49.014193 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001edb6-cb1b-481a-9e0d-94d5568ad515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847f66d446a14706b69870be59f8f40b, user_id=f130bd3ef7264a06995a22d5fa76126e, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:49.018084 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001edb6-cb1b-481a-9e0d-94d5568ad515 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:49.042445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1053/2118] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:48 2022] PUT /identity/v3/projects/847f66d446a14706b69870be59f8f40b/users/f130bd3ef7264a06995a22d5fa76126e/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:49.054282 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b56c0-d269-4111-a4a5-abf2de4e28da None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:49.054635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b56c0-d269-4111-a4a5-abf2de4e28da None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:49.054919 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b56c0-d269-4111-a4a5-abf2de4e28da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:49.072618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3124d4-6f3d-44ee-b440-9ca4a3c61eb1 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:49.073094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3124d4-6f3d-44ee-b440-9ca4a3c61eb1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:49.073579 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3124d4-6f3d-44ee-b440-9ca4a3c61eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:49.092519 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-441b56c0-d269-4111-a4a5-abf2de4e28da None None] MFA Rules not processed for user `f130bd3ef7264a06995a22d5fa76126e`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:49.093713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-441b56c0-d269-4111-a4a5-abf2de4e28da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:49.099972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:49.112024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-fe3124d4-6f3d-44ee-b440-9ca4a3c61eb1 None None] MFA Rules not processed for user `d3040eee20664f3e83931ae9da71089d`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:49.113949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fe3124d4-6f3d-44ee-b440-9ca4a3c61eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:49.186993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1066/2119] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:49.195731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b56c0-d269-4111-a4a5-abf2de4e28da None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:49.196588 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1054/2120] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:49.201073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-441b56c0-d269-4111-a4a5-abf2de4e28da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:49.211259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3124d4-6f3d-44ee-b440-9ca4a3c61eb1 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:49.213731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fe3124d4-6f3d-44ee-b440-9ca4a3c61eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:49.252320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:49.272303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b56c0-d269-4111-a4a5-abf2de4e28da None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:49.276330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3124d4-6f3d-44ee-b440-9ca4a3c61eb1 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:49.276838 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6abee-5e06-42a2-8823-8170f75c79b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1cabb41d38a40acb7d41c169cc90cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:49.277269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6abee-5e06-42a2-8823-8170f75c79b6 service glance] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:49.277559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6abee-5e06-42a2-8823-8170f75c79b6 service glance] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:49.277836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6abee-5e06-42a2-8823-8170f75c79b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:49.280314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df2b55-ea3b-4a47-985d-0dc53d380526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:49.281002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df2b55-ea3b-4a47-985d-0dc53d380526 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:49.281278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df2b55-ea3b-4a47-985d-0dc53d380526 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:49.281546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df2b55-ea3b-4a47-985d-0dc53d380526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:49.286699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6abee-5e06-42a2-8823-8170f75c79b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:49.288186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6abee-5e06-42a2-8823-8170f75c79b6 service glance] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:49.290041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df2b55-ea3b-4a47-985d-0dc53d380526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:49.291596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df2b55-ea3b-4a47-985d-0dc53d380526 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:49.298243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1067/2121] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:49.301390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1055/2122] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:49.687611 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6abee-5e06-42a2-8823-8170f75c79b6 service glance] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:49.689937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-def6abee-5e06-42a2-8823-8170f75c79b6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:49.853118 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6abee-5e06-42a2-8823-8170f75c79b6 service glance] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:49.858431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:49.859132 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:49.859453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:49.860853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] PATH_INFO: `/v3/users/1921dc8a7f454d19bb678c50285eaf0e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:49.861619 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1921dc8a7f454d19bb678c50285eaf0e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:49.863676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:49.983995 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1921dc8a7f454d19bb678c50285eaf0e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:49.995710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1921dc8a7f454d19bb678c50285eaf0e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.011303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1921dc8a7f454d19bb678c50285eaf0e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.011848 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1921dc8a7f454d19bb678c50285eaf0e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.012457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1921dc8a7f454d19bb678c50285eaf0e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.034982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1068/2123] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:49 2022] DELETE /identity/v3/users/1921dc8a7f454d19bb678c50285eaf0e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:50.039768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e299-bf4b-47ea-afea-770c8d366c42 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:50.040582 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e299-bf4b-47ea-afea-770c8d366c42 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:50.040582 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e299-bf4b-47ea-afea-770c8d366c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:50.064342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-5058e299-bf4b-47ea-afea-770c8d366c42 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:50.065996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-5058e299-bf4b-47ea-afea-770c8d366c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:50.138552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1056/2124] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:50.149998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:50.151645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:50.215841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371a37e-db7e-41ce-919c-a9da01d6ecc9 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:50.220333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25911a01-6db8-4fea-afb6-0a07e7dab866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:50.221071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25911a01-6db8-4fea-afb6-0a07e7dab866 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:50.221393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25911a01-6db8-4fea-afb6-0a07e7dab866 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:50.221718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25911a01-6db8-4fea-afb6-0a07e7dab866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:50.232822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25911a01-6db8-4fea-afb6-0a07e7dab866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:50.234287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25911a01-6db8-4fea-afb6-0a07e7dab866 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:50.239534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:50.245298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1069/2125] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:50.556524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058e299-bf4b-47ea-afea-770c8d366c42 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:50.558254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-5058e299-bf4b-47ea-afea-770c8d366c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:50.570867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058e299-bf4b-47ea-afea-770c8d366c42 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:50.575701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:50.576443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:50.576727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:50.577004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] PATH_INFO: `/v3/projects/b98d82968b7541f586fc3ddfb7038b88` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:50.578177 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98d82968b7541f586fc3ddfb7038b88)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:50.580139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:50.626804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:50.638879 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98d82968b7541f586fc3ddfb7038b88', 'request_id': 'req-7139cab0-c2b2-46fe-b875-70decbc70dd0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.645941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98d82968b7541f586fc3ddfb7038b88', 'request_id': 'req-7139cab0-c2b2-46fe-b875-70decbc70dd0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.652092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98d82968b7541f586fc3ddfb7038b88', 'request_id': 'req-7139cab0-c2b2-46fe-b875-70decbc70dd0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.667244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] The token cache is being invalidate because project b98d82968b7541f586fc3ddfb7038b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:50.667630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.668333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7139cab0-c2b2-46fe-b875-70decbc70dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.669872 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1057/2126] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:50 2022] DELETE /identity/v3/projects/b98d82968b7541f586fc3ddfb7038b88 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:50.675042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25911a01-6db8-4fea-afb6-0a07e7dab866 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:50.686800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25911a01-6db8-4fea-afb6-0a07e7dab866 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:50.755777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:50.757245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:50.757698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:50.757977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] PATH_INFO: `/v3/users/d212d61bdc5d478db7de527cff4d9719` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:50.760064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d212d61bdc5d478db7de527cff4d9719)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:50.762693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:50.842399 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd212d61bdc5d478db7de527cff4d9719'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.857972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c0d50-bfc7-487e-aa83-ec0eb8926686 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:50.858246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c0d50-bfc7-487e-aa83-ec0eb8926686 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:50.858522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c0d50-bfc7-487e-aa83-ec0eb8926686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:50.863238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd212d61bdc5d478db7de527cff4d9719'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.873125 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd212d61bdc5d478db7de527cff4d9719'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.874118 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd212d61bdc5d478db7de527cff4d9719'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.874735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd212d61bdc5d478db7de527cff4d9719'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:50.881487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-871c0d50-bfc7-487e-aa83-ec0eb8926686 None None] MFA Rules not processed for user `d3040eee20664f3e83931ae9da71089d`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:50.882728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-871c0d50-bfc7-487e-aa83-ec0eb8926686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:50.895944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1070/2127] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:50 2022] DELETE /identity/v3/users/d212d61bdc5d478db7de527cff4d9719 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:50.966584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1058/2128] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:51.443524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:51.445084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:51.536042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab425120-973a-4c30-bbeb-9ab274e623eb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:51.543313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:51.544043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:51.544535 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:51.544817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] PATH_INFO: `/v3/projects/ae41a3d7d18847e2aae34c16324919f4` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:51.546510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae41a3d7d18847e2aae34c16324919f4)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:51.548354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:51.573491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:51.601151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae41a3d7d18847e2aae34c16324919f4', 'request_id': 'req-0e69d4bd-af78-4746-ab5f-d514d6f3c405'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:51.611070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae41a3d7d18847e2aae34c16324919f4', 'request_id': 'req-0e69d4bd-af78-4746-ab5f-d514d6f3c405'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:51.617852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae41a3d7d18847e2aae34c16324919f4', 'request_id': 'req-0e69d4bd-af78-4746-ab5f-d514d6f3c405'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:51.630049 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] The token cache is being invalidate because project ae41a3d7d18847e2aae34c16324919f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:51.630398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:51.631141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-0e69d4bd-af78-4746-ab5f-d514d6f3c405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:51.632963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1071/2129] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:51 2022] DELETE /identity/v3/projects/ae41a3d7d18847e2aae34c16324919f4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:51.639238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a707d8-41c5-402c-8b55-0058a737018c None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:51.639780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a707d8-41c5-402c-8b55-0058a737018c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:51.639913 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a707d8-41c5-402c-8b55-0058a737018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:51.661178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-23a707d8-41c5-402c-8b55-0058a737018c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:51.662412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-23a707d8-41c5-402c-8b55-0058a737018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:51.747863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1059/2130] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:51.750825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf981-1d37-4baf-9632-83bce495badf None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:51.751550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf981-1d37-4baf-9632-83bce495badf None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:51.751888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf981-1d37-4baf-9632-83bce495badf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:51.774264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-b04cf981-1d37-4baf-9632-83bce495badf None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:51.775547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b04cf981-1d37-4baf-9632-83bce495badf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:51.784137 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1072/2131] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:51.788617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a707d8-41c5-402c-8b55-0058a737018c None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:51.802029 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a707d8-41c5-402c-8b55-0058a737018c None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:51.809581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55633e0-013c-46e4-b206-f360e277ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:51.810236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55633e0-013c-46e4-b206-f360e277ca12 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:51.810521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55633e0-013c-46e4-b206-f360e277ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:51.810802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55633e0-013c-46e4-b206-f360e277ca12 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:51.811576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55633e0-013c-46e4-b206-f360e277ca12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:51.811885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55633e0-013c-46e4-b206-f360e277ca12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:51.813517 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55633e0-013c-46e4-b206-f360e277ca12 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:51.827614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1060/2132] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:54:51.832210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cf981-1d37-4baf-9632-83bce495badf None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:51.843291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cf981-1d37-4baf-9632-83bce495badf None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:51.848091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607be93-4838-469c-b3a6-ac505ba33d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:51.848719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607be93-4838-469c-b3a6-ac505ba33d06 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:51.849007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607be93-4838-469c-b3a6-ac505ba33d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:51.849283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607be93-4838-469c-b3a6-ac505ba33d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:51.850004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607be93-4838-469c-b3a6-ac505ba33d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:51.851960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607be93-4838-469c-b3a6-ac505ba33d06 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:51.883429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1073/2133] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:51 2022] POST /identity/v3/projects => generated 374 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:51.888970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55633e0-013c-46e4-b206-f360e277ca12 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:51.910156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55633e0-013c-46e4-b206-f360e277ca12 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:51.971420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:51.978989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fe341-f2fa-4b7f-97d4-31b49ea94e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:51.979672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fe341-f2fa-4b7f-97d4-31b49ea94e09 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:51.980238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fe341-f2fa-4b7f-97d4-31b49ea94e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:51.981033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fe341-f2fa-4b7f-97d4-31b49ea94e09 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:51.981706 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fe341-f2fa-4b7f-97d4-31b49ea94e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:51.984710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fe341-f2fa-4b7f-97d4-31b49ea94e09 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:52.019067 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1061/2134] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:51 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:52.022013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607be93-4838-469c-b3a6-ac505ba33d06 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:52.034686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607be93-4838-469c-b3a6-ac505ba33d06 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:52.040274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82e863-4cb5-4068-b717-336756f24343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:52.041196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82e863-4cb5-4068-b717-336756f24343 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:52.041545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82e863-4cb5-4068-b717-336756f24343 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:52.041834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82e863-4cb5-4068-b717-336756f24343 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:52.042700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82e863-4cb5-4068-b717-336756f24343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:52.044208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82e863-4cb5-4068-b717-336756f24343 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:52.055519 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1074/2135] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:52 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:52.062496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fe341-f2fa-4b7f-97d4-31b49ea94e09 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:52.074544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fe341-f2fa-4b7f-97d4-31b49ea94e09 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:52.080497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004cf9c-6abe-4622-ad23-27ef0f5e5998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:52.081195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004cf9c-6abe-4622-ad23-27ef0f5e5998 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:52.081484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004cf9c-6abe-4622-ad23-27ef0f5e5998 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:52.081762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004cf9c-6abe-4622-ad23-27ef0f5e5998 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:52.082494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004cf9c-6abe-4622-ad23-27ef0f5e5998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:52.084159 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004cf9c-6abe-4622-ad23-27ef0f5e5998 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:52.097607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1062/2136] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:52 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:52.102042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82e863-4cb5-4068-b717-336756f24343 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:52.113476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82e863-4cb5-4068-b717-336756f24343 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:52.120266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04434-e090-406a-b0c6-67a36d01cc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:52.121118 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04434-e090-406a-b0c6-67a36d01cc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:52.121756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04434-e090-406a-b0c6-67a36d01cc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:52.121756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04434-e090-406a-b0c6-67a36d01cc32 admin admin] PATH_INFO: `/v3/projects/ff87d5eb338243ba920b9adcf3e395de/users/29073b1ec3874f1e8627a3e2adb9da0c/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:52.140999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04434-e090-406a-b0c6-67a36d01cc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff87d5eb338243ba920b9adcf3e395de, user_id=29073b1ec3874f1e8627a3e2adb9da0c, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:52.144109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04434-e090-406a-b0c6-67a36d01cc32 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:52.165979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1075/2137] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:52 2022] PUT /identity/v3/projects/ff87d5eb338243ba920b9adcf3e395de/users/29073b1ec3874f1e8627a3e2adb9da0c/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:52.178400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf45cb-a16f-4623-82fe-d2fee01dd324 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:52.179054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf45cb-a16f-4623-82fe-d2fee01dd324 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:52.179483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf45cb-a16f-4623-82fe-d2fee01dd324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:52.212210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-22bf45cb-a16f-4623-82fe-d2fee01dd324 None None] MFA Rules not processed for user `29073b1ec3874f1e8627a3e2adb9da0c`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:52.213826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-22bf45cb-a16f-4623-82fe-d2fee01dd324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:52.293835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1063/2138] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:52.305532 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04434-e090-406a-b0c6-67a36d01cc32 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:52.307564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b7b04434-e090-406a-b0c6-67a36d01cc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:52.373320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04434-e090-406a-b0c6-67a36d01cc32 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:52.377264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6086b-99ef-4a10-a606-1d4f7104550c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:52.377889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6086b-99ef-4a10-a606-1d4f7104550c service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:52.378168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6086b-99ef-4a10-a606-1d4f7104550c service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:52.378437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6086b-99ef-4a10-a606-1d4f7104550c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:52.387476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6086b-99ef-4a10-a606-1d4f7104550c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:52.388898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6086b-99ef-4a10-a606-1d4f7104550c service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:52.398802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1076/2139] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:52.422160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf45cb-a16f-4623-82fe-d2fee01dd324 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:52.493410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf45cb-a16f-4623-82fe-d2fee01dd324 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:52.498364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:52.499060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:52.499340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:52.499666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] PATH_INFO: `/v3/users/29073b1ec3874f1e8627a3e2adb9da0c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:52.500872 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29073b1ec3874f1e8627a3e2adb9da0c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:52.502770 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:52.568543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29073b1ec3874f1e8627a3e2adb9da0c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:52.569347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29073b1ec3874f1e8627a3e2adb9da0c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:52.582824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29073b1ec3874f1e8627a3e2adb9da0c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:52.583597 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29073b1ec3874f1e8627a3e2adb9da0c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:52.586112 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:52.591991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29073b1ec3874f1e8627a3e2adb9da0c'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:52.607278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1064/2140] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:54:52 2022] DELETE /identity/v3/users/29073b1ec3874f1e8627a3e2adb9da0c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:52.611848 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f2f5-fe91-4e94-bee8-cd8125a67c61 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:52.612146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f2f5-fe91-4e94-bee8-cd8125a67c61 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:52.612429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f2f5-fe91-4e94-bee8-cd8125a67c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:52.633283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-8f00f2f5-fe91-4e94-bee8-cd8125a67c61 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:52.634554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8f00f2f5-fe91-4e94-bee8-cd8125a67c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:52.692155 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:52.714070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1077/2141] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:52.723901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:52.726422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:52.798605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd697f7-9165-4f06-a525-98ccede705f0 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:52.803503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e95696-7c25-442b-a3d6-a07add2484ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:52.804473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95696-7c25-442b-a3d6-a07add2484ed service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:52.804946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95696-7c25-442b-a3d6-a07add2484ed service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:52.805267 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95696-7c25-442b-a3d6-a07add2484ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:52.827024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e95696-7c25-442b-a3d6-a07add2484ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:52.828761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e95696-7c25-442b-a3d6-a07add2484ed service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:52.840828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1065/2142] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:53.202176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00f2f5-fe91-4e94-bee8-cd8125a67c61 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:53.204159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8f00f2f5-fe91-4e94-bee8-cd8125a67c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:53.217029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00f2f5-fe91-4e94-bee8-cd8125a67c61 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:53.224089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:53.224757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:53.225035 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:53.225302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] PATH_INFO: `/v3/projects/ff87d5eb338243ba920b9adcf3e395de` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:53.226657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff87d5eb338243ba920b9adcf3e395de)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:53.229178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:53.283268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff87d5eb338243ba920b9adcf3e395de', 'request_id': 'req-70e35e43-3c8c-4955-bc60-e34dcf148626'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:53.292492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff87d5eb338243ba920b9adcf3e395de', 'request_id': 'req-70e35e43-3c8c-4955-bc60-e34dcf148626'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:53.298531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff87d5eb338243ba920b9adcf3e395de', 'request_id': 'req-70e35e43-3c8c-4955-bc60-e34dcf148626'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:53.312892 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] The token cache is being invalidate because project ff87d5eb338243ba920b9adcf3e395de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:54:53.313155 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:53.313790 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-70e35e43-3c8c-4955-bc60-e34dcf148626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:54:53.323036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1078/2143] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:54:53 2022] DELETE /identity/v3/projects/ff87d5eb338243ba920b9adcf3e395de => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:53.325348 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1235d1-6768-41c3-8701-b1cb2f966288 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:53.326004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1235d1-6768-41c3-8701-b1cb2f966288 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:53.326279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1235d1-6768-41c3-8701-b1cb2f966288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:53.358155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-0e1235d1-6768-41c3-8701-b1cb2f966288 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:53.359322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0e1235d1-6768-41c3-8701-b1cb2f966288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:53.440263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1066/2144] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:53.449345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dac816-afb7-4d10-b12f-9f0bd8b99c27 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:53.449625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dac816-afb7-4d10-b12f-9f0bd8b99c27 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:53.449920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dac816-afb7-4d10-b12f-9f0bd8b99c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:53.473471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-56dac816-afb7-4d10-b12f-9f0bd8b99c27 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:53.474803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-56dac816-afb7-4d10-b12f-9f0bd8b99c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:53.485138 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1079/2145] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:53.489798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1235d1-6768-41c3-8701-b1cb2f966288 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:53.502009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1235d1-6768-41c3-8701-b1cb2f966288 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:53.507263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d186f-e211-4f61-acd5-25e7f4fcf7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:53.507905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d186f-e211-4f61-acd5-25e7f4fcf7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:53.508186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d186f-e211-4f61-acd5-25e7f4fcf7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:53.509204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d186f-e211-4f61-acd5-25e7f4fcf7e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:53.509593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d186f-e211-4f61-acd5-25e7f4fcf7e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:54:53.511227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d186f-e211-4f61-acd5-25e7f4fcf7e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:53.512948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d186f-e211-4f61-acd5-25e7f4fcf7e8 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:53.529280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1067/2146] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:54:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:54:53.530578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dac816-afb7-4d10-b12f-9f0bd8b99c27 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:53.540724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dac816-afb7-4d10-b12f-9f0bd8b99c27 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:53.546237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e198f7-f622-47bd-9a20-158d2b45bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:53.547228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e198f7-f622-47bd-9a20-158d2b45bb7e admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:53.547508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e198f7-f622-47bd-9a20-158d2b45bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:53.547778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e198f7-f622-47bd-9a20-158d2b45bb7e admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:53.548455 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e198f7-f622-47bd-9a20-158d2b45bb7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:53.550366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e198f7-f622-47bd-9a20-158d2b45bb7e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:53.587777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1080/2147] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:53 2022] POST /identity/v3/projects => generated 374 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:53.592170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d186f-e211-4f61-acd5-25e7f4fcf7e8 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:53.603982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d186f-e211-4f61-acd5-25e7f4fcf7e8 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:53.667603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e5e55-ffd7-4987-936b-b77f635c0318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:53.668244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5e55-ffd7-4987-936b-b77f635c0318 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:53.668528 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5e55-ffd7-4987-936b-b77f635c0318 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:53.668804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5e55-ffd7-4987-936b-b77f635c0318 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:53.669480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e5e55-ffd7-4987-936b-b77f635c0318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:53.671466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e5e55-ffd7-4987-936b-b77f635c0318 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:53.698522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1068/2148] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:53 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:53.703503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e198f7-f622-47bd-9a20-158d2b45bb7e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:53.718526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e198f7-f622-47bd-9a20-158d2b45bb7e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:53.724629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6889f-8dc8-48c9-be3b-a36bb82220cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:53.725313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6889f-8dc8-48c9-be3b-a36bb82220cf admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:53.725591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6889f-8dc8-48c9-be3b-a36bb82220cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:53.725861 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6889f-8dc8-48c9-be3b-a36bb82220cf admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:53.726642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6889f-8dc8-48c9-be3b-a36bb82220cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:53.728485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6889f-8dc8-48c9-be3b-a36bb82220cf admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:53.740002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1081/2149] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:53 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:53.744541 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e5e55-ffd7-4987-936b-b77f635c0318 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:53.753320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:53.757896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e5e55-ffd7-4987-936b-b77f635c0318 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:53.765044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073b777-953e-4192-a851-1ecd7d1ab879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:53.765894 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b777-953e-4192-a851-1ecd7d1ab879 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:53.766335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b777-953e-4192-a851-1ecd7d1ab879 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:53.766669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b777-953e-4192-a851-1ecd7d1ab879 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:53.767618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073b777-953e-4192-a851-1ecd7d1ab879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:53.769278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073b777-953e-4192-a851-1ecd7d1ab879 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:53.781502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1069/2150] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:53 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:54:53.786280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6889f-8dc8-48c9-be3b-a36bb82220cf admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:53.799315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6889f-8dc8-48c9-be3b-a36bb82220cf admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:53.805815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0fc45-1222-445f-b7b1-00c8d1bba526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:53.806769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0fc45-1222-445f-b7b1-00c8d1bba526 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:53.807027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0fc45-1222-445f-b7b1-00c8d1bba526 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:53.807288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0fc45-1222-445f-b7b1-00c8d1bba526 admin admin] PATH_INFO: `/v3/projects/d9f4aaa58a5b4292a26c462b13908fbe/users/9536c2d410aa44d2a26c7d8185981275/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:53.826574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0fc45-1222-445f-b7b1-00c8d1bba526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f4aaa58a5b4292a26c462b13908fbe, user_id=9536c2d410aa44d2a26c7d8185981275, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:53.829258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0fc45-1222-445f-b7b1-00c8d1bba526 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:53.854310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1082/2151] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:53 2022] PUT /identity/v3/projects/d9f4aaa58a5b4292a26c462b13908fbe/users/9536c2d410aa44d2a26c7d8185981275/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:53.865173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3e760-d513-462c-9046-bd10fdbe575f None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:53.865419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3e760-d513-462c-9046-bd10fdbe575f None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:53.865638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3e760-d513-462c-9046-bd10fdbe575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:53.902054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-bff3e760-d513-462c-9046-bd10fdbe575f None None] MFA Rules not processed for user `9536c2d410aa44d2a26c7d8185981275`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:53.903524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-bff3e760-d513-462c-9046-bd10fdbe575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:53.995732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1070/2152] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:54.001163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0fc45-1222-445f-b7b1-00c8d1bba526 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:54.081311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0fc45-1222-445f-b7b1-00c8d1bba526 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:54.087784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2bc9c-bbf3-43ba-96af-235a348af542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:54.088571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2bc9c-bbf3-43ba-96af-235a348af542 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:54.089503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2bc9c-bbf3-43ba-96af-235a348af542 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:54.090661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2bc9c-bbf3-43ba-96af-235a348af542 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:54.091601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2bc9c-bbf3-43ba-96af-235a348af542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:54.093923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2bc9c-bbf3-43ba-96af-235a348af542 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:54.116430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:54.161813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1083/2153] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:53 2022] POST /identity/v3/projects => generated 376 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:54.165858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3e760-d513-462c-9046-bd10fdbe575f None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:54.178746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3e760-d513-462c-9046-bd10fdbe575f None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:54.314346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631a049-c0fc-4735-aa04-e950995a93d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:54.315244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631a049-c0fc-4735-aa04-e950995a93d9 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:54.315667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631a049-c0fc-4735-aa04-e950995a93d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:54.316090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631a049-c0fc-4735-aa04-e950995a93d9 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:54.317055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631a049-c0fc-4735-aa04-e950995a93d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:54.319206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631a049-c0fc-4735-aa04-e950995a93d9 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:54.371051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1071/2154] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:54 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:54.376584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2bc9c-bbf3-43ba-96af-235a348af542 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:54.390448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2bc9c-bbf3-43ba-96af-235a348af542 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:54.409855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd301b-c2ce-444a-8e69-76c5e8bf18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:54.410582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd301b-c2ce-444a-8e69-76c5e8bf18cb admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:54.411508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd301b-c2ce-444a-8e69-76c5e8bf18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:54.411508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd301b-c2ce-444a-8e69-76c5e8bf18cb admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:54.412068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd301b-c2ce-444a-8e69-76c5e8bf18cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:54.413789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd301b-c2ce-444a-8e69-76c5e8bf18cb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:54.427483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1084/2155] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:54 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:54.431445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631a049-c0fc-4735-aa04-e950995a93d9 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:54.446310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631a049-c0fc-4735-aa04-e950995a93d9 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:54.452069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8c0b5-95b0-49f1-bca8-205d25d6d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:54.452766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c0b5-95b0-49f1-bca8-205d25d6d4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:54.453134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c0b5-95b0-49f1-bca8-205d25d6d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:54.453488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c0b5-95b0-49f1-bca8-205d25d6d4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:54.454264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8c0b5-95b0-49f1-bca8-205d25d6d4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:54.468319 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8c0b5-95b0-49f1-bca8-205d25d6d4e7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:54.483685 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1072/2156] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:54 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:54.487749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd301b-c2ce-444a-8e69-76c5e8bf18cb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:54.504303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd301b-c2ce-444a-8e69-76c5e8bf18cb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:54.511812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7588b1c-a9e9-4b58-84ce-a97b1c182e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:54.512505 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7588b1c-a9e9-4b58-84ce-a97b1c182e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:54.512782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7588b1c-a9e9-4b58-84ce-a97b1c182e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:54.513054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7588b1c-a9e9-4b58-84ce-a97b1c182e83 admin admin] PATH_INFO: `/v3/projects/4058a57f54864d968073d43d82924faa/users/564aae8236134f4990b7a340130e18c6/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:54.567705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7588b1c-a9e9-4b58-84ce-a97b1c182e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4058a57f54864d968073d43d82924faa, user_id=564aae8236134f4990b7a340130e18c6, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:54.569918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7588b1c-a9e9-4b58-84ce-a97b1c182e83 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:54.597802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1085/2157] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:54 2022] PUT /identity/v3/projects/4058a57f54864d968073d43d82924faa/users/564aae8236134f4990b7a340130e18c6/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:54.609116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce043f14-1b30-41e2-9dbb-b3d8608722ea None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:54.609495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce043f14-1b30-41e2-9dbb-b3d8608722ea None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:54.610261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce043f14-1b30-41e2-9dbb-b3d8608722ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:54.645840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ce043f14-1b30-41e2-9dbb-b3d8608722ea None None] MFA Rules not processed for user `564aae8236134f4990b7a340130e18c6`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:54.647119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ce043f14-1b30-41e2-9dbb-b3d8608722ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:54.722403 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:54.759942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1073/2158] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:54.764152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7588b1c-a9e9-4b58-84ce-a97b1c182e83 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:54.830809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7588b1c-a9e9-4b58-84ce-a97b1c182e83 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:54.836828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6dfaa-4f44-40ee-9eac-da7fbaa08c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:54.837544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6dfaa-4f44-40ee-9eac-da7fbaa08c2c admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:54.837933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6dfaa-4f44-40ee-9eac-da7fbaa08c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:54.838280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6dfaa-4f44-40ee-9eac-da7fbaa08c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:54.838998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6dfaa-4f44-40ee-9eac-da7fbaa08c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:54.840982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6dfaa-4f44-40ee-9eac-da7fbaa08c2c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:54.878113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1086/2159] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:54:54 2022] POST /identity/v3/projects => generated 378 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:54:54.879323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce043f14-1b30-41e2-9dbb-b3d8608722ea None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:54.891043 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce043f14-1b30-41e2-9dbb-b3d8608722ea None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:54.954192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99a12-63db-4a68-9592-b62c7e18a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:54.954860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99a12-63db-4a68-9592-b62c7e18a1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:54.955171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99a12-63db-4a68-9592-b62c7e18a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:54.955448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99a12-63db-4a68-9592-b62c7e18a1c8 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:54.956121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c99a12-63db-4a68-9592-b62c7e18a1c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:54.958059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c99a12-63db-4a68-9592-b62c7e18a1c8 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:54.981759 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1074/2160] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:54:54 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:54:54.986091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6dfaa-4f44-40ee-9eac-da7fbaa08c2c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:54.996877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6dfaa-4f44-40ee-9eac-da7fbaa08c2c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:55.002358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5be455-f5c0-442d-ad1d-9762f5cdb353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:55.003054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5be455-f5c0-442d-ad1d-9762f5cdb353 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:55.003366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5be455-f5c0-442d-ad1d-9762f5cdb353 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:55.003645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5be455-f5c0-442d-ad1d-9762f5cdb353 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:55.004456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5be455-f5c0-442d-ad1d-9762f5cdb353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:55.006335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5be455-f5c0-442d-ad1d-9762f5cdb353 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:55.021045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1087/2161] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:54 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:55.026317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99a12-63db-4a68-9592-b62c7e18a1c8 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:55.038180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99a12-63db-4a68-9592-b62c7e18a1c8 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:55.057119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abc5d2-1a58-4774-91ca-8dbba35d9c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:55.057839 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc5d2-1a58-4774-91ca-8dbba35d9c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:55.058118 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc5d2-1a58-4774-91ca-8dbba35d9c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:55.058392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc5d2-1a58-4774-91ca-8dbba35d9c25 admin admin] PATH_INFO: `/v3/projects/576ecee9e568480ebdf842a2a31cc277/users/4b8894645322428fa5de89480fdc3bc5/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:55.076165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abc5d2-1a58-4774-91ca-8dbba35d9c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576ecee9e568480ebdf842a2a31cc277, user_id=4b8894645322428fa5de89480fdc3bc5, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:55.078522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abc5d2-1a58-4774-91ca-8dbba35d9c25 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:55.118779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1075/2162] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:55 2022] PUT /identity/v3/projects/576ecee9e568480ebdf842a2a31cc277/users/4b8894645322428fa5de89480fdc3bc5/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:55.123466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5be455-f5c0-442d-ad1d-9762f5cdb353 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:55.139846 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5be455-f5c0-442d-ad1d-9762f5cdb353 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:55.232877 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520958c8-ec36-4f24-95e6-6029ca746ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:55.233844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520958c8-ec36-4f24-95e6-6029ca746ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:55.234272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520958c8-ec36-4f24-95e6-6029ca746ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:55.234691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520958c8-ec36-4f24-95e6-6029ca746ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:55.235782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520958c8-ec36-4f24-95e6-6029ca746ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:55.238429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520958c8-ec36-4f24-95e6-6029ca746ae2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:55.253283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1088/2163] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:54:55 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:54:55.257735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abc5d2-1a58-4774-91ca-8dbba35d9c25 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:55.270035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abc5d2-1a58-4774-91ca-8dbba35d9c25 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:55.275280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763e10-67d2-43a4-a592-1ecc93d1e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:55.276078 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763e10-67d2-43a4-a592-1ecc93d1e660 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:55.276382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763e10-67d2-43a4-a592-1ecc93d1e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:55.276660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763e10-67d2-43a4-a592-1ecc93d1e660 admin admin] PATH_INFO: `/v3/projects/576ecee9e568480ebdf842a2a31cc277/users/4b8894645322428fa5de89480fdc3bc5/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:55.285918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763e10-67d2-43a4-a592-1ecc93d1e660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576ecee9e568480ebdf842a2a31cc277, user_id=4b8894645322428fa5de89480fdc3bc5, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:55.288650 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763e10-67d2-43a4-a592-1ecc93d1e660 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:55.300599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1076/2164] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:54:55 2022] PUT /identity/v3/projects/576ecee9e568480ebdf842a2a31cc277/users/4b8894645322428fa5de89480fdc3bc5/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:54:55.376577 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c031-0581-4999-8c70-2d81d4cf12d3 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:55.377112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c031-0581-4999-8c70-2d81d4cf12d3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:55.377112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c031-0581-4999-8c70-2d81d4cf12d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:55.408254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-42b9c031-0581-4999-8c70-2d81d4cf12d3 None None] MFA Rules not processed for user `4b8894645322428fa5de89480fdc3bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:55.409467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-42b9c031-0581-4999-8c70-2d81d4cf12d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:55.430334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:55.492045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1089/2165] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:54:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:55.504279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763e10-67d2-43a4-a592-1ecc93d1e660 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:55.506119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-95763e10-67d2-43a4-a592-1ecc93d1e660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:55.577041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763e10-67d2-43a4-a592-1ecc93d1e660 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:55.581627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377623dd-4e7f-4466-9490-b22db4de2747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:55.582265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377623dd-4e7f-4466-9490-b22db4de2747 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:55.582550 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377623dd-4e7f-4466-9490-b22db4de2747 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:55.582826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377623dd-4e7f-4466-9490-b22db4de2747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:55.649260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377623dd-4e7f-4466-9490-b22db4de2747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:55.651579 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377623dd-4e7f-4466-9490-b22db4de2747 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:55.656616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:55.669656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1077/2166] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:57.401444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9c031-0581-4999-8c70-2d81d4cf12d3 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:57.413260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9c031-0581-4999-8c70-2d81d4cf12d3 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:57.423646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0c74a-7840-4432-b39f-27c5e4a6b760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:57.424443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c74a-7840-4432-b39f-27c5e4a6b760 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:57.424934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c74a-7840-4432-b39f-27c5e4a6b760 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:57.425396 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c74a-7840-4432-b39f-27c5e4a6b760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:57.553176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0c74a-7840-4432-b39f-27c5e4a6b760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:57.555233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0c74a-7840-4432-b39f-27c5e4a6b760 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:57.579290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1090/2167] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:58.281043 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377623dd-4e7f-4466-9490-b22db4de2747 service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:58.291410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377623dd-4e7f-4466-9490-b22db4de2747 service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:58.299400 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35812-9df2-4cda-a651-4d3da30e6e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:58.300037 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35812-9df2-4cda-a651-4d3da30e6e6f service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:58.300349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35812-9df2-4cda-a651-4d3da30e6e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:58.300625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35812-9df2-4cda-a651-4d3da30e6e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:58.312416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e35812-9df2-4cda-a651-4d3da30e6e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:58.316754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e35812-9df2-4cda-a651-4d3da30e6e6f service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:58.332729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1078/2168] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:00.570377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c98c53-3cfa-40bc-b4ea-a69a22164b17 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:00.572398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c98c53-3cfa-40bc-b4ea-a69a22164b17 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:00.573428 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c98c53-3cfa-40bc-b4ea-a69a22164b17 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:00.576618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1091/2169] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 16:55:00 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:00.584667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9d2d5-1c1e-4523-bb73-91d621a8a0d7 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:00.585873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9d2d5-1c1e-4523-bb73-91d621a8a0d7 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:00.586726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9d2d5-1c1e-4523-bb73-91d621a8a0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:00.612788 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-92b9d2d5-1c1e-4523-bb73-91d621a8a0d7 None None] MFA Rules not processed for user `6deeea314be545609b0fe4dd786b3b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:00.614266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-92b9d2d5-1c1e-4523-bb73-91d621a8a0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:00.704533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c98c53-3cfa-40bc-b4ea-a69a22164b17 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:00.707406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-90c98c53-3cfa-40bc-b4ea-a69a22164b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:00.735062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1079/2170] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 16:55:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:00.754638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9d2d5-1c1e-4523-bb73-91d621a8a0d7 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:00.757491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-92b9d2d5-1c1e-4523-bb73-91d621a8a0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:00.777249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9d2d5-1c1e-4523-bb73-91d621a8a0d7 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:00.783090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ee34f-7671-45bf-963c-7d4b83c35b4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:00.783975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ee34f-7671-45bf-963c-7d4b83c35b4d service placement] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:00.784564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ee34f-7671-45bf-963c-7d4b83c35b4d service placement] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:00.784974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ee34f-7671-45bf-963c-7d4b83c35b4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:00.797443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ee34f-7671-45bf-963c-7d4b83c35b4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:00.799431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ee34f-7671-45bf-963c-7d4b83c35b4d service placement] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:00.817854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c98c53-3cfa-40bc-b4ea-a69a22164b17 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:00.823196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1080/2171] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:00.823562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba52776-9262-4004-9941-04d825cd89cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:00.824220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba52776-9262-4004-9941-04d825cd89cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:00.824650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba52776-9262-4004-9941-04d825cd89cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:00.825981 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba52776-9262-4004-9941-04d825cd89cd admin admin] PATH_INFO: `/v3/users/61cdaecc25284225bb05bf978fe037bb` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:00.827543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba52776-9262-4004-9941-04d825cd89cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=61cdaecc25284225bb05bf978fe037bb)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:00.829635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba52776-9262-4004-9941-04d825cd89cd admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:00.883749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-cba52776-9262-4004-9941-04d825cd89cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61cdaecc25284225bb05bf978fe037bb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:00.893226 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-cba52776-9262-4004-9941-04d825cd89cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61cdaecc25284225bb05bf978fe037bb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:00.894579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:00.902724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-cba52776-9262-4004-9941-04d825cd89cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61cdaecc25284225bb05bf978fe037bb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:00.904022 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-cba52776-9262-4004-9941-04d825cd89cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61cdaecc25284225bb05bf978fe037bb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:00.904766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-cba52776-9262-4004-9941-04d825cd89cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61cdaecc25284225bb05bf978fe037bb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:00.933167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1092/2172] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:55:00 2022] DELETE /identity/v3/users/61cdaecc25284225bb05bf978fe037bb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:55:01.260621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ee34f-7671-45bf-963c-7d4b83c35b4d service placement] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:01.274095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ee34f-7671-45bf-963c-7d4b83c35b4d service placement] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:01.388824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:01.389506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:01.389953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:01.390237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] PATH_INFO: `/v3/projects/217c7ddebb90443d992223bcb4e2173f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:01.392473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] RBAC: Authorizing `identity:delete_project(project_id=217c7ddebb90443d992223bcb4e2173f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:01.394569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:01.477554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217c7ddebb90443d992223bcb4e2173f', 'request_id': 'req-029923d4-8f3b-4f58-809f-238362f7876d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:01.500323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217c7ddebb90443d992223bcb4e2173f', 'request_id': 'req-029923d4-8f3b-4f58-809f-238362f7876d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:01.516182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217c7ddebb90443d992223bcb4e2173f', 'request_id': 'req-029923d4-8f3b-4f58-809f-238362f7876d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:01.537770 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:01.545005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] The token cache is being invalidate because project 217c7ddebb90443d992223bcb4e2173f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:55:01.545754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:01.546857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-029923d4-8f3b-4f58-809f-238362f7876d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:01.549603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1081/2173] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:55:01 2022] DELETE /identity/v3/projects/217c7ddebb90443d992223bcb4e2173f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:01.555714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3578fc-de08-4962-962b-a21c43c829bb None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:01.555714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3578fc-de08-4962-962b-a21c43c829bb None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:01.555966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3578fc-de08-4962-962b-a21c43c829bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:01.602484 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-1a3578fc-de08-4962-962b-a21c43c829bb None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:01.603944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1a3578fc-de08-4962-962b-a21c43c829bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:01.689134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1093/2174] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:01.697180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a146c9-4ab3-4982-bcb6-30e5a7cf8bbd None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:01.698053 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a146c9-4ab3-4982-bcb6-30e5a7cf8bbd None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:01.699248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a146c9-4ab3-4982-bcb6-30e5a7cf8bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:01.723596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-10a146c9-4ab3-4982-bcb6-30e5a7cf8bbd None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:01.724825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-10a146c9-4ab3-4982-bcb6-30e5a7cf8bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:01.735370 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1082/2175] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:01.739596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3578fc-de08-4962-962b-a21c43c829bb None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:01.757293 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3578fc-de08-4962-962b-a21c43c829bb None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:01.767333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5732063-ae5b-4514-8844-ab09af8f9f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:01.768282 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732063-ae5b-4514-8844-ab09af8f9f42 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:01.768700 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732063-ae5b-4514-8844-ab09af8f9f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:01.769368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732063-ae5b-4514-8844-ab09af8f9f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:01.770268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5732063-ae5b-4514-8844-ab09af8f9f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:55:01.770832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5732063-ae5b-4514-8844-ab09af8f9f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:01.776423 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5732063-ae5b-4514-8844-ab09af8f9f42 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:01.793574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1094/2176] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:55:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:55:01.794771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a146c9-4ab3-4982-bcb6-30e5a7cf8bbd None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:01.814968 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a146c9-4ab3-4982-bcb6-30e5a7cf8bbd None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:01.823145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df0c0-5f44-4663-9285-5e326d1a36a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:01.824052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df0c0-5f44-4663-9285-5e326d1a36a6 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:01.824478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df0c0-5f44-4663-9285-5e326d1a36a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:01.824908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df0c0-5f44-4663-9285-5e326d1a36a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:01.825717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0df0c0-5f44-4663-9285-5e326d1a36a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:01.828643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0df0c0-5f44-4663-9285-5e326d1a36a6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:01.858458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1083/2177] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:55:01 2022] POST /identity/v3/projects => generated 374 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:01.863070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5732063-ae5b-4514-8844-ab09af8f9f42 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:01.873335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5732063-ae5b-4514-8844-ab09af8f9f42 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:01.935221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b63237-448b-49b5-9cea-ffaebe62500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:01.935863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63237-448b-49b5-9cea-ffaebe62500a admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:01.936139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63237-448b-49b5-9cea-ffaebe62500a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:01.936408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63237-448b-49b5-9cea-ffaebe62500a admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:01.937081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b63237-448b-49b5-9cea-ffaebe62500a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:01.939016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b63237-448b-49b5-9cea-ffaebe62500a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:01.962847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1095/2178] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:55:01 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:01.967255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df0c0-5f44-4663-9285-5e326d1a36a6 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:01.980477 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df0c0-5f44-4663-9285-5e326d1a36a6 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:01.985986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587a8e-b4d4-4327-ba14-081e3fb4b769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:01.986598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587a8e-b4d4-4327-ba14-081e3fb4b769 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:01.986907 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587a8e-b4d4-4327-ba14-081e3fb4b769 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:01.987213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587a8e-b4d4-4327-ba14-081e3fb4b769 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:01.987928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0587a8e-b4d4-4327-ba14-081e3fb4b769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:01.989546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0587a8e-b4d4-4327-ba14-081e3fb4b769 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:02.001597 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1084/2179] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:01 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:02.006389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b63237-448b-49b5-9cea-ffaebe62500a admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:02.017620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b63237-448b-49b5-9cea-ffaebe62500a admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:02.022609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc2044-ee4f-4ceb-ae99-e13abbf53b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:02.023303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc2044-ee4f-4ceb-ae99-e13abbf53b01 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:02.023585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc2044-ee4f-4ceb-ae99-e13abbf53b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:02.023862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc2044-ee4f-4ceb-ae99-e13abbf53b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:02.024594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc2044-ee4f-4ceb-ae99-e13abbf53b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:02.026203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc2044-ee4f-4ceb-ae99-e13abbf53b01 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:02.037843 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1096/2180] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:02 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:55:02.042505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587a8e-b4d4-4327-ba14-081e3fb4b769 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:02.053186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587a8e-b4d4-4327-ba14-081e3fb4b769 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:02.058144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a98c61-cd03-4a68-9b98-0cc77004e8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:02.058814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a98c61-cd03-4a68-9b98-0cc77004e8f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:02.059134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a98c61-cd03-4a68-9b98-0cc77004e8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:02.059419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a98c61-cd03-4a68-9b98-0cc77004e8f6 admin admin] PATH_INFO: `/v3/projects/4e4ad9328a274e46a74d1290a96f5365/users/5fdc45ea97934eecb436be2f270aa668/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:02.076607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a98c61-cd03-4a68-9b98-0cc77004e8f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4ad9328a274e46a74d1290a96f5365, user_id=5fdc45ea97934eecb436be2f270aa668, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:02.079415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a98c61-cd03-4a68-9b98-0cc77004e8f6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:02.099984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1085/2181] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:02 2022] PUT /identity/v3/projects/4e4ad9328a274e46a74d1290a96f5365/users/5fdc45ea97934eecb436be2f270aa668/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:55:02.112358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1d25-5b7d-41f2-a579-7696b65be2e7 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:02.112675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1d25-5b7d-41f2-a579-7696b65be2e7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:02.113042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1d25-5b7d-41f2-a579-7696b65be2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:02.149244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-e75a1d25-5b7d-41f2-a579-7696b65be2e7 None None] MFA Rules not processed for user `5fdc45ea97934eecb436be2f270aa668`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:02.150563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e75a1d25-5b7d-41f2-a579-7696b65be2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:02.182880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:02.224735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1097/2182] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:02.237688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a98c61-cd03-4a68-9b98-0cc77004e8f6 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:02.239868 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a7a98c61-cd03-4a68-9b98-0cc77004e8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:02.322040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a98c61-cd03-4a68-9b98-0cc77004e8f6 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:02.331977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4f3e2-ac79-44fd-b6d6-fa99876f52b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:02.332624 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f3e2-ac79-44fd-b6d6-fa99876f52b9 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:02.332910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f3e2-ac79-44fd-b6d6-fa99876f52b9 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:02.333173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f3e2-ac79-44fd-b6d6-fa99876f52b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:02.345373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4f3e2-ac79-44fd-b6d6-fa99876f52b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:02.347051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4f3e2-ac79-44fd-b6d6-fa99876f52b9 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:02.359102 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1086/2183] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:02.642030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1d25-5b7d-41f2-a579-7696b65be2e7 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:02.644487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e75a1d25-5b7d-41f2-a579-7696b65be2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:02.741389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1d25-5b7d-41f2-a579-7696b65be2e7 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:02.763330 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:02.765005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:02.767275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:02.767563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] PATH_INFO: `/v3/users/9536c2d410aa44d2a26c7d8185981275` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:02.773422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9536c2d410aa44d2a26c7d8185981275)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:02.775898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:02.843035 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9536c2d410aa44d2a26c7d8185981275'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:02.858626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9536c2d410aa44d2a26c7d8185981275'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:02.869760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9536c2d410aa44d2a26c7d8185981275'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:02.871024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9536c2d410aa44d2a26c7d8185981275'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:02.871868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9536c2d410aa44d2a26c7d8185981275'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:02.919361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1098/2184] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:55:02 2022] DELETE /identity/v3/users/9536c2d410aa44d2a26c7d8185981275 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:02.920066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08335ce7-7120-462d-a148-0a5ff855fd8e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:02.920572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08335ce7-7120-462d-a148-0a5ff855fd8e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:02.920662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08335ce7-7120-462d-a148-0a5ff855fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:02.952608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-08335ce7-7120-462d-a148-0a5ff855fd8e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:02.953881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-08335ce7-7120-462d-a148-0a5ff855fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:03.034758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1087/2185] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:03.063018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:03.064453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:03.138474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:03.146578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c640f49-d406-4d66-bd6e-d620d353bc39 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:03.152282 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a0916-fad1-4145-9e21-12f7dae1d8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:03.156469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a0916-fad1-4145-9e21-12f7dae1d8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:03.156469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a0916-fad1-4145-9e21-12f7dae1d8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:03.156469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a0916-fad1-4145-9e21-12f7dae1d8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:03.173594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a0916-fad1-4145-9e21-12f7dae1d8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:03.176710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a0916-fad1-4145-9e21-12f7dae1d8f4 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:03.191870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1099/2186] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:03.508388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08335ce7-7120-462d-a148-0a5ff855fd8e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:03.510269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-08335ce7-7120-462d-a148-0a5ff855fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:03.529984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08335ce7-7120-462d-a148-0a5ff855fd8e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:03.535594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:03.536556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:03.536832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:03.537341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] PATH_INFO: `/v3/projects/d9f4aaa58a5b4292a26c462b13908fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:03.538737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f4aaa58a5b4292a26c462b13908fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:03.541187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:03.560518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:03.601120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f4aaa58a5b4292a26c462b13908fbe', 'request_id': 'req-e1dc956e-e65c-4139-b662-31d9904dc0f2'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:03.607957 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f4aaa58a5b4292a26c462b13908fbe', 'request_id': 'req-e1dc956e-e65c-4139-b662-31d9904dc0f2'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:03.614456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f4aaa58a5b4292a26c462b13908fbe', 'request_id': 'req-e1dc956e-e65c-4139-b662-31d9904dc0f2'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:03.630023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] The token cache is being invalidate because project d9f4aaa58a5b4292a26c462b13908fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:55:03.630286 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:03.630915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:03.632652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1088/2187] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:55:03 2022] DELETE /identity/v3/projects/d9f4aaa58a5b4292a26c462b13908fbe => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:03.639192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a0916-fad1-4145-9e21-12f7dae1d8f4 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:03.655148 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a0916-fad1-4145-9e21-12f7dae1d8f4 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:03.721031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:03.721688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:03.721974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:03.722248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] PATH_INFO: `/v3/users/564aae8236134f4990b7a340130e18c6` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:03.723540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=564aae8236134f4990b7a340130e18c6)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:03.725534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:03.782578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564aae8236134f4990b7a340130e18c6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:03.793941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564aae8236134f4990b7a340130e18c6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:03.801791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564aae8236134f4990b7a340130e18c6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:03.802525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564aae8236134f4990b7a340130e18c6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:03.803405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564aae8236134f4990b7a340130e18c6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:03.821064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1100/2188] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:55:03 2022] DELETE /identity/v3/users/564aae8236134f4990b7a340130e18c6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:04.294571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:04.296243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:04.313865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc956e-e65c-4139-b662-31d9904dc0f2 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:04.382386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:04.383068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:04.383311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:04.383618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] PATH_INFO: `/v3/projects/4058a57f54864d968073d43d82924faa` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:04.384917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4058a57f54864d968073d43d82924faa)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:04.386786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:04.450280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4058a57f54864d968073d43d82924faa', 'request_id': 'req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:04.456627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4058a57f54864d968073d43d82924faa', 'request_id': 'req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:04.463090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4058a57f54864d968073d43d82924faa', 'request_id': 'req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:04.478890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] The token cache is being invalidate because project 4058a57f54864d968073d43d82924faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:55:04.479431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:04.480099 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:04.481805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1089/2189] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:55:04 2022] DELETE /identity/v3/projects/4058a57f54864d968073d43d82924faa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:04.486507 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:04.488438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:04.519752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa684-e633-4291-8aa2-41120aa9c56f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:04.587654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a69d7-9ea5-4338-991f-ae0650e86350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:04.588678 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a69d7-9ea5-4338-991f-ae0650e86350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:04.588951 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a69d7-9ea5-4338-991f-ae0650e86350 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:04.589252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a69d7-9ea5-4338-991f-ae0650e86350 admin admin] PATH_INFO: `/v3/users/4b8894645322428fa5de89480fdc3bc5` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:04.590549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a69d7-9ea5-4338-991f-ae0650e86350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b8894645322428fa5de89480fdc3bc5)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:04.592684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a69d7-9ea5-4338-991f-ae0650e86350 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:04.604109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:04.646112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-512a69d7-9ea5-4338-991f-ae0650e86350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b8894645322428fa5de89480fdc3bc5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:04.657236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-512a69d7-9ea5-4338-991f-ae0650e86350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b8894645322428fa5de89480fdc3bc5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:04.665172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-512a69d7-9ea5-4338-991f-ae0650e86350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b8894645322428fa5de89480fdc3bc5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:04.666146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-512a69d7-9ea5-4338-991f-ae0650e86350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b8894645322428fa5de89480fdc3bc5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:04.666867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-512a69d7-9ea5-4338-991f-ae0650e86350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b8894645322428fa5de89480fdc3bc5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:04.686142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1101/2190] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:55:04 2022] DELETE /identity/v3/users/4b8894645322428fa5de89480fdc3bc5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:04.983367 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:04.984823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:04.999710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ce767-eb8d-4dc8-a0e8-39fbd00ca321 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:05.045277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:05.082236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:05.083232 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.083613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.084028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] PATH_INFO: `/v3/projects/576ecee9e568480ebdf842a2a31cc277` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.085800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] RBAC: Authorizing `identity:delete_project(project_id=576ecee9e568480ebdf842a2a31cc277)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:05.088208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:05.142542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576ecee9e568480ebdf842a2a31cc277', 'request_id': 'req-dea05f76-a1bc-40c1-b85f-1aec3075993a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:05.155892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576ecee9e568480ebdf842a2a31cc277', 'request_id': 'req-dea05f76-a1bc-40c1-b85f-1aec3075993a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:05.167893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576ecee9e568480ebdf842a2a31cc277', 'request_id': 'req-dea05f76-a1bc-40c1-b85f-1aec3075993a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:05.181603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] The token cache is being invalidate because project 576ecee9e568480ebdf842a2a31cc277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:55:05.181997 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:05.182542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dea05f76-a1bc-40c1-b85f-1aec3075993a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:05.184114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1090/2191] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:55:04 2022] DELETE /identity/v3/projects/576ecee9e568480ebdf842a2a31cc277 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:05.190284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33331d1-7f34-41e6-b81e-ce1791c82e23 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.190568 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33331d1-7f34-41e6-b81e-ce1791c82e23 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.190867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33331d1-7f34-41e6-b81e-ce1791c82e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.216277 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-d33331d1-7f34-41e6-b81e-ce1791c82e23 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:05.217670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d33331d1-7f34-41e6-b81e-ce1791c82e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:05.307048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1102/2192] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:05.314977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623553ad-5e1e-4a69-8266-f11d85b13a32 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.315503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623553ad-5e1e-4a69-8266-f11d85b13a32 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.315607 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623553ad-5e1e-4a69-8266-f11d85b13a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.342873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-623553ad-5e1e-4a69-8266-f11d85b13a32 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:05.344310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-623553ad-5e1e-4a69-8266-f11d85b13a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:05.354913 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1091/2193] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:05.360007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33331d1-7f34-41e6-b81e-ce1791c82e23 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:05.373810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33331d1-7f34-41e6-b81e-ce1791c82e23 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:05.376231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623553ad-5e1e-4a69-8266-f11d85b13a32 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:05.377838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-623553ad-5e1e-4a69-8266-f11d85b13a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:05.379344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd620d1-7ef3-4b46-8975-2ff0dd15b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:05.379988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd620d1-7ef3-4b46-8975-2ff0dd15b3af admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.380265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd620d1-7ef3-4b46-8975-2ff0dd15b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.380535 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd620d1-7ef3-4b46-8975-2ff0dd15b3af admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.381252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd620d1-7ef3-4b46-8975-2ff0dd15b3af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:55:05.381548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd620d1-7ef3-4b46-8975-2ff0dd15b3af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:05.383171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd620d1-7ef3-4b46-8975-2ff0dd15b3af admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:05.394004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623553ad-5e1e-4a69-8266-f11d85b13a32 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:05.407178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214da13-0536-4aca-833c-0208958ffc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:05.407178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214da13-0536-4aca-833c-0208958ffc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.407178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214da13-0536-4aca-833c-0208958ffc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.407178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214da13-0536-4aca-833c-0208958ffc8c admin admin] PATH_INFO: `/v3/users/5fdc45ea97934eecb436be2f270aa668` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.407487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214da13-0536-4aca-833c-0208958ffc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fdc45ea97934eecb436be2f270aa668)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:05.407650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1103/2194] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:55:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:55:05.407728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214da13-0536-4aca-833c-0208958ffc8c admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:05.409132 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd620d1-7ef3-4b46-8975-2ff0dd15b3af admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:05.420099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd620d1-7ef3-4b46-8975-2ff0dd15b3af admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:05.424982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695cd75-9a4e-491e-9f20-334ea39e2b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:05.425604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695cd75-9a4e-491e-9f20-334ea39e2b6d admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.425873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695cd75-9a4e-491e-9f20-334ea39e2b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.426148 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695cd75-9a4e-491e-9f20-334ea39e2b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.426824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695cd75-9a4e-491e-9f20-334ea39e2b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:05.428762 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695cd75-9a4e-491e-9f20-334ea39e2b6d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:05.459058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3214da13-0536-4aca-833c-0208958ffc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fdc45ea97934eecb436be2f270aa668'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:05.459875 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3214da13-0536-4aca-833c-0208958ffc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fdc45ea97934eecb436be2f270aa668'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:05.472013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1104/2195] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:55:05 2022] POST /identity/v3/projects => generated 386 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:55:05.475202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3214da13-0536-4aca-833c-0208958ffc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fdc45ea97934eecb436be2f270aa668'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:05.475969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3214da13-0536-4aca-833c-0208958ffc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fdc45ea97934eecb436be2f270aa668'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:05.476385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695cd75-9a4e-491e-9f20-334ea39e2b6d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:05.478320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9695cd75-9a4e-491e-9f20-334ea39e2b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:05.483717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3214da13-0536-4aca-833c-0208958ffc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fdc45ea97934eecb436be2f270aa668'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:05.499758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1092/2196] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:55:05 2022] DELETE /identity/v3/users/5fdc45ea97934eecb436be2f270aa668 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:55:05.504466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0b414-84dc-41b5-b84a-7ebbfcd523ce None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.504758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0b414-84dc-41b5-b84a-7ebbfcd523ce None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.505040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0b414-84dc-41b5-b84a-7ebbfcd523ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.525504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-18a0b414-84dc-41b5-b84a-7ebbfcd523ce None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:05.527138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-18a0b414-84dc-41b5-b84a-7ebbfcd523ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:05.541115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:05.552554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:05.558769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695cd75-9a4e-491e-9f20-334ea39e2b6d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:05.603028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1093/2197] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:05.611214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0b414-84dc-41b5-b84a-7ebbfcd523ce None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:05.612786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-18a0b414-84dc-41b5-b84a-7ebbfcd523ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:05.628006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef702f-de02-4940-9a84-ce8eb7a02f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:05.628645 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef702f-de02-4940-9a84-ce8eb7a02f57 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.628954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef702f-de02-4940-9a84-ce8eb7a02f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.629226 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef702f-de02-4940-9a84-ce8eb7a02f57 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.629903 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef702f-de02-4940-9a84-ce8eb7a02f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:05.631914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef702f-de02-4940-9a84-ce8eb7a02f57 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:05.658719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1105/2198] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:55:05 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:55:05.659918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef702f-de02-4940-9a84-ce8eb7a02f57 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:05.670399 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef702f-de02-4940-9a84-ce8eb7a02f57 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:05.680376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abc234-c15e-439b-aa8a-a818a5170e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:05.681316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc234-c15e-439b-aa8a-a818a5170e1f admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.681731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc234-c15e-439b-aa8a-a818a5170e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.682017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc234-c15e-439b-aa8a-a818a5170e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.682812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abc234-c15e-439b-aa8a-a818a5170e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:05.684547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abc234-c15e-439b-aa8a-a818a5170e1f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:05.693708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0b414-84dc-41b5-b84a-7ebbfcd523ce None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:05.696123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1106/2199] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:05 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:55:05.699603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cae057-7ce5-4e17-87f1-493e83f4b8cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:05.700139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abc234-c15e-439b-aa8a-a818a5170e1f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:05.700260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cae057-7ce5-4e17-87f1-493e83f4b8cd service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.700590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cae057-7ce5-4e17-87f1-493e83f4b8cd service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.700850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cae057-7ce5-4e17-87f1-493e83f4b8cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.711316 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cae057-7ce5-4e17-87f1-493e83f4b8cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:05.711519 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abc234-c15e-439b-aa8a-a818a5170e1f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:05.713025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cae057-7ce5-4e17-87f1-493e83f4b8cd service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:05.717085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177bc82-b4fc-4fee-b979-b17013e76be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:05.717846 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177bc82-b4fc-4fee-b979-b17013e76be2 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.719082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177bc82-b4fc-4fee-b979-b17013e76be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.719082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177bc82-b4fc-4fee-b979-b17013e76be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.719279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177bc82-b4fc-4fee-b979-b17013e76be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:05.720739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177bc82-b4fc-4fee-b979-b17013e76be2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:05.735599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1107/2200] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:05 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:05.735803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1094/2201] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:55:05.736617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177bc82-b4fc-4fee-b979-b17013e76be2 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:05.747130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177bc82-b4fc-4fee-b979-b17013e76be2 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:05.752059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03789f56-e05e-4438-8114-9a45226292b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:05.752758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03789f56-e05e-4438-8114-9a45226292b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.753742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03789f56-e05e-4438-8114-9a45226292b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.753742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03789f56-e05e-4438-8114-9a45226292b2 admin admin] PATH_INFO: `/v3/projects/bf2a138fb08a43d0a276e65bb5062418/users/2553fc4bd29e4a1781b462301ade53ce/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.771011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03789f56-e05e-4438-8114-9a45226292b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2a138fb08a43d0a276e65bb5062418, user_id=2553fc4bd29e4a1781b462301ade53ce, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:05.773543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03789f56-e05e-4438-8114-9a45226292b2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:05.792813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1108/2202] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:05 2022] PUT /identity/v3/projects/bf2a138fb08a43d0a276e65bb5062418/users/2553fc4bd29e4a1781b462301ade53ce/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:55:05.804413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb17e-7ff3-4ea2-b389-08df89b6467f None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.804711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb17e-7ff3-4ea2-b389-08df89b6467f None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.804975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb17e-7ff3-4ea2-b389-08df89b6467f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:05.839589 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-3f2eb17e-7ff3-4ea2-b389-08df89b6467f None None] MFA Rules not processed for user `2553fc4bd29e4a1781b462301ade53ce`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:05.840928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3f2eb17e-7ff3-4ea2-b389-08df89b6467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:05.916164 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1095/2203] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:05.928738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03789f56-e05e-4438-8114-9a45226292b2 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:05.930533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-03789f56-e05e-4438-8114-9a45226292b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:05.993566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03789f56-e05e-4438-8114-9a45226292b2 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:05.997517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fcd1d-b9bb-41d2-8b69-a7f1bf5538b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:05.998196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fcd1d-b9bb-41d2-8b69-a7f1bf5538b1 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:05.998473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fcd1d-b9bb-41d2-8b69-a7f1bf5538b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:05.998746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fcd1d-b9bb-41d2-8b69-a7f1bf5538b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.008149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fcd1d-b9bb-41d2-8b69-a7f1bf5538b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:06.009715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fcd1d-b9bb-41d2-8b69-a7f1bf5538b1 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:06.020600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1109/2204] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:06.037046 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eb17e-7ff3-4ea2-b389-08df89b6467f None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:06.039750 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3f2eb17e-7ff3-4ea2-b389-08df89b6467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:06.134553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eb17e-7ff3-4ea2-b389-08df89b6467f None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:06.140001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:06.141355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.141798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.142117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] PATH_INFO: `/v3/projects/4e4ad9328a274e46a74d1290a96f5365` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.143371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4ad9328a274e46a74d1290a96f5365)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:06.145302 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:06.148628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:06.204324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4ad9328a274e46a74d1290a96f5365', 'request_id': 'req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:06.211816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4ad9328a274e46a74d1290a96f5365', 'request_id': 'req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:06.218490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4ad9328a274e46a74d1290a96f5365', 'request_id': 'req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:06.234175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] The token cache is being invalidate because project 4e4ad9328a274e46a74d1290a96f5365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:55:06.234576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:06.235335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-858c0b4a-5a8b-436c-bf69-0f9bcede3b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:06.236868 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1096/2205] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:55:06 2022] DELETE /identity/v3/projects/4e4ad9328a274e46a74d1290a96f5365 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:55:06.243673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b1c9-2583-4a15-a64a-b35a623a1730 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.243986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b1c9-2583-4a15-a64a-b35a623a1730 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.244234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b1c9-2583-4a15-a64a-b35a623a1730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.265276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-0404b1c9-2583-4a15-a64a-b35a623a1730 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:06.267018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0404b1c9-2583-4a15-a64a-b35a623a1730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:06.331187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:06.355268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1110/2206] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:06.364631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84609a-a5e6-430b-bcf2-fdd4f387b3f4 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.365245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84609a-a5e6-430b-bcf2-fdd4f387b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.365245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84609a-a5e6-430b-bcf2-fdd4f387b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.400293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-df84609a-a5e6-430b-bcf2-fdd4f387b3f4 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:06.401653 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-df84609a-a5e6-430b-bcf2-fdd4f387b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:06.411031 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1097/2207] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:06.416341 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404b1c9-2583-4a15-a64a-b35a623a1730 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:06.433503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404b1c9-2583-4a15-a64a-b35a623a1730 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:06.440653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12374bc1-6a2f-4c34-b748-e1d91135f25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:06.441372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12374bc1-6a2f-4c34-b748-e1d91135f25f admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.441723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12374bc1-6a2f-4c34-b748-e1d91135f25f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.442087 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12374bc1-6a2f-4c34-b748-e1d91135f25f admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.442874 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12374bc1-6a2f-4c34-b748-e1d91135f25f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:55:06.443275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12374bc1-6a2f-4c34-b748-e1d91135f25f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:06.444972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12374bc1-6a2f-4c34-b748-e1d91135f25f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:06.466613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1111/2208] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:55:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:55:06.471438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84609a-a5e6-430b-bcf2-fdd4f387b3f4 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:06.482350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84609a-a5e6-430b-bcf2-fdd4f387b3f4 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:06.487464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee320d-a84d-41d0-a0d5-bd8e3c5fe6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:06.488171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee320d-a84d-41d0-a0d5-bd8e3c5fe6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.488658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee320d-a84d-41d0-a0d5-bd8e3c5fe6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.489029 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee320d-a84d-41d0-a0d5-bd8e3c5fe6e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.489773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee320d-a84d-41d0-a0d5-bd8e3c5fe6e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:06.491780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee320d-a84d-41d0-a0d5-bd8e3c5fe6e9 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:06.542766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1098/2209] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:55:06 2022] POST /identity/v3/projects => generated 404 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:06.544210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12374bc1-6a2f-4c34-b748-e1d91135f25f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:06.555845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12374bc1-6a2f-4c34-b748-e1d91135f25f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:06.620358 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e88295-8f5d-4968-9f8f-d8846efc4509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:06.620982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e88295-8f5d-4968-9f8f-d8846efc4509 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.621263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e88295-8f5d-4968-9f8f-d8846efc4509 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.621541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e88295-8f5d-4968-9f8f-d8846efc4509 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.622237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e88295-8f5d-4968-9f8f-d8846efc4509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:06.624204 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e88295-8f5d-4968-9f8f-d8846efc4509 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:06.647895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1112/2210] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:55:06 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:06.653824 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee320d-a84d-41d0-a0d5-bd8e3c5fe6e9 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:06.672255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee320d-a84d-41d0-a0d5-bd8e3c5fe6e9 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:06.673620 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a846b5-c3ea-4197-a097-aeedc98514b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:06.674670 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a846b5-c3ea-4197-a097-aeedc98514b6 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.674670 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a846b5-c3ea-4197-a097-aeedc98514b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.679647 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a846b5-c3ea-4197-a097-aeedc98514b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.679647 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a846b5-c3ea-4197-a097-aeedc98514b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:06.679647 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a846b5-c3ea-4197-a097-aeedc98514b6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:06.688210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1099/2211] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:06 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:55:06.694089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e88295-8f5d-4968-9f8f-d8846efc4509 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:06.706369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e88295-8f5d-4968-9f8f-d8846efc4509 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:06.715848 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57398347-5dc0-4149-b1e1-a7f1e36969ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:06.716801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57398347-5dc0-4149-b1e1-a7f1e36969ad admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.717003 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57398347-5dc0-4149-b1e1-a7f1e36969ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.717331 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57398347-5dc0-4149-b1e1-a7f1e36969ad admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.718408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57398347-5dc0-4149-b1e1-a7f1e36969ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:06.720944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57398347-5dc0-4149-b1e1-a7f1e36969ad admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:06.736899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1113/2212] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:06 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:06.742288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a846b5-c3ea-4197-a097-aeedc98514b6 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:06.757044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a846b5-c3ea-4197-a097-aeedc98514b6 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:06.762887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82442b73-a276-4d5e-958a-39282f390b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:06.763536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82442b73-a276-4d5e-958a-39282f390b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.763820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82442b73-a276-4d5e-958a-39282f390b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.764097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82442b73-a276-4d5e-958a-39282f390b1e admin admin] PATH_INFO: `/v3/projects/7000cdd4b0d04f769888cf94d6c3e1ce/users/036d47e99a184054bb819d9cf707f957/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.779238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82442b73-a276-4d5e-958a-39282f390b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7000cdd4b0d04f769888cf94d6c3e1ce, user_id=036d47e99a184054bb819d9cf707f957, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:06.782033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82442b73-a276-4d5e-958a-39282f390b1e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:06.802191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1100/2213] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:06 2022] PUT /identity/v3/projects/7000cdd4b0d04f769888cf94d6c3e1ce/users/036d47e99a184054bb819d9cf707f957/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:55:06.803977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3de1e7-ee6f-460c-810c-2fc7bd92c02b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.804267 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3de1e7-ee6f-460c-810c-2fc7bd92c02b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.804594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3de1e7-ee6f-460c-810c-2fc7bd92c02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.825893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-1d3de1e7-ee6f-460c-810c-2fc7bd92c02b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:06.828014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1d3de1e7-ee6f-460c-810c-2fc7bd92c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:06.890859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1114/2214] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:06.901231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82442b73-a276-4d5e-958a-39282f390b1e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:06.904501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-82442b73-a276-4d5e-958a-39282f390b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:06.967495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82442b73-a276-4d5e-958a-39282f390b1e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:06.971318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b869d-feec-46c7-ba47-171c8470a2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:06.971945 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b869d-feec-46c7-ba47-171c8470a2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.972221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b869d-feec-46c7-ba47-171c8470a2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.972489 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b869d-feec-46c7-ba47-171c8470a2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.982469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b869d-feec-46c7-ba47-171c8470a2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:06.984074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b869d-feec-46c7-ba47-171c8470a2b9 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:06.995569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1101/2215] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:07.852160 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12e376-e1c6-4c0f-b625-018632c25ed5 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:07.852676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12e376-e1c6-4c0f-b625-018632c25ed5 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:07.852783 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12e376-e1c6-4c0f-b625-018632c25ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:07.882657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-cd12e376-e1c6-4c0f-b625-018632c25ed5 None None] MFA Rules not processed for user `036d47e99a184054bb819d9cf707f957`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:07.883938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-cd12e376-e1c6-4c0f-b625-018632c25ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:07.927448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:07.956683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1115/2216] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:07.961611 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b869d-feec-46c7-ba47-171c8470a2b9 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:07.972142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b869d-feec-46c7-ba47-171c8470a2b9 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:07.977142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408eac2-0b03-4591-b43b-bd000a5b5f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:07.977753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408eac2-0b03-4591-b43b-bd000a5b5f50 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:07.978041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408eac2-0b03-4591-b43b-bd000a5b5f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:07.978504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408eac2-0b03-4591-b43b-bd000a5b5f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:07.979598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408eac2-0b03-4591-b43b-bd000a5b5f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:07.981709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408eac2-0b03-4591-b43b-bd000a5b5f50 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:08.015975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1102/2217] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:55:07 2022] POST /identity/v3/projects => generated 404 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:08.021399 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12e376-e1c6-4c0f-b625-018632c25ed5 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:08.037985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12e376-e1c6-4c0f-b625-018632c25ed5 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:08.107697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c151952-53b9-4893-b46f-2e79a66d2fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:08.108347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c151952-53b9-4893-b46f-2e79a66d2fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:08.108632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c151952-53b9-4893-b46f-2e79a66d2fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:08.108911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c151952-53b9-4893-b46f-2e79a66d2fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:08.109602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c151952-53b9-4893-b46f-2e79a66d2fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:08.111657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c151952-53b9-4893-b46f-2e79a66d2fe7 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:08.139006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1116/2218] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:55:08 2022] POST /identity/v3/users => generated 309 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:08.140904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408eac2-0b03-4591-b43b-bd000a5b5f50 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:08.151925 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408eac2-0b03-4591-b43b-bd000a5b5f50 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:08.156709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457ae71-db29-4693-8b34-8ed45adf95c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:08.157358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457ae71-db29-4693-8b34-8ed45adf95c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:08.157622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457ae71-db29-4693-8b34-8ed45adf95c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:08.157905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457ae71-db29-4693-8b34-8ed45adf95c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:08.158614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457ae71-db29-4693-8b34-8ed45adf95c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:08.160310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457ae71-db29-4693-8b34-8ed45adf95c7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:08.162528 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:08.174312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1103/2219] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:08 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:08.178376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c151952-53b9-4893-b46f-2e79a66d2fe7 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:08.194360 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c151952-53b9-4893-b46f-2e79a66d2fe7 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:08.201030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5d261-b048-4a18-acb5-3b7e640e30c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:08.201780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5d261-b048-4a18-acb5-3b7e640e30c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:08.202080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5d261-b048-4a18-acb5-3b7e640e30c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:08.202308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5d261-b048-4a18-acb5-3b7e640e30c8 admin admin] PATH_INFO: `/v3/projects/bd714641c77d4beaa7175881a8ed6969/users/566bf6f2fba34787827f1773692dacab/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:08.221445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5d261-b048-4a18-acb5-3b7e640e30c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd714641c77d4beaa7175881a8ed6969, user_id=566bf6f2fba34787827f1773692dacab, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:08.226771 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5d261-b048-4a18-acb5-3b7e640e30c8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:08.243007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1117/2220] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:08 2022] PUT /identity/v3/projects/bd714641c77d4beaa7175881a8ed6969/users/566bf6f2fba34787827f1773692dacab/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:55:08.247170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457ae71-db29-4693-8b34-8ed45adf95c7 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:08.258344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457ae71-db29-4693-8b34-8ed45adf95c7 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:08.315617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133c8a1-77c5-43d8-b8f3-2f2b14fdc409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:08.316238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133c8a1-77c5-43d8-b8f3-2f2b14fdc409 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:08.316517 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133c8a1-77c5-43d8-b8f3-2f2b14fdc409 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:08.316790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133c8a1-77c5-43d8-b8f3-2f2b14fdc409 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:08.317488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133c8a1-77c5-43d8-b8f3-2f2b14fdc409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:08.319142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133c8a1-77c5-43d8-b8f3-2f2b14fdc409 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:08.331672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1104/2221] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:08 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:08.337237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5d261-b048-4a18-acb5-3b7e640e30c8 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:08.348759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5d261-b048-4a18-acb5-3b7e640e30c8 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:08.353987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482262a2-2f9b-40ba-8581-52e050ab7e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:08.354745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482262a2-2f9b-40ba-8581-52e050ab7e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:08.355057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482262a2-2f9b-40ba-8581-52e050ab7e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:08.355359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482262a2-2f9b-40ba-8581-52e050ab7e59 admin admin] PATH_INFO: `/v3/projects/bd714641c77d4beaa7175881a8ed6969/users/566bf6f2fba34787827f1773692dacab/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:08.357335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482262a2-2f9b-40ba-8581-52e050ab7e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd714641c77d4beaa7175881a8ed6969, user_id=566bf6f2fba34787827f1773692dacab, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:08.360105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482262a2-2f9b-40ba-8581-52e050ab7e59 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:08.371325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1118/2222] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:08 2022] PUT /identity/v3/projects/bd714641c77d4beaa7175881a8ed6969/users/566bf6f2fba34787827f1773692dacab/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:09.176712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812685-bb14-4adf-a41a-671258840862 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:09.177622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812685-bb14-4adf-a41a-671258840862 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:09.177930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812685-bb14-4adf-a41a-671258840862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:09.206418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-95812685-bb14-4adf-a41a-671258840862 None None] MFA Rules not processed for user `566bf6f2fba34787827f1773692dacab`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:09.207729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-95812685-bb14-4adf-a41a-671258840862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:09.293559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1105/2223] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:09 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:09.689799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5b14-4e9d-401d-90cb-81fb687ede42 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:09.690324 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5b14-4e9d-401d-90cb-81fb687ede42 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:09.690427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5b14-4e9d-401d-90cb-81fb687ede42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:09.713098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-6b4b5b14-4e9d-401d-90cb-81fb687ede42 None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:09.714342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6b4b5b14-4e9d-401d-90cb-81fb687ede42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:09.789716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95812685-bb14-4adf-a41a-671258840862 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:09.791673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-95812685-bb14-4adf-a41a-671258840862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:09.805738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1119/2224] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:55:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:09.862792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5b14-4e9d-401d-90cb-81fb687ede42 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:09.864628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6b4b5b14-4e9d-401d-90cb-81fb687ede42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:09.885207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95812685-bb14-4adf-a41a-671258840862 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:09.890438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a351d-d344-478e-8740-5b2e70356a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:09.891313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a351d-d344-478e-8740-5b2e70356a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:09.891691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a351d-d344-478e-8740-5b2e70356a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:09.892067 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a351d-d344-478e-8740-5b2e70356a1d admin admin] PATH_INFO: `/v3/users/2553fc4bd29e4a1781b462301ade53ce` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:09.893540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a351d-d344-478e-8740-5b2e70356a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2553fc4bd29e4a1781b462301ade53ce)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:09.895870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a351d-d344-478e-8740-5b2e70356a1d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:09.923104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:09.938386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:09.973755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e16a351d-d344-478e-8740-5b2e70356a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2553fc4bd29e4a1781b462301ade53ce'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:09.973755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e16a351d-d344-478e-8740-5b2e70356a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2553fc4bd29e4a1781b462301ade53ce'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:09.984688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5b14-4e9d-401d-90cb-81fb687ede42 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:09.990538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7409511-2834-42d6-9875-11a46b84e18d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:09.991561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7409511-2834-42d6-9875-11a46b84e18d service swift] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:09.992009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7409511-2834-42d6-9875-11a46b84e18d service swift] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:09.992149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e16a351d-d344-478e-8740-5b2e70356a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2553fc4bd29e4a1781b462301ade53ce'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:09.992562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7409511-2834-42d6-9875-11a46b84e18d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:09.993101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e16a351d-d344-478e-8740-5b2e70356a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2553fc4bd29e4a1781b462301ade53ce'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:09.995599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b7409511-2834-42d6-9875-11a46b84e18d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:10.004080 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e16a351d-d344-478e-8740-5b2e70356a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2553fc4bd29e4a1781b462301ade53ce'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:10.010504 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7409511-2834-42d6-9875-11a46b84e18d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:10.012207 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7409511-2834-42d6-9875-11a46b84e18d service swift] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:10.025408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1106/2225] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:55:09 2022] DELETE /identity/v3/users/2553fc4bd29e4a1781b462301ade53ce => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:10.027128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1120/2226] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:55:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 16:55:10.030590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0cc8-6844-4378-a214-e9288875b96d None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:10.031066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0cc8-6844-4378-a214-e9288875b96d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:10.031555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0cc8-6844-4378-a214-e9288875b96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:10.066786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-654f0cc8-6844-4378-a214-e9288875b96d None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:10.068070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-654f0cc8-6844-4378-a214-e9288875b96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:10.156286 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1107/2227] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:10.166127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7409511-2834-42d6-9875-11a46b84e18d service swift] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:10.170105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b7409511-2834-42d6-9875-11a46b84e18d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:10.246096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7409511-2834-42d6-9875-11a46b84e18d service swift] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:10.323977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecbf67-9020-44ef-930f-5c888fb15213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:10.324723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecbf67-9020-44ef-930f-5c888fb15213 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:10.325016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecbf67-9020-44ef-930f-5c888fb15213 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:10.325297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecbf67-9020-44ef-930f-5c888fb15213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:10.351899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecbf67-9020-44ef-930f-5c888fb15213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:10.351899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecbf67-9020-44ef-930f-5c888fb15213 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:10.355816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1121/2228] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:10.747106 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5579b3f-9ac8-45fd-b171-fee369f69de0 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:10.747711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5579b3f-9ac8-45fd-b171-fee369f69de0 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:10.747711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5579b3f-9ac8-45fd-b171-fee369f69de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:10.769264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f5579b3f-9ac8-45fd-b171-fee369f69de0 None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:10.770685 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f5579b3f-9ac8-45fd-b171-fee369f69de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:10.832939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1108/2229] 10.222.0.124 () {58 vars in 972 bytes} [Mon Aug 1 16:55:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:10.847364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecbf67-9020-44ef-930f-5c888fb15213 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:10.849142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-58ecbf67-9020-44ef-930f-5c888fb15213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:10.926795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecbf67-9020-44ef-930f-5c888fb15213 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:10.933980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e1b05-8460-4f57-82fb-eb30362bd0be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:10.934635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e1b05-8460-4f57-82fb-eb30362bd0be service swift] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:10.934921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e1b05-8460-4f57-82fb-eb30362bd0be service swift] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:10.935245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e1b05-8460-4f57-82fb-eb30362bd0be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:10.944815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e1b05-8460-4f57-82fb-eb30362bd0be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:10.946443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e1b05-8460-4f57-82fb-eb30362bd0be service swift] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:10.956213 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1122/2230] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:55:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:55:11.045453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cafdc0-ac83-4ed3-b8de-9d7029783ce9 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.045614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cafdc0-ac83-4ed3-b8de-9d7029783ce9 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.045883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cafdc0-ac83-4ed3-b8de-9d7029783ce9 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.047678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1109/2231] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 16:55:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:11.090278 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fea3a5-5519-4fc0-beb0-56b351980456 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.091563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fea3a5-5519-4fc0-beb0-56b351980456 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.091733 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fea3a5-5519-4fc0-beb0-56b351980456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.126128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-c7fea3a5-5519-4fc0-beb0-56b351980456 None None] MFA Rules not processed for user `6deeea314be545609b0fe4dd786b3b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:11.127420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c7fea3a5-5519-4fc0-beb0-56b351980456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:11.143270 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cafdc0-ac83-4ed3-b8de-9d7029783ce9 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:11.145873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-26cafdc0-ac83-4ed3-b8de-9d7029783ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:11.149995 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:11.178740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cafdc0-ac83-4ed3-b8de-9d7029783ce9 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:11.200055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed007024-bc3b-4513-9741-23a214c3f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:11.200745 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed007024-bc3b-4513-9741-23a214c3f1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.201032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed007024-bc3b-4513-9741-23a214c3f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.201312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed007024-bc3b-4513-9741-23a214c3f1ba admin admin] PATH_INFO: `/v3/users/036d47e99a184054bb819d9cf707f957` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.203708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed007024-bc3b-4513-9741-23a214c3f1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=036d47e99a184054bb819d9cf707f957)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:11.205752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed007024-bc3b-4513-9741-23a214c3f1ba admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:11.243042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1123/2232] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 16:55:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:11.268516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fea3a5-5519-4fc0-beb0-56b351980456 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:11.271414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c7fea3a5-5519-4fc0-beb0-56b351980456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:11.273065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:11.283901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ed007024-bc3b-4513-9741-23a214c3f1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036d47e99a184054bb819d9cf707f957'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.285176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ed007024-bc3b-4513-9741-23a214c3f1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036d47e99a184054bb819d9cf707f957'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.298168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fea3a5-5519-4fc0-beb0-56b351980456 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:11.306965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7921f63-1f12-4703-9a9c-8d1ed504004b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:11.307624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7921f63-1f12-4703-9a9c-8d1ed504004b service placement] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.307955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7921f63-1f12-4703-9a9c-8d1ed504004b service placement] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.308285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7921f63-1f12-4703-9a9c-8d1ed504004b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.317934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ed007024-bc3b-4513-9741-23a214c3f1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036d47e99a184054bb819d9cf707f957'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.319152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7921f63-1f12-4703-9a9c-8d1ed504004b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:11.319456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ed007024-bc3b-4513-9741-23a214c3f1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036d47e99a184054bb819d9cf707f957'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.320778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7921f63-1f12-4703-9a9c-8d1ed504004b service placement] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:11.332633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ed007024-bc3b-4513-9741-23a214c3f1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036d47e99a184054bb819d9cf707f957'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.333299 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1124/2233] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:55:11.334157 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7921f63-1f12-4703-9a9c-8d1ed504004b service placement] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:11.335933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a7921f63-1f12-4703-9a9c-8d1ed504004b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:11.351018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7921f63-1f12-4703-9a9c-8d1ed504004b service placement] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:11.356315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:11.356971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.357248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.357521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] PATH_INFO: `/v3/projects/bf2a138fb08a43d0a276e65bb5062418` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.359025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2a138fb08a43d0a276e65bb5062418)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:11.361045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:11.361268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1110/2234] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:55:11 2022] DELETE /identity/v3/users/036d47e99a184054bb819d9cf707f957 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:11.362838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b09db-3d8d-45fb-b862-d4c98df4be9a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.363220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b09db-3d8d-45fb-b862-d4c98df4be9a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.363990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b09db-3d8d-45fb-b862-d4c98df4be9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.407038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a28b09db-3d8d-45fb-b862-d4c98df4be9a None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:11.408677 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a28b09db-3d8d-45fb-b862-d4c98df4be9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:11.472671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2a138fb08a43d0a276e65bb5062418', 'request_id': 'req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.482527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2a138fb08a43d0a276e65bb5062418', 'request_id': 'req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.489739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2a138fb08a43d0a276e65bb5062418', 'request_id': 'req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.504881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] The token cache is being invalidate because project bf2a138fb08a43d0a276e65bb5062418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:55:11.505180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.506443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-75eaf3ea-b606-452e-9ad5-b3f8e4f5754e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.513091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1125/2235] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:55:11 2022] DELETE /identity/v3/projects/bf2a138fb08a43d0a276e65bb5062418 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:11.515025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e5cb-687f-450e-8f3a-9574e2a92834 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.515328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e5cb-687f-450e-8f3a-9574e2a92834 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.515609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e5cb-687f-450e-8f3a-9574e2a92834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.523628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1111/2236] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:55:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:11.537493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b09db-3d8d-45fb-b862-d4c98df4be9a None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:11.539262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a28b09db-3d8d-45fb-b862-d4c98df4be9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:11.543427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-6d02e5cb-687f-450e-8f3a-9574e2a92834 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:11.544658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6d02e5cb-687f-450e-8f3a-9574e2a92834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:11.615737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1126/2237] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:11.617444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62870c-b34f-4e7f-8989-cfab3803244d None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.617734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62870c-b34f-4e7f-8989-cfab3803244d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.618015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62870c-b34f-4e7f-8989-cfab3803244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.643194 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b09db-3d8d-45fb-b862-d4c98df4be9a None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:11.643401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-fb62870c-b34f-4e7f-8989-cfab3803244d None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:11.643401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-fb62870c-b34f-4e7f-8989-cfab3803244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:11.654576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1127/2238] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:11.658784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62870c-b34f-4e7f-8989-cfab3803244d None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:11.668972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62870c-b34f-4e7f-8989-cfab3803244d None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:11.674431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6790d-d448-4ea9-ba82-f75cea07d9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:11.675024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6790d-d448-4ea9-ba82-f75cea07d9bb admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.675314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6790d-d448-4ea9-ba82-f75cea07d9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.675617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6790d-d448-4ea9-ba82-f75cea07d9bb admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.676380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6790d-d448-4ea9-ba82-f75cea07d9bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:55:11.676693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6790d-d448-4ea9-ba82-f75cea07d9bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:11.678405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6790d-d448-4ea9-ba82-f75cea07d9bb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:11.696232 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1128/2239] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:55:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:55:11.696232 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6790d-d448-4ea9-ba82-f75cea07d9bb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:11.698305 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0fb6790d-d448-4ea9-ba82-f75cea07d9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:11.709438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:11.715108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6790d-d448-4ea9-ba82-f75cea07d9bb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:11.723375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:11.723993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.724503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.724989 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] PATH_INFO: `/v3/projects/7000cdd4b0d04f769888cf94d6c3e1ce` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.726227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ee9ee-fb18-48f3-81de-1c857319ed46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:11.726405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7000cdd4b0d04f769888cf94d6c3e1ce)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:11.726865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ee9ee-fb18-48f3-81de-1c857319ed46 service swift] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.727261 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ee9ee-fb18-48f3-81de-1c857319ed46 service swift] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.727541 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ee9ee-fb18-48f3-81de-1c857319ed46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.728369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:11.732316 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:11.784837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7000cdd4b0d04f769888cf94d6c3e1ce', 'request_id': 'req-4538af34-2f66-4131-b99c-30bf6587218e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.793689 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7000cdd4b0d04f769888cf94d6c3e1ce', 'request_id': 'req-4538af34-2f66-4131-b99c-30bf6587218e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.799076 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ee9ee-fb18-48f3-81de-1c857319ed46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:11.800706 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ee9ee-fb18-48f3-81de-1c857319ed46 service swift] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:11.801834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7000cdd4b0d04f769888cf94d6c3e1ce', 'request_id': 'req-4538af34-2f66-4131-b99c-30bf6587218e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.809236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1112/2240] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:55:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 16:55:11.810051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ee9ee-fb18-48f3-81de-1c857319ed46 service swift] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:11.815174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] The token cache is being invalidate because project 7000cdd4b0d04f769888cf94d6c3e1ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:55:11.815474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.816234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:11.818103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1129/2241] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:55:11 2022] DELETE /identity/v3/projects/7000cdd4b0d04f769888cf94d6c3e1ce => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:11.824102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:11.824337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ee9ee-fb18-48f3-81de-1c857319ed46 service swift] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:11.825732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:11.892628 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf568-8f08-4cf9-a880-ba1c3d905778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:11.893397 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf568-8f08-4cf9-a880-ba1c3d905778 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.893750 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf568-8f08-4cf9-a880-ba1c3d905778 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.894093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf568-8f08-4cf9-a880-ba1c3d905778 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.894848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaf568-8f08-4cf9-a880-ba1c3d905778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:11.897032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaf568-8f08-4cf9-a880-ba1c3d905778 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:11.913831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538af34-2f66-4131-b99c-30bf6587218e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:11.920751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:11.921873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:11.923592 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:11.924736 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] PATH_INFO: `/v3/users/566bf6f2fba34787827f1773692dacab` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:11.926236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=566bf6f2fba34787827f1773692dacab)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:11.928531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:11.931921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1113/2242] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:55:11 2022] POST /identity/v3/projects => generated 376 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:11.936973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf568-8f08-4cf9-a880-ba1c3d905778 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:11.939415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6cfaf568-8f08-4cf9-a880-ba1c3d905778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:11.996379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '566bf6f2fba34787827f1773692dacab'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:12.007416 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '566bf6f2fba34787827f1773692dacab'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:12.018219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '566bf6f2fba34787827f1773692dacab'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:12.019297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '566bf6f2fba34787827f1773692dacab'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:12.020362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '566bf6f2fba34787827f1773692dacab'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:12.044061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1130/2243] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:55:11 2022] DELETE /identity/v3/users/566bf6f2fba34787827f1773692dacab => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:12.049916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf568-8f08-4cf9-a880-ba1c3d905778 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:12.097699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:12.131360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99105f39-e01f-4497-92b0-62695ab612a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:12.132223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105f39-e01f-4497-92b0-62695ab612a4 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.132508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105f39-e01f-4497-92b0-62695ab612a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.132790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105f39-e01f-4497-92b0-62695ab612a4 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.134312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99105f39-e01f-4497-92b0-62695ab612a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:12.136461 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99105f39-e01f-4497-92b0-62695ab612a4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:12.167668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1114/2244] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:55:11 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:12.172139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:12.173784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:12.194326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499bf29-d66d-40d9-9083-a8f1142cfcc1 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:12.200330 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17847047-77cd-4488-a7cc-d94ea1244ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:12.200977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17847047-77cd-4488-a7cc-d94ea1244ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.201259 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17847047-77cd-4488-a7cc-d94ea1244ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.201558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17847047-77cd-4488-a7cc-d94ea1244ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.202254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17847047-77cd-4488-a7cc-d94ea1244ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:12.204108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17847047-77cd-4488-a7cc-d94ea1244ae5 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:12.206057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:12.213658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b5b49-c9e5-41bd-a06e-386e66cfff02 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.213933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b5b49-c9e5-41bd-a06e-386e66cfff02 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.214211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b5b49-c9e5-41bd-a06e-386e66cfff02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.220996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1131/2245] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:12 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:12.225110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17847047-77cd-4488-a7cc-d94ea1244ae5 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:12.235884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17847047-77cd-4488-a7cc-d94ea1244ae5 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:12.236753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-c98b5b49-c9e5-41bd-a06e-386e66cfff02 None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:12.238032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c98b5b49-c9e5-41bd-a06e-386e66cfff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:12.241094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065967cb-00d2-4dc5-99ec-51a864fa3a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:12.241864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065967cb-00d2-4dc5-99ec-51a864fa3a8e admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.242088 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065967cb-00d2-4dc5-99ec-51a864fa3a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.242365 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065967cb-00d2-4dc5-99ec-51a864fa3a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.243104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065967cb-00d2-4dc5-99ec-51a864fa3a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:12.245169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065967cb-00d2-4dc5-99ec-51a864fa3a8e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:12.261240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1132/2246] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:12 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:12.263238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065967cb-00d2-4dc5-99ec-51a864fa3a8e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:12.278065 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065967cb-00d2-4dc5-99ec-51a864fa3a8e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:12.282555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e4774-55bb-4871-a2b9-b5fe3ce74d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:12.283427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e4774-55bb-4871-a2b9-b5fe3ce74d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.283718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e4774-55bb-4871-a2b9-b5fe3ce74d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.284001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e4774-55bb-4871-a2b9-b5fe3ce74d96 admin admin] PATH_INFO: `/v3/projects/ced9906db29f4684bb9b97921389937b/users/f21db14048b149c394711418a732ffcf/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.302019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e4774-55bb-4871-a2b9-b5fe3ce74d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced9906db29f4684bb9b97921389937b, user_id=f21db14048b149c394711418a732ffcf, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:12.305085 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e4774-55bb-4871-a2b9-b5fe3ce74d96 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:12.319916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1115/2247] 10.222.0.124 () {58 vars in 972 bytes} [Mon Aug 1 16:55:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:12.321623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1133/2248] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:12 2022] PUT /identity/v3/projects/ced9906db29f4684bb9b97921389937b/users/f21db14048b149c394711418a732ffcf/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:55:12.322778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e4774-55bb-4871-a2b9-b5fe3ce74d96 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:12.324529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e46e4774-55bb-4871-a2b9-b5fe3ce74d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:12.333271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a5fb-be25-4655-b194-b809ebcc8589 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.334580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a5fb-be25-4655-b194-b809ebcc8589 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.335049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a5fb-be25-4655-b194-b809ebcc8589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.364626 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-3679a5fb-be25-4655-b194-b809ebcc8589 None None] MFA Rules not processed for user `f21db14048b149c394711418a732ffcf`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:12.365930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3679a5fb-be25-4655-b194-b809ebcc8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:12.396514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e4774-55bb-4871-a2b9-b5fe3ce74d96 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:12.402324 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:12.403041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.403311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.404071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] PATH_INFO: `/v3/projects/bd714641c77d4beaa7175881a8ed6969` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.404784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd714641c77d4beaa7175881a8ed6969)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:12.406755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:12.453693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1116/2249] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:12.453693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a5fb-be25-4655-b194-b809ebcc8589 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:12.457992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3679a5fb-be25-4655-b194-b809ebcc8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:12.498711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd714641c77d4beaa7175881a8ed6969', 'request_id': 'req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:12.518554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd714641c77d4beaa7175881a8ed6969', 'request_id': 'req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:12.526007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd714641c77d4beaa7175881a8ed6969', 'request_id': 'req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:12.538749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] The token cache is being invalidate because project bd714641c77d4beaa7175881a8ed6969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:55:12.539499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:12.539827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:12.547134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1134/2250] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:55:12 2022] DELETE /identity/v3/projects/bd714641c77d4beaa7175881a8ed6969 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:12.547134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:12.551744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:12.595783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:12.601726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a5fb-be25-4655-b194-b809ebcc8589 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:12.638819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ddb91-3fdb-4bdf-a37a-6cfdd8cdb2e6 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:12.642572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2704f-c9c0-42ac-9115-d577900f7374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:12.643240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2704f-c9c0-42ac-9115-d577900f7374 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.643540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2704f-c9c0-42ac-9115-d577900f7374 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.644455 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2704f-c9c0-42ac-9115-d577900f7374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.647432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-76b2704f-c9c0-42ac-9115-d577900f7374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:12.654063 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:12.671711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99403892-bf7b-4c04-aca8-fe1e42e9bc12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:12.672941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99403892-bf7b-4c04-aca8-fe1e42e9bc12 service swift] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.673600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99403892-bf7b-4c04-aca8-fe1e42e9bc12 service swift] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.674086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99403892-bf7b-4c04-aca8-fe1e42e9bc12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.677805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-99403892-bf7b-4c04-aca8-fe1e42e9bc12 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:12.724442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2704f-c9c0-42ac-9115-d577900f7374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:12.726062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2704f-c9c0-42ac-9115-d577900f7374 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:12.736588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1135/2251] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:12.738880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696e11-d227-4bb9-a531-93f7bc6b6cf4 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.739206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696e11-d227-4bb9-a531-93f7bc6b6cf4 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.739487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696e11-d227-4bb9-a531-93f7bc6b6cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.764813 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99403892-bf7b-4c04-aca8-fe1e42e9bc12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:12.767373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99403892-bf7b-4c04-aca8-fe1e42e9bc12 service swift] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:12.769316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-86696e11-d227-4bb9-a531-93f7bc6b6cf4 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:12.770554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-86696e11-d227-4bb9-a531-93f7bc6b6cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:12.780059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1117/2252] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:55:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:55:12.859808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1136/2253] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:12.870363 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda28b2-1cb0-4a26-993e-708df85f8770 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.871015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda28b2-1cb0-4a26-993e-708df85f8770 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.871457 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda28b2-1cb0-4a26-993e-708df85f8770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.903045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-abda28b2-1cb0-4a26-993e-708df85f8770 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:12.905704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-abda28b2-1cb0-4a26-993e-708df85f8770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:12.919883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1118/2254] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:12.925580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86696e11-d227-4bb9-a531-93f7bc6b6cf4 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:12.937618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86696e11-d227-4bb9-a531-93f7bc6b6cf4 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:12.951693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1f4e7-6996-4148-a396-d119350ad2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:12.952576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1f4e7-6996-4148-a396-d119350ad2ab admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:12.957723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1f4e7-6996-4148-a396-d119350ad2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:12.957723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1f4e7-6996-4148-a396-d119350ad2ab admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:12.957723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1f4e7-6996-4148-a396-d119350ad2ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:55:12.957723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1f4e7-6996-4148-a396-d119350ad2ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:12.957723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1f4e7-6996-4148-a396-d119350ad2ab admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:12.976823 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1137/2255] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:55:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:55:12.982246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda28b2-1cb0-4a26-993e-708df85f8770 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:12.998248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda28b2-1cb0-4a26-993e-708df85f8770 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:13.011248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae7f9e-3f6c-4cfb-9df3-e64b7cc0e242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:13.011919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7f9e-3f6c-4cfb-9df3-e64b7cc0e242 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:13.012337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7f9e-3f6c-4cfb-9df3-e64b7cc0e242 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:13.012661 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7f9e-3f6c-4cfb-9df3-e64b7cc0e242 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:13.013347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae7f9e-3f6c-4cfb-9df3-e64b7cc0e242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:13.015594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae7f9e-3f6c-4cfb-9df3-e64b7cc0e242 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:13.078024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1119/2256] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:55:12 2022] POST /identity/v3/projects => generated 374 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:13.079918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1f4e7-6996-4148-a396-d119350ad2ab admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:13.095934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1f4e7-6996-4148-a396-d119350ad2ab admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:13.192105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72761cf-d0e9-461a-b7e2-ddbc7be4e40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:13.192948 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72761cf-d0e9-461a-b7e2-ddbc7be4e40b admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:13.193691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72761cf-d0e9-461a-b7e2-ddbc7be4e40b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:13.194000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72761cf-d0e9-461a-b7e2-ddbc7be4e40b admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:13.197015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72761cf-d0e9-461a-b7e2-ddbc7be4e40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:13.199635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72761cf-d0e9-461a-b7e2-ddbc7be4e40b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:13.246438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1138/2257] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:55:13 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:55:13.250615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae7f9e-3f6c-4cfb-9df3-e64b7cc0e242 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:13.265752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae7f9e-3f6c-4cfb-9df3-e64b7cc0e242 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:13.273365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a343a-bb22-41bd-a27e-f8ebd71f3a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:13.274001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a343a-bb22-41bd-a27e-f8ebd71f3a9c admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:13.274281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a343a-bb22-41bd-a27e-f8ebd71f3a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:13.274689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a343a-bb22-41bd-a27e-f8ebd71f3a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:13.275576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a343a-bb22-41bd-a27e-f8ebd71f3a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:13.277397 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a343a-bb22-41bd-a27e-f8ebd71f3a9c admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:13.291048 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1120/2258] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:13 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:55:13.302034 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72761cf-d0e9-461a-b7e2-ddbc7be4e40b admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:13.316018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72761cf-d0e9-461a-b7e2-ddbc7be4e40b admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:13.322562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754c9eb-ca48-41bd-9e82-fd439102b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:13.323537 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754c9eb-ca48-41bd-9e82-fd439102b6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:13.323970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754c9eb-ca48-41bd-9e82-fd439102b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:13.324392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754c9eb-ca48-41bd-9e82-fd439102b6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:13.326062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754c9eb-ca48-41bd-9e82-fd439102b6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:13.328758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754c9eb-ca48-41bd-9e82-fd439102b6e4 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:13.357028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1139/2259] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:13 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:13.361450 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a343a-bb22-41bd-a27e-f8ebd71f3a9c admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:13.375346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a343a-bb22-41bd-a27e-f8ebd71f3a9c admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:13.382094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6554b6c-1582-4909-be7b-f93874b208cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:13.382936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6554b6c-1582-4909-be7b-f93874b208cc admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:13.391275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6554b6c-1582-4909-be7b-f93874b208cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:13.391275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6554b6c-1582-4909-be7b-f93874b208cc admin admin] PATH_INFO: `/v3/projects/9deffe39e2ff463eb49d4069d617ab71/users/47960dd1fdee4cd9892f115e7068824e/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:13.409567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6554b6c-1582-4909-be7b-f93874b208cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9deffe39e2ff463eb49d4069d617ab71, user_id=47960dd1fdee4cd9892f115e7068824e, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:13.412663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6554b6c-1582-4909-be7b-f93874b208cc admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:13.439034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1121/2260] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:13 2022] PUT /identity/v3/projects/9deffe39e2ff463eb49d4069d617ab71/users/47960dd1fdee4cd9892f115e7068824e/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:13.444618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83197c-28f2-4925-a7b9-f29426791469 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:13.445314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83197c-28f2-4925-a7b9-f29426791469 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:13.445314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83197c-28f2-4925-a7b9-f29426791469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:13.466614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-3f83197c-28f2-4925-a7b9-f29426791469 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:13.468170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3f83197c-28f2-4925-a7b9-f29426791469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:13.473918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:13.559355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1140/2261] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:13.569775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6554b6c-1582-4909-be7b-f93874b208cc admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:13.571863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f6554b6c-1582-4909-be7b-f93874b208cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:13.633953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:13.650795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6554b6c-1582-4909-be7b-f93874b208cc admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:13.655915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653fb1e-0ec9-43c5-a7bd-07b1bf86335c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:13.656683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653fb1e-0ec9-43c5-a7bd-07b1bf86335c service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:13.656964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653fb1e-0ec9-43c5-a7bd-07b1bf86335c service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:13.657275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653fb1e-0ec9-43c5-a7bd-07b1bf86335c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:13.669015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653fb1e-0ec9-43c5-a7bd-07b1bf86335c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:13.670684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653fb1e-0ec9-43c5-a7bd-07b1bf86335c service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:13.686056 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1122/2262] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:14.474585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee6b2-da0d-4856-9185-9f0119f6d4f3 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:14.475224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee6b2-da0d-4856-9185-9f0119f6d4f3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:14.476521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee6b2-da0d-4856-9185-9f0119f6d4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:14.530393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-df8ee6b2-da0d-4856-9185-9f0119f6d4f3 None None] MFA Rules not processed for user `47960dd1fdee4cd9892f115e7068824e`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:14.533072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-df8ee6b2-da0d-4856-9185-9f0119f6d4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:14.634778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1141/2263] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:14.639955 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653fb1e-0ec9-43c5-a7bd-07b1bf86335c service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:14.660606 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653fb1e-0ec9-43c5-a7bd-07b1bf86335c service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:14.671188 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c034b2-4486-474d-83c5-6beec0ae2959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:14.672451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c034b2-4486-474d-83c5-6beec0ae2959 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:14.674217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c034b2-4486-474d-83c5-6beec0ae2959 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:14.674514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c034b2-4486-474d-83c5-6beec0ae2959 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:14.675470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c034b2-4486-474d-83c5-6beec0ae2959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:14.678192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c034b2-4486-474d-83c5-6beec0ae2959 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:14.727470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1123/2264] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:55:14 2022] POST /identity/v3/projects => generated 374 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:14.735166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ee6b2-da0d-4856-9185-9f0119f6d4f3 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:14.747482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ee6b2-da0d-4856-9185-9f0119f6d4f3 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:14.826601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a778c7-e9e2-49c7-a204-b033fe0ac1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:14.827300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a778c7-e9e2-49c7-a204-b033fe0ac1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:14.827588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a778c7-e9e2-49c7-a204-b033fe0ac1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:14.827870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a778c7-e9e2-49c7-a204-b033fe0ac1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:14.828563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a778c7-e9e2-49c7-a204-b033fe0ac1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:14.830630 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a778c7-e9e2-49c7-a204-b033fe0ac1f6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:14.853099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1142/2265] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:55:14 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:14.857453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c034b2-4486-474d-83c5-6beec0ae2959 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:14.867876 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c034b2-4486-474d-83c5-6beec0ae2959 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:14.873762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e6ea1-60e2-4c95-af65-eac2f68699b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:14.874395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6ea1-60e2-4c95-af65-eac2f68699b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:14.874666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6ea1-60e2-4c95-af65-eac2f68699b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:14.874936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6ea1-60e2-4c95-af65-eac2f68699b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:14.875672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e6ea1-60e2-4c95-af65-eac2f68699b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:14.877295 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e6ea1-60e2-4c95-af65-eac2f68699b5 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:14.888939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1124/2266] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:14 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:14.893445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a778c7-e9e2-49c7-a204-b033fe0ac1f6 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:14.906739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a778c7-e9e2-49c7-a204-b033fe0ac1f6 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:14.915028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca45543-ad47-4eca-89a2-485cddf40b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:14.916284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca45543-ad47-4eca-89a2-485cddf40b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:14.916681 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca45543-ad47-4eca-89a2-485cddf40b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:14.917041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca45543-ad47-4eca-89a2-485cddf40b9c admin admin] PATH_INFO: `/v3/projects/a2e1bd052d02494c87ddae662297e246/users/5d066db8da934ed4a9e13b0256ef250a/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:14.934801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca45543-ad47-4eca-89a2-485cddf40b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e1bd052d02494c87ddae662297e246, user_id=5d066db8da934ed4a9e13b0256ef250a, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:14.937497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca45543-ad47-4eca-89a2-485cddf40b9c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:14.955230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1143/2267] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:14 2022] PUT /identity/v3/projects/a2e1bd052d02494c87ddae662297e246/users/5d066db8da934ed4a9e13b0256ef250a/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:14.961489 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e6ea1-60e2-4c95-af65-eac2f68699b5 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:14.975432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e6ea1-60e2-4c95-af65-eac2f68699b5 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:15.013413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2aa29-5421-439f-bcc2-e7a7e598abba None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:15.013731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2aa29-5421-439f-bcc2-e7a7e598abba None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:15.014809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2aa29-5421-439f-bcc2-e7a7e598abba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:15.028311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:15.034530 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ebc2aa29-5421-439f-bcc2-e7a7e598abba None None] MFA Rules not processed for user `d3040eee20664f3e83931ae9da71089d`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:15.036720 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ebc2aa29-5421-439f-bcc2-e7a7e598abba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:15.039335 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234c4b6-4ed9-49f5-a4f9-354340fbabf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:15.039956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c4b6-4ed9-49f5-a4f9-354340fbabf7 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:15.040268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c4b6-4ed9-49f5-a4f9-354340fbabf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:15.040697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c4b6-4ed9-49f5-a4f9-354340fbabf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:15.041590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234c4b6-4ed9-49f5-a4f9-354340fbabf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:15.043664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234c4b6-4ed9-49f5-a4f9-354340fbabf7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:15.055513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1125/2268] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:14 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:15.060103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234c4b6-4ed9-49f5-a4f9-354340fbabf7 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:15.070729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234c4b6-4ed9-49f5-a4f9-354340fbabf7 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:15.076365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb2e34-96c1-46ab-b4d7-b7b98c63d7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:15.077050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2e34-96c1-46ab-b4d7-b7b98c63d7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:15.077332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2e34-96c1-46ab-b4d7-b7b98c63d7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:15.077610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2e34-96c1-46ab-b4d7-b7b98c63d7e5 admin admin] PATH_INFO: `/v3/projects/a2e1bd052d02494c87ddae662297e246/users/5d066db8da934ed4a9e13b0256ef250a/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:15.079604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb2e34-96c1-46ab-b4d7-b7b98c63d7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e1bd052d02494c87ddae662297e246, user_id=5d066db8da934ed4a9e13b0256ef250a, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:15.082247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb2e34-96c1-46ab-b4d7-b7b98c63d7e5 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:15.094354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1126/2269] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:15 2022] PUT /identity/v3/projects/a2e1bd052d02494c87ddae662297e246/users/5d066db8da934ed4a9e13b0256ef250a/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:15.102081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1144/2270] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:15.134907 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb2e34-96c1-46ab-b4d7-b7b98c63d7e5 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:15.137518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e8cb2e34-96c1-46ab-b4d7-b7b98c63d7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:15.237683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb2e34-96c1-46ab-b4d7-b7b98c63d7e5 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:15.243048 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:15.243760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:15.244166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:15.244585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] PATH_INFO: `/v3/users/0f067c5dc1fb4539b0606a699e302a0f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:15.247030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f067c5dc1fb4539b0606a699e302a0f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:15.249057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:15.301615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:15.318725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f067c5dc1fb4539b0606a699e302a0f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:15.319449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f067c5dc1fb4539b0606a699e302a0f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:15.339971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f067c5dc1fb4539b0606a699e302a0f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:15.340800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f067c5dc1fb4539b0606a699e302a0f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:15.351058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f067c5dc1fb4539b0606a699e302a0f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:15.371726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1127/2271] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:55:15 2022] DELETE /identity/v3/users/0f067c5dc1fb4539b0606a699e302a0f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:15.374606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c0604-4001-464e-88e1-7010ce8390a3 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:15.374606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c0604-4001-464e-88e1-7010ce8390a3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:15.374606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c0604-4001-464e-88e1-7010ce8390a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:15.397973 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-3a0c0604-4001-464e-88e1-7010ce8390a3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:15.399353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3a0c0604-4001-464e-88e1-7010ce8390a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:15.478350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1145/2272] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:15.488743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:15.490851 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:15.581017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de428eb-9dc2-401b-9997-30f00502f3fc admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:15.586600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89671629-0a2c-444f-9b38-8e783cc83bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:15.587495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89671629-0a2c-444f-9b38-8e783cc83bdc service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:15.588439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89671629-0a2c-444f-9b38-8e783cc83bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:15.589130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89671629-0a2c-444f-9b38-8e783cc83bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:15.603093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89671629-0a2c-444f-9b38-8e783cc83bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:15.606079 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89671629-0a2c-444f-9b38-8e783cc83bdc service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:15.622235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1128/2273] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:15.945342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c0604-4001-464e-88e1-7010ce8390a3 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:15.946777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3a0c0604-4001-464e-88e1-7010ce8390a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:15.961609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c0604-4001-464e-88e1-7010ce8390a3 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:15.980111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:15.980729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:15.980928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:15.981203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] PATH_INFO: `/v3/projects/01171ed3343b4f8da2f733289b08c1be` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:15.983262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01171ed3343b4f8da2f733289b08c1be)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:15.985199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:16.119615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01171ed3343b4f8da2f733289b08c1be', 'request_id': 'req-f73e81e7-785a-4ecf-92a5-8ae51cba5870'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:16.148317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f44a46-8534-4f5c-99a8-a9d4be8f7687 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.148858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01171ed3343b4f8da2f733289b08c1be', 'request_id': 'req-f73e81e7-785a-4ecf-92a5-8ae51cba5870'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:16.149917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f44a46-8534-4f5c-99a8-a9d4be8f7687 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.150443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f44a46-8534-4f5c-99a8-a9d4be8f7687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.156420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01171ed3343b4f8da2f733289b08c1be', 'request_id': 'req-f73e81e7-785a-4ecf-92a5-8ae51cba5870'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:16.179449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] The token cache is being invalidate because project 01171ed3343b4f8da2f733289b08c1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:55:16.180150 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:16.184169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f73e81e7-785a-4ecf-92a5-8ae51cba5870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:16.187063 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1146/2274] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:55:15 2022] DELETE /identity/v3/projects/01171ed3343b4f8da2f733289b08c1be => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:16.192372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463874ab-8742-4f39-a63d-e526f782669c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.192724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463874ab-8742-4f39-a63d-e526f782669c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.193080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463874ab-8742-4f39-a63d-e526f782669c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.232992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-08f44a46-8534-4f5c-99a8-a9d4be8f7687 None None] MFA Rules not processed for user `5d066db8da934ed4a9e13b0256ef250a`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:16.234366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-08f44a46-8534-4f5c-99a8-a9d4be8f7687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:16.235782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-463874ab-8742-4f39-a63d-e526f782669c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:16.237691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-463874ab-8742-4f39-a63d-e526f782669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:16.293112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:16.349128 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1147/2275] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:16.357780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1bd2e-8dab-42aa-a803-5951cb71fd7f None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.358139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1bd2e-8dab-42aa-a803-5951cb71fd7f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.358581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1bd2e-8dab-42aa-a803-5951cb71fd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.394468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-40f1bd2e-8dab-42aa-a803-5951cb71fd7f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:16.399124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-40f1bd2e-8dab-42aa-a803-5951cb71fd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:16.407786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1129/2276] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:16.419051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6704-8622-4929-8fa0-3ff045974b3d None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.419341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6704-8622-4929-8fa0-3ff045974b3d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.421151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6704-8622-4929-8fa0-3ff045974b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.429130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1148/2277] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:16.430686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1bd2e-8dab-42aa-a803-5951cb71fd7f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:16.464343 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1bd2e-8dab-42aa-a803-5951cb71fd7f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:16.469582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71a94-a0ce-4e5f-a5bb-79918996230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:16.470370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71a94-a0ce-4e5f-a5bb-79918996230f admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.470652 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71a94-a0ce-4e5f-a5bb-79918996230f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.471045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71a94-a0ce-4e5f-a5bb-79918996230f admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.471796 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d71a94-a0ce-4e5f-a5bb-79918996230f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:55:16.472103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d71a94-a0ce-4e5f-a5bb-79918996230f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:16.473784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d71a94-a0ce-4e5f-a5bb-79918996230f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:16.488081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1149/2278] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:55:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:55:16.492248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-4c9d6704-8622-4929-8fa0-3ff045974b3d None None] MFA Rules not processed for user `47960dd1fdee4cd9892f115e7068824e`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:16.492830 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71a94-a0ce-4e5f-a5bb-79918996230f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:16.505369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71a94-a0ce-4e5f-a5bb-79918996230f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:16.513587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa68558-4bcf-489b-b915-cb244d75bcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:16.514284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa68558-4bcf-489b-b915-cb244d75bcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.514575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa68558-4bcf-489b-b915-cb244d75bcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.514893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4c9d6704-8622-4929-8fa0-3ff045974b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:16.515033 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa68558-4bcf-489b-b915-cb244d75bcc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.515834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa68558-4bcf-489b-b915-cb244d75bcc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:16.517954 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa68558-4bcf-489b-b915-cb244d75bcc2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:16.555427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1150/2279] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:55:16 2022] POST /identity/v3/projects => generated 384 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:16.559901 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa68558-4bcf-489b-b915-cb244d75bcc2 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:16.584337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:16.612169 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1130/2280] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:16.624207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d6704-8622-4929-8fa0-3ff045974b3d None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:16.625735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4c9d6704-8622-4929-8fa0-3ff045974b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:16.654718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa68558-4bcf-489b-b915-cb244d75bcc2 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:16.667908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b67858-2d52-490e-8526-56024fd8c5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:16.672816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67858-2d52-490e-8526-56024fd8c5ff admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.672816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67858-2d52-490e-8526-56024fd8c5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.672816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67858-2d52-490e-8526-56024fd8c5ff admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.672816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b67858-2d52-490e-8526-56024fd8c5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:16.679037 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b67858-2d52-490e-8526-56024fd8c5ff admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:16.709095 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1151/2281] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:55:16 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:16.713767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b67858-2d52-490e-8526-56024fd8c5ff admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:16.724526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b67858-2d52-490e-8526-56024fd8c5ff admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:16.731730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949785da-3a1b-441f-917e-e3325f35e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:16.733575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949785da-3a1b-441f-917e-e3325f35e19c admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.733864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949785da-3a1b-441f-917e-e3325f35e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.734145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949785da-3a1b-441f-917e-e3325f35e19c admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.734878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949785da-3a1b-441f-917e-e3325f35e19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:16.735580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d6704-8622-4929-8fa0-3ff045974b3d None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:16.736588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949785da-3a1b-441f-917e-e3325f35e19c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:16.757610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1152/2282] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:16 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:55:16.760788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949785da-3a1b-441f-917e-e3325f35e19c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:16.773130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949785da-3a1b-441f-917e-e3325f35e19c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:16.779031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce860564-e7f7-4515-a54e-582bc0d27d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:16.779808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860564-e7f7-4515-a54e-582bc0d27d3e admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.780190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860564-e7f7-4515-a54e-582bc0d27d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.780732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860564-e7f7-4515-a54e-582bc0d27d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.781672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce860564-e7f7-4515-a54e-582bc0d27d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:16.784294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce860564-e7f7-4515-a54e-582bc0d27d3e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:16.798279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1153/2283] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:16 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:16.803219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce860564-e7f7-4515-a54e-582bc0d27d3e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:16.815220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce860564-e7f7-4515-a54e-582bc0d27d3e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:16.820116 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a407c-b607-4c76-8b29-de20487c355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:16.820809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a407c-b607-4c76-8b29-de20487c355b admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.821089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a407c-b607-4c76-8b29-de20487c355b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.821369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a407c-b607-4c76-8b29-de20487c355b admin admin] PATH_INFO: `/v3/projects/0384eb2e221e4886ae55816625f7a2d8/users/e73396a25e87410fb73697ac8e92833f/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.822980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d235909-286f-4144-90ce-ea554b38024b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:16.823656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d235909-286f-4144-90ce-ea554b38024b service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.823938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d235909-286f-4144-90ce-ea554b38024b service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.824848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d235909-286f-4144-90ce-ea554b38024b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.826757 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2d235909-286f-4144-90ce-ea554b38024b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:16.837919 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a407c-b607-4c76-8b29-de20487c355b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0384eb2e221e4886ae55816625f7a2d8, user_id=e73396a25e87410fb73697ac8e92833f, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:16.840776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a407c-b607-4c76-8b29-de20487c355b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:16.856044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1154/2284] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:16 2022] PUT /identity/v3/projects/0384eb2e221e4886ae55816625f7a2d8/users/e73396a25e87410fb73697ac8e92833f/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:16.862190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218e774-4865-4d6b-92cc-cd3e4bd7d277 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:16.862571 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218e774-4865-4d6b-92cc-cd3e4bd7d277 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:16.862871 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218e774-4865-4d6b-92cc-cd3e4bd7d277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:16.882043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-c218e774-4865-4d6b-92cc-cd3e4bd7d277 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:16.883293 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c218e774-4865-4d6b-92cc-cd3e4bd7d277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:16.890754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d235909-286f-4144-90ce-ea554b38024b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:16.892468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d235909-286f-4144-90ce-ea554b38024b service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:16.902878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1131/2285] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:16.936487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:16.983013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1155/2286] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:16.992017 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d235909-286f-4144-90ce-ea554b38024b service nova] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:16.993679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2d235909-286f-4144-90ce-ea554b38024b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:17.022108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:17.058578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d235909-286f-4144-90ce-ea554b38024b service nova] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:17.119795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54093611-9488-400d-a1bf-ceab8d2231c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:17.120362 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54093611-9488-400d-a1bf-ceab8d2231c1 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:17.120644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54093611-9488-400d-a1bf-ceab8d2231c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:17.120918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54093611-9488-400d-a1bf-ceab8d2231c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:17.131090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54093611-9488-400d-a1bf-ceab8d2231c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:17.132545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54093611-9488-400d-a1bf-ceab8d2231c1 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:17.143296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1132/2287] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:24.523480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e58e0-ecb1-479b-aedb-941d718bcda7 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:24.524058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e58e0-ecb1-479b-aedb-941d718bcda7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:24.524058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e58e0-ecb1-479b-aedb-941d718bcda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:24.555812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-e69e58e0-ecb1-479b-aedb-941d718bcda7 None None] MFA Rules not processed for user `e73396a25e87410fb73697ac8e92833f`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:24.558101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e69e58e0-ecb1-479b-aedb-941d718bcda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:24.631473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1156/2288] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:24.636771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54093611-9488-400d-a1bf-ceab8d2231c1 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:24.646649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54093611-9488-400d-a1bf-ceab8d2231c1 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:24.651937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5263c92-7f53-4c24-a492-069e132d6c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:24.652562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5263c92-7f53-4c24-a492-069e132d6c84 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:24.652901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5263c92-7f53-4c24-a492-069e132d6c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:24.653208 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5263c92-7f53-4c24-a492-069e132d6c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:24.653890 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5263c92-7f53-4c24-a492-069e132d6c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:24.655862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5263c92-7f53-4c24-a492-069e132d6c84 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:24.690407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1133/2289] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:55:24 2022] POST /identity/v3/projects => generated 386 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:24.696392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e58e0-ecb1-479b-aedb-941d718bcda7 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:24.708840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e58e0-ecb1-479b-aedb-941d718bcda7 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:24.774596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3972b-3f04-4fe0-8343-d276eae6a381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:24.775727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3972b-3f04-4fe0-8343-d276eae6a381 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:24.776081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3972b-3f04-4fe0-8343-d276eae6a381 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:24.776448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3972b-3f04-4fe0-8343-d276eae6a381 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:24.777385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3972b-3f04-4fe0-8343-d276eae6a381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:24.779854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3972b-3f04-4fe0-8343-d276eae6a381 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:24.810347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1157/2290] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:55:24 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:24.811889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5263c92-7f53-4c24-a492-069e132d6c84 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:24.825951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5263c92-7f53-4c24-a492-069e132d6c84 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:24.831180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc59b21-dcda-4a78-a33b-aa544ca522ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:24.832100 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc59b21-dcda-4a78-a33b-aa544ca522ba admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:24.832476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc59b21-dcda-4a78-a33b-aa544ca522ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:24.832849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc59b21-dcda-4a78-a33b-aa544ca522ba admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:24.833693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc59b21-dcda-4a78-a33b-aa544ca522ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:24.835795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc59b21-dcda-4a78-a33b-aa544ca522ba admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:24.848899 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1134/2291] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:24 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:24.853479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3972b-3f04-4fe0-8343-d276eae6a381 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:24.865440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3972b-3f04-4fe0-8343-d276eae6a381 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:24.878113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3449d47-dda4-4957-b8ba-baf41ddc496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:24.878829 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449d47-dda4-4957-b8ba-baf41ddc496b admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:24.879141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449d47-dda4-4957-b8ba-baf41ddc496b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:24.879480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449d47-dda4-4957-b8ba-baf41ddc496b admin admin] PATH_INFO: `/v3/projects/2729ff31fe7e46d7b9011d49164646c5/users/24b085bd5b0c418d99f38130837241c8/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:24.900629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3449d47-dda4-4957-b8ba-baf41ddc496b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2729ff31fe7e46d7b9011d49164646c5, user_id=24b085bd5b0c418d99f38130837241c8, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:24.903687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3449d47-dda4-4957-b8ba-baf41ddc496b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:24.918873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1158/2292] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:24 2022] PUT /identity/v3/projects/2729ff31fe7e46d7b9011d49164646c5/users/24b085bd5b0c418d99f38130837241c8/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:24.922855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc59b21-dcda-4a78-a33b-aa544ca522ba admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:24.933662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc59b21-dcda-4a78-a33b-aa544ca522ba admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:25.002927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b82f4-dfc9-4381-a8f6-460c2bc238a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:25.003951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b82f4-dfc9-4381-a8f6-460c2bc238a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:25.004306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b82f4-dfc9-4381-a8f6-460c2bc238a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:25.004652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b82f4-dfc9-4381-a8f6-460c2bc238a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:25.005523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b82f4-dfc9-4381-a8f6-460c2bc238a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:25.007642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b82f4-dfc9-4381-a8f6-460c2bc238a4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:25.025782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1135/2293] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:24 2022] GET /identity/v3/roles => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:25.030088 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3449d47-dda4-4957-b8ba-baf41ddc496b admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:25.042896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3449d47-dda4-4957-b8ba-baf41ddc496b admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:25.054379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91255a-5ec1-4a2f-944b-a33829a16a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:25.055454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91255a-5ec1-4a2f-944b-a33829a16a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:25.055814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91255a-5ec1-4a2f-944b-a33829a16a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:25.056166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91255a-5ec1-4a2f-944b-a33829a16a23 admin admin] PATH_INFO: `/v3/projects/2729ff31fe7e46d7b9011d49164646c5/users/24b085bd5b0c418d99f38130837241c8/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:25.059059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91255a-5ec1-4a2f-944b-a33829a16a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2729ff31fe7e46d7b9011d49164646c5, user_id=24b085bd5b0c418d99f38130837241c8, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:25.061807 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91255a-5ec1-4a2f-944b-a33829a16a23 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:25.075663 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1159/2294] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:25 2022] PUT /identity/v3/projects/2729ff31fe7e46d7b9011d49164646c5/users/24b085bd5b0c418d99f38130837241c8/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:25.576803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b82f4-dfc9-4381-a8f6-460c2bc238a4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:25.578920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-875b82f4-dfc9-4381-a8f6-460c2bc238a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:25.597320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b82f4-dfc9-4381-a8f6-460c2bc238a4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:25.681143 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:25.706194 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:25.706909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:25.707257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:25.707741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] PATH_INFO: `/v3/users/f21db14048b149c394711418a732ffcf` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:25.709295 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21db14048b149c394711418a732ffcf)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:25.712259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:25.798184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21db14048b149c394711418a732ffcf'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:25.798932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21db14048b149c394711418a732ffcf'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:25.816091 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21db14048b149c394711418a732ffcf'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:25.816856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21db14048b149c394711418a732ffcf'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:25.827701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21db14048b149c394711418a732ffcf'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:25.849552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1136/2295] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:55:25 2022] DELETE /identity/v3/users/f21db14048b149c394711418a732ffcf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:25.856965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6f00-b170-4bba-beee-0992d4443494 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:25.857544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6f00-b170-4bba-beee-0992d4443494 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:25.857626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6f00-b170-4bba-beee-0992d4443494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:25.879897 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-eb5c6f00-b170-4bba-beee-0992d4443494 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:25.881147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-eb5c6f00-b170-4bba-beee-0992d4443494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:25.902412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:26.029818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1160/2296] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:26.057975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:26.059540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:26.162315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407c712-e53f-4f32-956a-e04d93c5cb5a admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:26.168705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8036a35-42ba-429c-9377-a129f005e8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:26.169398 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036a35-42ba-429c-9377-a129f005e8df service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:26.169635 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036a35-42ba-429c-9377-a129f005e8df service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:26.170008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036a35-42ba-429c-9377-a129f005e8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:26.209681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8036a35-42ba-429c-9377-a129f005e8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:26.212219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8036a35-42ba-429c-9377-a129f005e8df service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:26.241637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1137/2297] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:27.493884 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c6f00-b170-4bba-beee-0992d4443494 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:27.500990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-eb5c6f00-b170-4bba-beee-0992d4443494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:27.525508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c6f00-b170-4bba-beee-0992d4443494 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:27.538673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:27.539306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:27.539596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:27.539869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] PATH_INFO: `/v3/projects/ced9906db29f4684bb9b97921389937b` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:27.541340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced9906db29f4684bb9b97921389937b)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:27.543402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:27.654455 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced9906db29f4684bb9b97921389937b', 'request_id': 'req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:27.672952 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced9906db29f4684bb9b97921389937b', 'request_id': 'req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:27.695983 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced9906db29f4684bb9b97921389937b', 'request_id': 'req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:27.719404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] The token cache is being invalidate because project ced9906db29f4684bb9b97921389937b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:55:27.719767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:27.720429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-47e9c4fc-d377-46d9-9a30-f6f6b94dab0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:27.724853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1161/2298] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:55:27 2022] DELETE /identity/v3/projects/ced9906db29f4684bb9b97921389937b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:55:29.126256 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8036a35-42ba-429c-9377-a129f005e8df service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:29.127704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a8036a35-42ba-429c-9377-a129f005e8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:29.142642 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8036a35-42ba-429c-9377-a129f005e8df service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:29.226595 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:29.227387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:29.227971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:29.228243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] PATH_INFO: `/v3/users/f130bd3ef7264a06995a22d5fa76126e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:29.229750 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f130bd3ef7264a06995a22d5fa76126e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:29.233663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:29.242831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:29.297659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f130bd3ef7264a06995a22d5fa76126e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:29.298430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f130bd3ef7264a06995a22d5fa76126e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:29.311853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f130bd3ef7264a06995a22d5fa76126e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:29.312893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f130bd3ef7264a06995a22d5fa76126e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:29.322610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f130bd3ef7264a06995a22d5fa76126e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:29.345888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1138/2299] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:55:29 2022] DELETE /identity/v3/users/f130bd3ef7264a06995a22d5fa76126e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:29.347008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b2037-608d-4b71-8596-fd498f716171 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:29.347495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b2037-608d-4b71-8596-fd498f716171 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:29.347599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b2037-608d-4b71-8596-fd498f716171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:29.369891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-780b2037-608d-4b71-8596-fd498f716171 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:29.372794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-780b2037-608d-4b71-8596-fd498f716171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:29.445643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1162/2300] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:29.456249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:29.457876 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:29.524684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55c9ad-3fbe-43a1-af4d-353e18e7f348 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:29.530486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b956a-1608-4ff7-822d-76debf34af84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:29.531372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b956a-1608-4ff7-822d-76debf34af84 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:29.531750 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b956a-1608-4ff7-822d-76debf34af84 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:29.533613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b956a-1608-4ff7-822d-76debf34af84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:29.543659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b956a-1608-4ff7-822d-76debf34af84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:29.545546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b956a-1608-4ff7-822d-76debf34af84 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:29.572708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1139/2301] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:55:30.120208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b2037-608d-4b71-8596-fd498f716171 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:30.123698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-780b2037-608d-4b71-8596-fd498f716171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:30.163121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b2037-608d-4b71-8596-fd498f716171 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:30.176292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:30.177206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:30.177682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:30.178098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] PATH_INFO: `/v3/projects/847f66d446a14706b69870be59f8f40b` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:30.184622 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=847f66d446a14706b69870be59f8f40b)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:30.187932 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:30.280817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:30.298702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847f66d446a14706b69870be59f8f40b', 'request_id': 'req-93124295-07af-43b2-b6a1-bd35c82db03a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:30.315090 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847f66d446a14706b69870be59f8f40b', 'request_id': 'req-93124295-07af-43b2-b6a1-bd35c82db03a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:30.326515 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847f66d446a14706b69870be59f8f40b', 'request_id': 'req-93124295-07af-43b2-b6a1-bd35c82db03a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:30.343692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] The token cache is being invalidate because project 847f66d446a14706b69870be59f8f40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:55:30.344006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:30.344680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-93124295-07af-43b2-b6a1-bd35c82db03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:55:30.347789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1163/2302] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:55:30 2022] DELETE /identity/v3/projects/847f66d446a14706b69870be59f8f40b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:55:30.352749 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349cc5c-e03e-41a0-9277-9c3eb38870a8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:30.353186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349cc5c-e03e-41a0-9277-9c3eb38870a8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:30.353301 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349cc5c-e03e-41a0-9277-9c3eb38870a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:30.375171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e349cc5c-e03e-41a0-9277-9c3eb38870a8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:30.377024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e349cc5c-e03e-41a0-9277-9c3eb38870a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:30.473849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1140/2303] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:30.482186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343721b5-a3c9-4072-9868-9d075d68456f None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:30.482538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343721b5-a3c9-4072-9868-9d075d68456f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:30.482824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343721b5-a3c9-4072-9868-9d075d68456f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:30.527686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-343721b5-a3c9-4072-9868-9d075d68456f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:30.529291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-343721b5-a3c9-4072-9868-9d075d68456f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:30.539206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1164/2304] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:30.543514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349cc5c-e03e-41a0-9277-9c3eb38870a8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:30.556109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349cc5c-e03e-41a0-9277-9c3eb38870a8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:30.562832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e2952-2459-4357-a191-6af01f676628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:30.562832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e2952-2459-4357-a191-6af01f676628 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:30.563160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e2952-2459-4357-a191-6af01f676628 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:30.563405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e2952-2459-4357-a191-6af01f676628 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:30.564122 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e2952-2459-4357-a191-6af01f676628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:55:30.564430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e2952-2459-4357-a191-6af01f676628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:30.566176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e2952-2459-4357-a191-6af01f676628 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:30.585961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1141/2305] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:55:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:55:30.586624 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343721b5-a3c9-4072-9868-9d075d68456f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:30.600631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343721b5-a3c9-4072-9868-9d075d68456f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:30.639706 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f718542-ce4c-4afe-9755-a978a5920670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:30.640633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f718542-ce4c-4afe-9755-a978a5920670 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:30.642465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f718542-ce4c-4afe-9755-a978a5920670 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:30.642921 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f718542-ce4c-4afe-9755-a978a5920670 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:30.645667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f718542-ce4c-4afe-9755-a978a5920670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:30.653800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f718542-ce4c-4afe-9755-a978a5920670 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:30.727381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1165/2306] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:55:30 2022] POST /identity/v3/projects => generated 366 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:55:30.732710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e2952-2459-4357-a191-6af01f676628 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:30.745861 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e2952-2459-4357-a191-6af01f676628 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:30.764047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:30.828645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33e096-f6b8-4f01-a2bb-d9ef9d4fceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:30.829362 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e096-f6b8-4f01-a2bb-d9ef9d4fceda admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:30.829600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e096-f6b8-4f01-a2bb-d9ef9d4fceda admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:30.829874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e096-f6b8-4f01-a2bb-d9ef9d4fceda admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:30.830592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33e096-f6b8-4f01-a2bb-d9ef9d4fceda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:30.832771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33e096-f6b8-4f01-a2bb-d9ef9d4fceda admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:30.861281 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1142/2307] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:55:30 2022] POST /identity/v3/users => generated 284 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:55:30.865745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f718542-ce4c-4afe-9755-a978a5920670 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:30.878319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f718542-ce4c-4afe-9755-a978a5920670 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:30.884457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbf33b-685e-4a68-a31d-5dcc0b92a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:30.885544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf33b-685e-4a68-a31d-5dcc0b92a1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:30.886011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf33b-685e-4a68-a31d-5dcc0b92a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:30.886459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf33b-685e-4a68-a31d-5dcc0b92a1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:30.887442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbf33b-685e-4a68-a31d-5dcc0b92a1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:30.889329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbf33b-685e-4a68-a31d-5dcc0b92a1f9 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:30.906035 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1166/2308] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:30 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:55:30.910162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33e096-f6b8-4f01-a2bb-d9ef9d4fceda admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:30.929095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33e096-f6b8-4f01-a2bb-d9ef9d4fceda admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:30.944975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b11342-dfa7-4528-a36e-4572dc382a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:30.945798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b11342-dfa7-4528-a36e-4572dc382a6d admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:30.946089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b11342-dfa7-4528-a36e-4572dc382a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:30.946373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b11342-dfa7-4528-a36e-4572dc382a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:30.947438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b11342-dfa7-4528-a36e-4572dc382a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:30.949175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b11342-dfa7-4528-a36e-4572dc382a6d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:30.972504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1143/2309] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:55:30 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:55:30.973675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbf33b-685e-4a68-a31d-5dcc0b92a1f9 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:30.985875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbf33b-685e-4a68-a31d-5dcc0b92a1f9 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:30.992226 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4547f5c-21fe-4583-a298-8b3dd28eb73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:30.992944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4547f5c-21fe-4583-a298-8b3dd28eb73e admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:30.993219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4547f5c-21fe-4583-a298-8b3dd28eb73e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:30.993691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4547f5c-21fe-4583-a298-8b3dd28eb73e admin admin] PATH_INFO: `/v3/projects/f8cc116824f244fcb801b8c6a11e27ce/users/d889e44c8687438e8fe74a0fbb463962/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:31.013029 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4547f5c-21fe-4583-a298-8b3dd28eb73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8cc116824f244fcb801b8c6a11e27ce, user_id=d889e44c8687438e8fe74a0fbb463962, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:31.016070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4547f5c-21fe-4583-a298-8b3dd28eb73e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:31.036616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1167/2310] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:55:30 2022] PUT /identity/v3/projects/f8cc116824f244fcb801b8c6a11e27ce/users/d889e44c8687438e8fe74a0fbb463962/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:55:31.047789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2517b-5f9c-431e-83c2-e871a9c97351 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:31.048396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2517b-5f9c-431e-83c2-e871a9c97351 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:31.048901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2517b-5f9c-431e-83c2-e871a9c97351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:31.101776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-fff2517b-5f9c-431e-83c2-e871a9c97351 None None] MFA Rules not processed for user `d889e44c8687438e8fe74a0fbb463962`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:31.103089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fff2517b-5f9c-431e-83c2-e871a9c97351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:31.201633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1144/2311] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:31.209666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4547f5c-21fe-4583-a298-8b3dd28eb73e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:31.212214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c4547f5c-21fe-4583-a298-8b3dd28eb73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:31.302839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4547f5c-21fe-4583-a298-8b3dd28eb73e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:31.308756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2105c-ab8d-4adc-94f1-ba7394231e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:31.310257 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2105c-ab8d-4adc-94f1-ba7394231e52 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:31.310758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2105c-ab8d-4adc-94f1-ba7394231e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:31.312770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2105c-ab8d-4adc-94f1-ba7394231e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:31.329001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2105c-ab8d-4adc-94f1-ba7394231e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:31.333202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2105c-ab8d-4adc-94f1-ba7394231e52 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:31.367371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1168/2312] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:32.773495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a08b0d-0051-4edf-bba3-f9ccbcd2ed01 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:32.775544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a08b0d-0051-4edf-bba3-f9ccbcd2ed01 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:32.776004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a08b0d-0051-4edf-bba3-f9ccbcd2ed01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:32.806998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f4a08b0d-0051-4edf-bba3-f9ccbcd2ed01 None None] MFA Rules not processed for user `24b085bd5b0c418d99f38130837241c8`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:32.808231 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f4a08b0d-0051-4edf-bba3-f9ccbcd2ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:32.935979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1145/2313] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:32.955213 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2105c-ab8d-4adc-94f1-ba7394231e52 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:32.956678 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-fbf2105c-ab8d-4adc-94f1-ba7394231e52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:33.020743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2105c-ab8d-4adc-94f1-ba7394231e52 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:33.024910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591bf62-37fa-4d46-9ce5-6576480dfce2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1cabb41d38a40acb7d41c169cc90cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:33.025781 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591bf62-37fa-4d46-9ce5-6576480dfce2 service glance] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:33.026133 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591bf62-37fa-4d46-9ce5-6576480dfce2 service glance] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:33.026407 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591bf62-37fa-4d46-9ce5-6576480dfce2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:33.028759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c591bf62-37fa-4d46-9ce5-6576480dfce2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:33.053896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:33.113071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591bf62-37fa-4d46-9ce5-6576480dfce2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:33.114718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591bf62-37fa-4d46-9ce5-6576480dfce2 service glance] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:33.125503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1169/2314] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:33.269696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dac9ae-dc34-4210-b2cb-a9d7cad3e15a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:33.270487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dac9ae-dc34-4210-b2cb-a9d7cad3e15a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:33.270986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dac9ae-dc34-4210-b2cb-a9d7cad3e15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:33.292822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d4dac9ae-dc34-4210-b2cb-a9d7cad3e15a None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:33.294715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d4dac9ae-dc34-4210-b2cb-a9d7cad3e15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:33.299578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:33.378336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1146/2315] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:55:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:33.395938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591bf62-37fa-4d46-9ce5-6576480dfce2 service glance] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:33.397583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c591bf62-37fa-4d46-9ce5-6576480dfce2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:33.520748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591bf62-37fa-4d46-9ce5-6576480dfce2 service glance] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:33.534413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abbdd5-cdff-4fae-8577-c40e48f85f7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:33.536149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abbdd5-cdff-4fae-8577-c40e48f85f7b service swift] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:33.536869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abbdd5-cdff-4fae-8577-c40e48f85f7b service swift] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:33.537898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abbdd5-cdff-4fae-8577-c40e48f85f7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:33.564181 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abbdd5-cdff-4fae-8577-c40e48f85f7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:33.569220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abbdd5-cdff-4fae-8577-c40e48f85f7b service swift] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:33.602184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1170/2316] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:55:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 16:55:42.657175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dac9ae-dc34-4210-b2cb-a9d7cad3e15a None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:42.675638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dac9ae-dc34-4210-b2cb-a9d7cad3e15a None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:42.685104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fce3a-2671-40ec-ab9d-f21f86136a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:42.685805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fce3a-2671-40ec-ab9d-f21f86136a23 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:42.686084 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fce3a-2671-40ec-ab9d-f21f86136a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:42.686387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fce3a-2671-40ec-ab9d-f21f86136a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:42.690197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-282fce3a-2671-40ec-ab9d-f21f86136a23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:42.810520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fce3a-2671-40ec-ab9d-f21f86136a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:42.812470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fce3a-2671-40ec-ab9d-f21f86136a23 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:42.825546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1147/2317] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:43.590891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=50 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:44.101363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d40ea-3242-4f95-b14e-a7b6637c0d8c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:44.101844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d40ea-3242-4f95-b14e-a7b6637c0d8c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:44.102272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d40ea-3242-4f95-b14e-a7b6637c0d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:44.134036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-417d40ea-3242-4f95-b14e-a7b6637c0d8c None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:44.136356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-417d40ea-3242-4f95-b14e-a7b6637c0d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:44.144528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1171/2318] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:55:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:44.164888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fce3a-2671-40ec-ab9d-f21f86136a23 service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:44.181539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fce3a-2671-40ec-ab9d-f21f86136a23 service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:44.187792 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7190a-8e9e-43c6-8f4f-6fb041f2aa50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:44.188820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7190a-8e9e-43c6-8f4f-6fb041f2aa50 service swift] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:44.189355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7190a-8e9e-43c6-8f4f-6fb041f2aa50 service swift] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:44.189992 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7190a-8e9e-43c6-8f4f-6fb041f2aa50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:44.207983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7190a-8e9e-43c6-8f4f-6fb041f2aa50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:44.209690 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7190a-8e9e-43c6-8f4f-6fb041f2aa50 service swift] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:44.225359 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1148/2319] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:55:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:55:45.715519 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088139-640e-4a1a-aebe-791bec708d50 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:45.716493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088139-640e-4a1a-aebe-791bec708d50 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:45.716989 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088139-640e-4a1a-aebe-791bec708d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:45.747585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-dd088139-640e-4a1a-aebe-791bec708d50 None None] MFA Rules not processed for user `e73396a25e87410fb73697ac8e92833f`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:45.748843 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-dd088139-640e-4a1a-aebe-791bec708d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:45.762536 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1172/2320] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:55:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:54.219499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=57 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:55.738819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=6 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:01.848287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873fb21-b0ac-479d-95a3-ca7a0190a8fa None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:01.849495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873fb21-b0ac-479d-95a3-ca7a0190a8fa None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:01.850135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873fb21-b0ac-479d-95a3-ca7a0190a8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:01.879720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-c873fb21-b0ac-479d-95a3-ca7a0190a8fa None None] MFA Rules not processed for user `8ef71e3a38c245d5a008368c23e701d7`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:01.881029 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c873fb21-b0ac-479d-95a3-ca7a0190a8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:01.966854 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1149/2321] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:07.644475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd088139-640e-4a1a-aebe-791bec708d50 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:07.647061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-dd088139-640e-4a1a-aebe-791bec708d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:07.786923 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cae4e-8e41-43c9-9c9b-1f0d840c11fc None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:07.788338 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cae4e-8e41-43c9-9c9b-1f0d840c11fc None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:07.788777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cae4e-8e41-43c9-9c9b-1f0d840c11fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:07.797816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd088139-640e-4a1a-aebe-791bec708d50 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:07.805221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:07.806804 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:07.807508 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:07.808394 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] PATH_INFO: `/v3/users/47960dd1fdee4cd9892f115e7068824e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:07.810912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47960dd1fdee4cd9892f115e7068824e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:07.814699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:07.823379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-dd2cae4e-8e41-43c9-9c9b-1f0d840c11fc None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:07.825509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-dd2cae4e-8e41-43c9-9c9b-1f0d840c11fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:07.840596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1150/2322] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:56:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:07.867193 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cae4e-8e41-43c9-9c9b-1f0d840c11fc None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:07.884238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cae4e-8e41-43c9-9c9b-1f0d840c11fc None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:07.891796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fb788-5850-417a-9981-059659801dc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:07.893276 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fb788-5850-417a-9981-059659801dc9 service swift] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:07.893869 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fb788-5850-417a-9981-059659801dc9 service swift] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:07.894354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fb788-5850-417a-9981-059659801dc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:07.906488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fb788-5850-417a-9981-059659801dc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:07.908819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fb788-5850-417a-9981-059659801dc9 service swift] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:07.915437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47960dd1fdee4cd9892f115e7068824e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:07.921395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1151/2323] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:56:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 16:56:07.930712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47960dd1fdee4cd9892f115e7068824e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:07.947493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47960dd1fdee4cd9892f115e7068824e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:07.953149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47960dd1fdee4cd9892f115e7068824e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:07.955866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47960dd1fdee4cd9892f115e7068824e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:07.988991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1173/2324] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:56:07 2022] DELETE /identity/v3/users/47960dd1fdee4cd9892f115e7068824e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:08.410105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fb788-5850-417a-9981-059659801dc9 service swift] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:08.433447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fb788-5850-417a-9981-059659801dc9 service swift] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:08.602804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:08.605447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:08.606388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:08.608614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] PATH_INFO: `/v3/projects/9deffe39e2ff463eb49d4069d617ab71` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:08.612010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9deffe39e2ff463eb49d4069d617ab71)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:08.614108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:08.735883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9deffe39e2ff463eb49d4069d617ab71', 'request_id': 'req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:08.758625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9deffe39e2ff463eb49d4069d617ab71', 'request_id': 'req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:08.776211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9deffe39e2ff463eb49d4069d617ab71', 'request_id': 'req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:08.812985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] The token cache is being invalidate because project 9deffe39e2ff463eb49d4069d617ab71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:56:08.813849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:08.816319 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:08.821389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1152/2325] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:56:08 2022] DELETE /identity/v3/projects/9deffe39e2ff463eb49d4069d617ab71 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:08.828798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:08.830721 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:08.857405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fc091-46af-42ec-ba77-1f6055ca4dd3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:08.963955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73ca66-225b-4f99-a573-9a1b933934bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:08.966206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73ca66-225b-4f99-a573-9a1b933934bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:08.966735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73ca66-225b-4f99-a573-9a1b933934bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:08.967340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73ca66-225b-4f99-a573-9a1b933934bb admin admin] PATH_INFO: `/v3/users/5d066db8da934ed4a9e13b0256ef250a` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:08.969073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73ca66-225b-4f99-a573-9a1b933934bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d066db8da934ed4a9e13b0256ef250a)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:08.972363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73ca66-225b-4f99-a573-9a1b933934bb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:09.015488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:09.118983 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dd73ca66-225b-4f99-a573-9a1b933934bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d066db8da934ed4a9e13b0256ef250a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:09.135759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dd73ca66-225b-4f99-a573-9a1b933934bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d066db8da934ed4a9e13b0256ef250a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:09.161788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dd73ca66-225b-4f99-a573-9a1b933934bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d066db8da934ed4a9e13b0256ef250a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:09.164766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dd73ca66-225b-4f99-a573-9a1b933934bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d066db8da934ed4a9e13b0256ef250a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:09.167784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dd73ca66-225b-4f99-a573-9a1b933934bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d066db8da934ed4a9e13b0256ef250a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:09.215431 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1174/2326] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:56:08 2022] DELETE /identity/v3/users/5d066db8da934ed4a9e13b0256ef250a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:09.575174 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:09.576912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:09.606470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2edf0-5c0a-4c41-8ff9-7ebe6f7d7a6d admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:09.634763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:09.765654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:09.768085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:09.770322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:09.770719 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] PATH_INFO: `/v3/projects/a2e1bd052d02494c87ddae662297e246` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:09.772853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e1bd052d02494c87ddae662297e246)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:09.776541 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:09.882598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e1bd052d02494c87ddae662297e246', 'request_id': 'req-3700618f-1d97-4b2c-a0a1-691b9db84abb'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:09.897940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e1bd052d02494c87ddae662297e246', 'request_id': 'req-3700618f-1d97-4b2c-a0a1-691b9db84abb'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:09.907884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e1bd052d02494c87ddae662297e246', 'request_id': 'req-3700618f-1d97-4b2c-a0a1-691b9db84abb'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:09.932034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] The token cache is being invalidate because project a2e1bd052d02494c87ddae662297e246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:56:09.932406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:09.933700 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3700618f-1d97-4b2c-a0a1-691b9db84abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:09.938072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1153/2327] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:56:09 2022] DELETE /identity/v3/projects/a2e1bd052d02494c87ddae662297e246 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:09.945268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982626ee-dec1-4379-8f24-4b4e5f5c1c7d None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:09.946370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982626ee-dec1-4379-8f24-4b4e5f5c1c7d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:09.946923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982626ee-dec1-4379-8f24-4b4e5f5c1c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.008353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-982626ee-dec1-4379-8f24-4b4e5f5c1c7d None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:10.008353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-982626ee-dec1-4379-8f24-4b4e5f5c1c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:10.103726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1c28-c8ea-472a-be28-4b0ac566f548 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:10.104083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1c28-c8ea-472a-be28-4b0ac566f548 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:10.104849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1c28-c8ea-472a-be28-4b0ac566f548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.109782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1175/2328] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:10.211503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ad6e1c28-c8ea-472a-be28-4b0ac566f548 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:10.211503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ad6e1c28-c8ea-472a-be28-4b0ac566f548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:10.225009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1154/2329] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:10.226836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982626ee-dec1-4379-8f24-4b4e5f5c1c7d None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:10.252516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982626ee-dec1-4379-8f24-4b4e5f5c1c7d None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:10.270986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b6e9-a649-4891-8cb1-a02f6c288a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:10.270986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b6e9-a649-4891-8cb1-a02f6c288a47 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:10.270986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b6e9-a649-4891-8cb1-a02f6c288a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:10.270986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b6e9-a649-4891-8cb1-a02f6c288a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.271490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042b6e9-a649-4891-8cb1-a02f6c288a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:56:10.271490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042b6e9-a649-4891-8cb1-a02f6c288a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:10.271490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042b6e9-a649-4891-8cb1-a02f6c288a47 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:10.304392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1176/2330] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:56:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:56:10.305570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e1c28-c8ea-472a-be28-4b0ac566f548 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:10.343614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e1c28-c8ea-472a-be28-4b0ac566f548 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:10.364560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705591d7-62e1-4d37-8d90-865c7606e625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:10.367008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705591d7-62e1-4d37-8d90-865c7606e625 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:10.367397 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705591d7-62e1-4d37-8d90-865c7606e625 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:10.367754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705591d7-62e1-4d37-8d90-865c7606e625 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.370773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705591d7-62e1-4d37-8d90-865c7606e625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:10.375741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705591d7-62e1-4d37-8d90-865c7606e625 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:10.448453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1155/2331] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:56:10 2022] POST /identity/v3/projects => generated 384 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:56:10.453279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b6e9-a649-4891-8cb1-a02f6c288a47 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:10.465104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b6e9-a649-4891-8cb1-a02f6c288a47 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:10.581083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380d8fd-4d34-4008-96a9-49042ba8d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:10.582328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380d8fd-4d34-4008-96a9-49042ba8d220 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:10.582818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380d8fd-4d34-4008-96a9-49042ba8d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:10.583539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380d8fd-4d34-4008-96a9-49042ba8d220 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.584583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380d8fd-4d34-4008-96a9-49042ba8d220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:10.587526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380d8fd-4d34-4008-96a9-49042ba8d220 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:10.621886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1177/2332] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:56:10 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:56:10.626350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705591d7-62e1-4d37-8d90-865c7606e625 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:10.641175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705591d7-62e1-4d37-8d90-865c7606e625 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:10.647811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f314dc-6c0f-4712-be33-385f9b033840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:10.648936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f314dc-6c0f-4712-be33-385f9b033840 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:10.649807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f314dc-6c0f-4712-be33-385f9b033840 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:10.649807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f314dc-6c0f-4712-be33-385f9b033840 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.651072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f314dc-6c0f-4712-be33-385f9b033840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:10.653860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f314dc-6c0f-4712-be33-385f9b033840 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:10.698246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1156/2333] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:10 2022] GET /identity/v3/roles => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:56:10.700402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380d8fd-4d34-4008-96a9-49042ba8d220 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:10.752562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380d8fd-4d34-4008-96a9-49042ba8d220 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:10.769041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835ffcd-3a5a-4325-8d1f-294e84444d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:10.770162 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ffcd-3a5a-4325-8d1f-294e84444d0f admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:10.771472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ffcd-3a5a-4325-8d1f-294e84444d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:10.772024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ffcd-3a5a-4325-8d1f-294e84444d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.775301 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835ffcd-3a5a-4325-8d1f-294e84444d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:10.777489 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835ffcd-3a5a-4325-8d1f-294e84444d0f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:10.816538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1178/2334] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:10 2022] GET /identity/v3/roles => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:56:10.821241 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f314dc-6c0f-4712-be33-385f9b033840 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:10.842157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f314dc-6c0f-4712-be33-385f9b033840 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:10.861001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b1d26-4e23-45b3-ab62-b92df2acb2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:10.861924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b1d26-4e23-45b3-ab62-b92df2acb2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:10.862297 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b1d26-4e23-45b3-ab62-b92df2acb2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:10.862689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b1d26-4e23-45b3-ab62-b92df2acb2f4 admin admin] PATH_INFO: `/v3/projects/2badcc4c5234417daad7b47bfd12a6e5/users/2f584e8b3e4c4721a56e7fa99f9a3d91/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.904932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b1d26-4e23-45b3-ab62-b92df2acb2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2badcc4c5234417daad7b47bfd12a6e5, user_id=2f584e8b3e4c4721a56e7fa99f9a3d91, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:10.909526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b1d26-4e23-45b3-ab62-b92df2acb2f4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:10.960725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1157/2335] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:56:10 2022] PUT /identity/v3/projects/2badcc4c5234417daad7b47bfd12a6e5/users/2f584e8b3e4c4721a56e7fa99f9a3d91/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:10.971239 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dc963-a958-403f-b7ef-1b7fe46be0e4 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:10.971881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dc963-a958-403f-b7ef-1b7fe46be0e4 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:10.972202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dc963-a958-403f-b7ef-1b7fe46be0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.987277 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:11.064353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ba7dc963-a958-403f-b7ef-1b7fe46be0e4 None None] MFA Rules not processed for user `2f584e8b3e4c4721a56e7fa99f9a3d91`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:11.068384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ba7dc963-a958-403f-b7ef-1b7fe46be0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:11.297306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1179/2336] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:11.303355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b1d26-4e23-45b3-ab62-b92df2acb2f4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:11.430797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:11.473836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b1d26-4e23-45b3-ab62-b92df2acb2f4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:11.488763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48543a-6997-49b0-bef1-3fb620eb2d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:11.489440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48543a-6997-49b0-bef1-3fb620eb2d9e admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:11.489713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48543a-6997-49b0-bef1-3fb620eb2d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:11.489985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48543a-6997-49b0-bef1-3fb620eb2d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:11.490677 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48543a-6997-49b0-bef1-3fb620eb2d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:11.497752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48543a-6997-49b0-bef1-3fb620eb2d9e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:11.557545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1158/2337] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:56:11 2022] POST /identity/v3/projects => generated 386 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:56:11.561695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dc963-a958-403f-b7ef-1b7fe46be0e4 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:11.586864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dc963-a958-403f-b7ef-1b7fe46be0e4 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:11.745896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e79e1-79d9-47ff-8029-4346a0b9ed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:11.746716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e79e1-79d9-47ff-8029-4346a0b9ed73 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:11.747882 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e79e1-79d9-47ff-8029-4346a0b9ed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:11.748842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e79e1-79d9-47ff-8029-4346a0b9ed73 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:11.750926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e79e1-79d9-47ff-8029-4346a0b9ed73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:11.753336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e79e1-79d9-47ff-8029-4346a0b9ed73 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:11.784583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1180/2338] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:56:11 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:56:11.788730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48543a-6997-49b0-bef1-3fb620eb2d9e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:11.804971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48543a-6997-49b0-bef1-3fb620eb2d9e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:11.817963 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229588c-2687-40fd-90df-3fb0f287b66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:11.818836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229588c-2687-40fd-90df-3fb0f287b66b admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:11.819260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229588c-2687-40fd-90df-3fb0f287b66b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:11.819557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229588c-2687-40fd-90df-3fb0f287b66b admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:11.820284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229588c-2687-40fd-90df-3fb0f287b66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:11.821924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229588c-2687-40fd-90df-3fb0f287b66b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:11.840276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e79e1-79d9-47ff-8029-4346a0b9ed73 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:11.841407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1159/2339] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:11 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:56:11.855725 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e79e1-79d9-47ff-8029-4346a0b9ed73 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:11.869660 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6768a0c-445d-46f1-a2a1-fb619cd5dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:11.871215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6768a0c-445d-46f1-a2a1-fb619cd5dc3d admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:11.872565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6768a0c-445d-46f1-a2a1-fb619cd5dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:11.873018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6768a0c-445d-46f1-a2a1-fb619cd5dc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:11.875933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6768a0c-445d-46f1-a2a1-fb619cd5dc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:11.878864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6768a0c-445d-46f1-a2a1-fb619cd5dc3d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:11.892560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1181/2340] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:11 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:56:11.897318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229588c-2687-40fd-90df-3fb0f287b66b admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:11.908415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229588c-2687-40fd-90df-3fb0f287b66b admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:11.914892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c72e65-106d-4979-8d99-cc60820c25e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:11.915804 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c72e65-106d-4979-8d99-cc60820c25e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:11.916172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c72e65-106d-4979-8d99-cc60820c25e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:11.916533 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c72e65-106d-4979-8d99-cc60820c25e7 admin admin] PATH_INFO: `/v3/projects/99c3d6ab82df443ea733a346dbf6d4e8/users/9258f0c95a7a4085a7e826535b6e1010/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:11.934234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c72e65-106d-4979-8d99-cc60820c25e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c3d6ab82df443ea733a346dbf6d4e8, user_id=9258f0c95a7a4085a7e826535b6e1010, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:11.937107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c72e65-106d-4979-8d99-cc60820c25e7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:11.957488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1160/2341] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:56:11 2022] PUT /identity/v3/projects/99c3d6ab82df443ea733a346dbf6d4e8/users/9258f0c95a7a4085a7e826535b6e1010/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:11.971713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2e756-ad62-43d6-bac0-dc89b0c2e3dd None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:11.972334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2e756-ad62-43d6-bac0-dc89b0c2e3dd None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:11.973115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2e756-ad62-43d6-bac0-dc89b0c2e3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:12.018715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-1ad2e756-ad62-43d6-bac0-dc89b0c2e3dd None None] MFA Rules not processed for user `9258f0c95a7a4085a7e826535b6e1010`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:12.020163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1ad2e756-ad62-43d6-bac0-dc89b0c2e3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:12.105913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1182/2342] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:12.111098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c72e65-106d-4979-8d99-cc60820c25e7 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:12.212881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c72e65-106d-4979-8d99-cc60820c25e7 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:12.217924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954839-4d8a-4d75-8a43-27dd17af8683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:12.218575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954839-4d8a-4d75-8a43-27dd17af8683 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:12.218856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954839-4d8a-4d75-8a43-27dd17af8683 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:12.219178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954839-4d8a-4d75-8a43-27dd17af8683 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:12.219889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c954839-4d8a-4d75-8a43-27dd17af8683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:12.222357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c954839-4d8a-4d75-8a43-27dd17af8683 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:12.280850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1161/2343] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:56:12 2022] POST /identity/v3/projects => generated 384 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:56:12.285169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2e756-ad62-43d6-bac0-dc89b0c2e3dd None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:12.290990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:12.299852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2e756-ad62-43d6-bac0-dc89b0c2e3dd None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:12.369457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2aafa-a12c-4599-8f72-146f773cac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:12.370103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2aafa-a12c-4599-8f72-146f773cac25 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:12.370382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2aafa-a12c-4599-8f72-146f773cac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:12.370656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2aafa-a12c-4599-8f72-146f773cac25 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:12.372765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2aafa-a12c-4599-8f72-146f773cac25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:12.373510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2aafa-a12c-4599-8f72-146f773cac25 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:12.418527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1183/2344] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:56:12 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:56:12.421278 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954839-4d8a-4d75-8a43-27dd17af8683 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:12.434283 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954839-4d8a-4d75-8a43-27dd17af8683 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:12.454296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06ab13-6e54-45e0-909b-537f6b6d4616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:12.455704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06ab13-6e54-45e0-909b-537f6b6d4616 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:12.455845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06ab13-6e54-45e0-909b-537f6b6d4616 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:12.456021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06ab13-6e54-45e0-909b-537f6b6d4616 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:12.457322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06ab13-6e54-45e0-909b-537f6b6d4616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:12.459643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06ab13-6e54-45e0-909b-537f6b6d4616 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:12.476148 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1162/2345] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:12 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:56:12.480562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2aafa-a12c-4599-8f72-146f773cac25 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:12.505205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2aafa-a12c-4599-8f72-146f773cac25 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:12.511993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc410d-277a-4d2b-83a3-5a2efba5f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:12.512965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc410d-277a-4d2b-83a3-5a2efba5f4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:12.513215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc410d-277a-4d2b-83a3-5a2efba5f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:12.513558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc410d-277a-4d2b-83a3-5a2efba5f4b2 admin admin] PATH_INFO: `/v3/projects/f0fc49d5ede7463c92886137a4250cbb/users/259feedebfb84e7da176917fa54ca283/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:12.533172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc410d-277a-4d2b-83a3-5a2efba5f4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fc49d5ede7463c92886137a4250cbb, user_id=259feedebfb84e7da176917fa54ca283, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:12.536008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc410d-277a-4d2b-83a3-5a2efba5f4b2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:12.569133 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1184/2346] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:56:12 2022] PUT /identity/v3/projects/f0fc49d5ede7463c92886137a4250cbb/users/259feedebfb84e7da176917fa54ca283/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:56:12.573411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06ab13-6e54-45e0-909b-537f6b6d4616 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:12.602015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06ab13-6e54-45e0-909b-537f6b6d4616 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:12.676837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66575d4-905c-4756-9fb2-e89a48f68fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:12.677778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66575d4-905c-4756-9fb2-e89a48f68fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:12.677778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66575d4-905c-4756-9fb2-e89a48f68fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:12.678066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66575d4-905c-4756-9fb2-e89a48f68fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:12.678751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66575d4-905c-4756-9fb2-e89a48f68fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:12.680958 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66575d4-905c-4756-9fb2-e89a48f68fb4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:12.702634 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1163/2347] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:12 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:56:12.707208 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc410d-277a-4d2b-83a3-5a2efba5f4b2 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:12.719507 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc410d-277a-4d2b-83a3-5a2efba5f4b2 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:12.725393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f84b4-f88a-4fde-bba8-baf935b2d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:12.726513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f84b4-f88a-4fde-bba8-baf935b2d7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:12.726967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f84b4-f88a-4fde-bba8-baf935b2d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:12.727308 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f84b4-f88a-4fde-bba8-baf935b2d7ec admin admin] PATH_INFO: `/v3/projects/f0fc49d5ede7463c92886137a4250cbb/users/259feedebfb84e7da176917fa54ca283/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:12.729570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f84b4-f88a-4fde-bba8-baf935b2d7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fc49d5ede7463c92886137a4250cbb, user_id=259feedebfb84e7da176917fa54ca283, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:12.732404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f84b4-f88a-4fde-bba8-baf935b2d7ec admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:12.743940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1185/2348] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:56:12 2022] PUT /identity/v3/projects/f0fc49d5ede7463c92886137a4250cbb/users/259feedebfb84e7da176917fa54ca283/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:56:12.758941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75ca48-dfe0-41da-8c23-7b7cea3a96f5 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:12.759260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75ca48-dfe0-41da-8c23-7b7cea3a96f5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:12.759542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75ca48-dfe0-41da-8c23-7b7cea3a96f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:12.767469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:12.791835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6d75ca48-dfe0-41da-8c23-7b7cea3a96f5 None None] MFA Rules not processed for user `259feedebfb84e7da176917fa54ca283`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:12.793062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6d75ca48-dfe0-41da-8c23-7b7cea3a96f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:12.880512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1164/2349] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:12.894369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f84b4-f88a-4fde-bba8-baf935b2d7ec admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:12.896353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1d6f84b4-f88a-4fde-bba8-baf935b2d7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:12.962352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f84b4-f88a-4fde-bba8-baf935b2d7ec admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:12.966434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d587f-06f9-43db-82dd-c02ecfd51c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:12.967080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d587f-06f9-43db-82dd-c02ecfd51c46 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:12.967534 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d587f-06f9-43db-82dd-c02ecfd51c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:12.967638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d587f-06f9-43db-82dd-c02ecfd51c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:13.041538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d587f-06f9-43db-82dd-c02ecfd51c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:13.044276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d587f-06f9-43db-82dd-c02ecfd51c46 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:13.057752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1186/2350] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:13.701674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33d447-81cf-47b1-94f9-f109e7311423 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:13.702218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33d447-81cf-47b1-94f9-f109e7311423 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:13.702218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33d447-81cf-47b1-94f9-f109e7311423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:13.737677 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-0a33d447-81cf-47b1-94f9-f109e7311423 None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:13.739621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0a33d447-81cf-47b1-94f9-f109e7311423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:13.811264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1165/2351] 10.222.0.124 () {58 vars in 972 bytes} [Mon Aug 1 16:56:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:13.826030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d587f-06f9-43db-82dd-c02ecfd51c46 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:13.827701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-190d587f-06f9-43db-82dd-c02ecfd51c46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:13.841304 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:13.924834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d587f-06f9-43db-82dd-c02ecfd51c46 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:13.929868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e664ade-3b6e-4cd4-8b2f-d195a3d11f88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:13.930710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e664ade-3b6e-4cd4-8b2f-d195a3d11f88 service swift] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:13.931387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e664ade-3b6e-4cd4-8b2f-d195a3d11f88 service swift] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:13.931876 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e664ade-3b6e-4cd4-8b2f-d195a3d11f88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:13.943716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e664ade-3b6e-4cd4-8b2f-d195a3d11f88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:13.945352 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e664ade-3b6e-4cd4-8b2f-d195a3d11f88 service swift] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:13.954586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1187/2352] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:56:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:56:14.722600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33d447-81cf-47b1-94f9-f109e7311423 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:14.724287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0a33d447-81cf-47b1-94f9-f109e7311423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:14.736838 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33d447-81cf-47b1-94f9-f109e7311423 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:14.740790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f116b-a1de-4cd4-bcd2-ee93c307302c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:14.741443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f116b-a1de-4cd4-bcd2-ee93c307302c service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:14.741728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f116b-a1de-4cd4-bcd2-ee93c307302c service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:14.742005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f116b-a1de-4cd4-bcd2-ee93c307302c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:14.804615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f116b-a1de-4cd4-bcd2-ee93c307302c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:14.806077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f116b-a1de-4cd4-bcd2-ee93c307302c service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:14.816927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1166/2353] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:15.553658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e664ade-3b6e-4cd4-8b2f-d195a3d11f88 service swift] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:15.564303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e664ade-3b6e-4cd4-8b2f-d195a3d11f88 service swift] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:15.568329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf4b19-d8ac-4966-8ad1-70755e1c811f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:15.568994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4b19-d8ac-4966-8ad1-70755e1c811f service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:15.569276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4b19-d8ac-4966-8ad1-70755e1c811f service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:15.569576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4b19-d8ac-4966-8ad1-70755e1c811f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:15.580252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf4b19-d8ac-4966-8ad1-70755e1c811f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:15.581919 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf4b19-d8ac-4966-8ad1-70755e1c811f service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:15.592453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1188/2354] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:56:17.287216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f116b-a1de-4cd4-bcd2-ee93c307302c service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:17.288741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-605f116b-a1de-4cd4-bcd2-ee93c307302c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:17.326939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:17.364331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f116b-a1de-4cd4-bcd2-ee93c307302c service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:17.369443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:17.370089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:17.370372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:17.370702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] PATH_INFO: `/v3/users/d3040eee20664f3e83931ae9da71089d` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:17.371987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3040eee20664f3e83931ae9da71089d)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:17.374220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:17.451388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3040eee20664f3e83931ae9da71089d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:17.452591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3040eee20664f3e83931ae9da71089d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:17.470485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3040eee20664f3e83931ae9da71089d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:17.471393 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3040eee20664f3e83931ae9da71089d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:17.479686 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3040eee20664f3e83931ae9da71089d'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:17.511587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1167/2355] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:56:17 2022] DELETE /identity/v3/users/d3040eee20664f3e83931ae9da71089d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:17.732948 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf4b19-d8ac-4966-8ad1-70755e1c811f service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:17.744691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf4b19-d8ac-4966-8ad1-70755e1c811f service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:17.815145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:17.815774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:17.816059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:17.816337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] PATH_INFO: `/v3/projects/5a7ad2e9a7da4bf18c452a2ca1814ed4` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:17.817522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7ad2e9a7da4bf18c452a2ca1814ed4)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:17.819509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:17.870486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7ad2e9a7da4bf18c452a2ca1814ed4', 'request_id': 'req-3e6ee01a-40ed-46db-9e2d-b45c849db181'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:17.881337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7ad2e9a7da4bf18c452a2ca1814ed4', 'request_id': 'req-3e6ee01a-40ed-46db-9e2d-b45c849db181'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:17.887543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7ad2e9a7da4bf18c452a2ca1814ed4', 'request_id': 'req-3e6ee01a-40ed-46db-9e2d-b45c849db181'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:17.901081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] The token cache is being invalidate because project 5a7ad2e9a7da4bf18c452a2ca1814ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:56:17.901371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:17.902112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3e6ee01a-40ed-46db-9e2d-b45c849db181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:17.903824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1189/2356] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:56:17 2022] DELETE /identity/v3/projects/5a7ad2e9a7da4bf18c452a2ca1814ed4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:20.707971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:20.710619 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:20.724857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb014fd-31e3-495e-bd93-77d331b06dc1 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:20.785875 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:20.786627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:20.786914 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:20.787655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] PATH_INFO: `/v3/users/2f584e8b3e4c4721a56e7fa99f9a3d91` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:20.789006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f584e8b3e4c4721a56e7fa99f9a3d91)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:20.791578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:20.853475 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f584e8b3e4c4721a56e7fa99f9a3d91'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:20.854136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f584e8b3e4c4721a56e7fa99f9a3d91'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:20.858956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:20.868729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f584e8b3e4c4721a56e7fa99f9a3d91'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:20.869445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f584e8b3e4c4721a56e7fa99f9a3d91'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:20.878507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f584e8b3e4c4721a56e7fa99f9a3d91'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:20.894921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1168/2357] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:56:20 2022] DELETE /identity/v3/users/2f584e8b3e4c4721a56e7fa99f9a3d91 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:20.899602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1f083-6359-4c60-b35e-637dc6e49604 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:20.900156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1f083-6359-4c60-b35e-637dc6e49604 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:20.900334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1f083-6359-4c60-b35e-637dc6e49604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:20.926625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-b4d1f083-6359-4c60-b35e-637dc6e49604 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:20.927889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b4d1f083-6359-4c60-b35e-637dc6e49604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:20.941590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:20.996547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1190/2358] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:21.006857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:21.008644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:21.072081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3cd6c-11d3-47d4-a0b5-0f6e069c4b08 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:21.075904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4150111-a38c-408b-87e5-1dc840618489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:21.076536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4150111-a38c-408b-87e5-1dc840618489 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:21.076822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4150111-a38c-408b-87e5-1dc840618489 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:21.077097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4150111-a38c-408b-87e5-1dc840618489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:21.087800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4150111-a38c-408b-87e5-1dc840618489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:21.089263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4150111-a38c-408b-87e5-1dc840618489 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:21.099162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1169/2359] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:21.400362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1f083-6359-4c60-b35e-637dc6e49604 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:21.401878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b4d1f083-6359-4c60-b35e-637dc6e49604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:21.414375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1f083-6359-4c60-b35e-637dc6e49604 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:21.419109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:21.419765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:21.420042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:21.420310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] PATH_INFO: `/v3/projects/2badcc4c5234417daad7b47bfd12a6e5` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:21.421471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2badcc4c5234417daad7b47bfd12a6e5)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:21.423478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:21.480240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2badcc4c5234417daad7b47bfd12a6e5', 'request_id': 'req-967bbb69-043b-45d5-83f6-469ebfb3fbe6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:21.489791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2badcc4c5234417daad7b47bfd12a6e5', 'request_id': 'req-967bbb69-043b-45d5-83f6-469ebfb3fbe6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:21.496235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2badcc4c5234417daad7b47bfd12a6e5', 'request_id': 'req-967bbb69-043b-45d5-83f6-469ebfb3fbe6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:21.508720 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] The token cache is being invalidate because project 2badcc4c5234417daad7b47bfd12a6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:56:21.509044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:21.509734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:21.511564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1191/2360] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:56:21 2022] DELETE /identity/v3/projects/2badcc4c5234417daad7b47bfd12a6e5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:21.516369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4150111-a38c-408b-87e5-1dc840618489 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:21.528672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4150111-a38c-408b-87e5-1dc840618489 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:21.610546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:21.611236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:21.611514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:21.611786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] PATH_INFO: `/v3/users/9258f0c95a7a4085a7e826535b6e1010` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:21.613174 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9258f0c95a7a4085a7e826535b6e1010)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:21.615234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:21.665962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9258f0c95a7a4085a7e826535b6e1010'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:21.666807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9258f0c95a7a4085a7e826535b6e1010'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:21.682282 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9258f0c95a7a4085a7e826535b6e1010'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:21.683347 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9258f0c95a7a4085a7e826535b6e1010'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:21.692453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9258f0c95a7a4085a7e826535b6e1010'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:21.694478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:21.718818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1170/2361] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:56:21 2022] DELETE /identity/v3/users/9258f0c95a7a4085a7e826535b6e1010 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:22.017244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:22.018976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:22.034251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bbb69-043b-45d5-83f6-469ebfb3fbe6 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:22.119480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:22.120148 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:22.120432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:22.120708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] PATH_INFO: `/v3/projects/99c3d6ab82df443ea733a346dbf6d4e8` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:22.121910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c3d6ab82df443ea733a346dbf6d4e8)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:22.124028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:22.175205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:22.182919 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c3d6ab82df443ea733a346dbf6d4e8', 'request_id': 'req-ac511d06-792c-4abb-9ed9-70130998d006'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.193549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c3d6ab82df443ea733a346dbf6d4e8', 'request_id': 'req-ac511d06-792c-4abb-9ed9-70130998d006'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.200948 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c3d6ab82df443ea733a346dbf6d4e8', 'request_id': 'req-ac511d06-792c-4abb-9ed9-70130998d006'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.213084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] The token cache is being invalidate because project 99c3d6ab82df443ea733a346dbf6d4e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:56:22.213372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.214100 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.215691 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1192/2362] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:56:22 2022] DELETE /identity/v3/projects/99c3d6ab82df443ea733a346dbf6d4e8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:22.219803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:22.221238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:22.235478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6c62-5344-4b24-be1a-54764fd4ad22 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:22.306852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00fc38-5732-4780-b543-8d27fb26f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:22.307582 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00fc38-5732-4780-b543-8d27fb26f960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:22.307864 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00fc38-5732-4780-b543-8d27fb26f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:22.308139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00fc38-5732-4780-b543-8d27fb26f960 admin admin] PATH_INFO: `/v3/users/259feedebfb84e7da176917fa54ca283` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:22.309324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00fc38-5732-4780-b543-8d27fb26f960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=259feedebfb84e7da176917fa54ca283)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:22.311312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00fc38-5732-4780-b543-8d27fb26f960 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:22.377438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-da00fc38-5732-4780-b543-8d27fb26f960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259feedebfb84e7da176917fa54ca283'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.380259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-da00fc38-5732-4780-b543-8d27fb26f960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259feedebfb84e7da176917fa54ca283'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.407578 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-da00fc38-5732-4780-b543-8d27fb26f960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259feedebfb84e7da176917fa54ca283'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.408617 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-da00fc38-5732-4780-b543-8d27fb26f960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259feedebfb84e7da176917fa54ca283'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.418520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-da00fc38-5732-4780-b543-8d27fb26f960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259feedebfb84e7da176917fa54ca283'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.435618 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1171/2363] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:56:22 2022] DELETE /identity/v3/users/259feedebfb84e7da176917fa54ca283 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:22.783249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:22.784987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:22.801421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac511d06-792c-4abb-9ed9-70130998d006 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:22.886026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:22.886685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:22.887046 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:22.887329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] PATH_INFO: `/v3/projects/f0fc49d5ede7463c92886137a4250cbb` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:22.888522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0fc49d5ede7463c92886137a4250cbb)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:22.890585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:22.941548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0fc49d5ede7463c92886137a4250cbb', 'request_id': 'req-b08d91ef-6bd8-4744-83b8-53a11f97dac8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.951377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0fc49d5ede7463c92886137a4250cbb', 'request_id': 'req-b08d91ef-6bd8-4744-83b8-53a11f97dac8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.957644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0fc49d5ede7463c92886137a4250cbb', 'request_id': 'req-b08d91ef-6bd8-4744-83b8-53a11f97dac8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.969957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] The token cache is being invalidate because project f0fc49d5ede7463c92886137a4250cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:56:22.970370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.970989 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b08d91ef-6bd8-4744-83b8-53a11f97dac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:22.972785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1193/2364] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:56:22 2022] DELETE /identity/v3/projects/f0fc49d5ede7463c92886137a4250cbb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:22.978887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a89d6-ddbe-4a3a-b844-bec0733f48ff None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:22.979435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a89d6-ddbe-4a3a-b844-bec0733f48ff None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:22.979597 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a89d6-ddbe-4a3a-b844-bec0733f48ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:23.000660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-c43a89d6-ddbe-4a3a-b844-bec0733f48ff None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:23.001906 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c43a89d6-ddbe-4a3a-b844-bec0733f48ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:23.068879 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1172/2365] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:23.077501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993d17f-a7fc-4d22-9f92-5ab7d7705e51 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:23.078350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993d17f-a7fc-4d22-9f92-5ab7d7705e51 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:23.078350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993d17f-a7fc-4d22-9f92-5ab7d7705e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:23.103478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-9993d17f-a7fc-4d22-9f92-5ab7d7705e51 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:23.104949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9993d17f-a7fc-4d22-9f92-5ab7d7705e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:23.113671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1194/2366] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:23.118065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a89d6-ddbe-4a3a-b844-bec0733f48ff None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:23.128260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a89d6-ddbe-4a3a-b844-bec0733f48ff None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:23.133353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972675cd-d3a8-463c-ae47-52c40cc2b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:23.133982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972675cd-d3a8-463c-ae47-52c40cc2b237 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:23.134262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972675cd-d3a8-463c-ae47-52c40cc2b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:23.134539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972675cd-d3a8-463c-ae47-52c40cc2b237 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:23.135288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972675cd-d3a8-463c-ae47-52c40cc2b237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:56:23.135596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972675cd-d3a8-463c-ae47-52c40cc2b237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:23.137246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972675cd-d3a8-463c-ae47-52c40cc2b237 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:23.145762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:23.155858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1173/2367] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:56:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:56:23.158497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993d17f-a7fc-4d22-9f92-5ab7d7705e51 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:23.169794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993d17f-a7fc-4d22-9f92-5ab7d7705e51 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:23.179801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc21df-6ddd-4617-8694-f4100275d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:23.180661 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc21df-6ddd-4617-8694-f4100275d46a admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:23.180792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc21df-6ddd-4617-8694-f4100275d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:23.181024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc21df-6ddd-4617-8694-f4100275d46a admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:23.181714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc21df-6ddd-4617-8694-f4100275d46a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:23.183825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc21df-6ddd-4617-8694-f4100275d46a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:23.219933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1195/2368] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:56:23 2022] POST /identity/v3/projects => generated 370 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:56:23.224652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972675cd-d3a8-463c-ae47-52c40cc2b237 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:23.236357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972675cd-d3a8-463c-ae47-52c40cc2b237 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:23.318195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19374286-e58b-48d7-957e-3d1d6da766bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:23.319044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19374286-e58b-48d7-957e-3d1d6da766bf admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:23.319272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19374286-e58b-48d7-957e-3d1d6da766bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:23.319632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19374286-e58b-48d7-957e-3d1d6da766bf admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:23.320600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19374286-e58b-48d7-957e-3d1d6da766bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:23.323831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19374286-e58b-48d7-957e-3d1d6da766bf admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:23.354877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1174/2369] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:56:23 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:56:23.356250 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc21df-6ddd-4617-8694-f4100275d46a admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:23.367770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc21df-6ddd-4617-8694-f4100275d46a admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:23.373369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb4f54-c394-4e1c-b00a-a344933b838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:23.374150 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb4f54-c394-4e1c-b00a-a344933b838c admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:23.374432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb4f54-c394-4e1c-b00a-a344933b838c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:23.374705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb4f54-c394-4e1c-b00a-a344933b838c admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:23.375559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb4f54-c394-4e1c-b00a-a344933b838c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:23.377188 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb4f54-c394-4e1c-b00a-a344933b838c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:23.388521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1196/2370] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:23 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:56:23.396395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19374286-e58b-48d7-957e-3d1d6da766bf admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:23.412633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19374286-e58b-48d7-957e-3d1d6da766bf admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:23.417413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4099e-802f-44bd-bad0-50fb32ce1881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:23.418050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4099e-802f-44bd-bad0-50fb32ce1881 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:23.418328 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4099e-802f-44bd-bad0-50fb32ce1881 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:23.418599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4099e-802f-44bd-bad0-50fb32ce1881 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:23.419344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4099e-802f-44bd-bad0-50fb32ce1881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:23.420956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4099e-802f-44bd-bad0-50fb32ce1881 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:23.433021 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1175/2371] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:23 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:56:23.437409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb4f54-c394-4e1c-b00a-a344933b838c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:23.448404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb4f54-c394-4e1c-b00a-a344933b838c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:23.454021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441adb7-6133-4a11-9d55-e3b97ef4d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:23.454715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441adb7-6133-4a11-9d55-e3b97ef4d48c admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:23.455022 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441adb7-6133-4a11-9d55-e3b97ef4d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:23.455298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441adb7-6133-4a11-9d55-e3b97ef4d48c admin admin] PATH_INFO: `/v3/projects/e6bb93f9970c4fb98fd7ac3d844e4934/users/d61d7e8345b34ba68f192242a29c4edb/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:23.478068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441adb7-6133-4a11-9d55-e3b97ef4d48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bb93f9970c4fb98fd7ac3d844e4934, user_id=d61d7e8345b34ba68f192242a29c4edb, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:23.480843 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441adb7-6133-4a11-9d55-e3b97ef4d48c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:23.484049 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:23.505300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1197/2372] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:56:23 2022] PUT /identity/v3/projects/e6bb93f9970c4fb98fd7ac3d844e4934/users/d61d7e8345b34ba68f192242a29c4edb/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:23.516960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee3d4-29c3-4417-b3db-df49d80b9503 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:23.517236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee3d4-29c3-4417-b3db-df49d80b9503 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:23.517524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee3d4-29c3-4417-b3db-df49d80b9503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:23.548150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-82aee3d4-29c3-4417-b3db-df49d80b9503 None None] MFA Rules not processed for user `d61d7e8345b34ba68f192242a29c4edb`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:23.549269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-82aee3d4-29c3-4417-b3db-df49d80b9503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:23.623362 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1176/2373] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:23.635568 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441adb7-6133-4a11-9d55-e3b97ef4d48c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:23.637468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c441adb7-6133-4a11-9d55-e3b97ef4d48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:23.699016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441adb7-6133-4a11-9d55-e3b97ef4d48c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:23.702641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1bf65-2f4f-4d07-8029-946b88373f05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1cabb41d38a40acb7d41c169cc90cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:23.703299 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1bf65-2f4f-4d07-8029-946b88373f05 service glance] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:23.703582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1bf65-2f4f-4d07-8029-946b88373f05 service glance] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:23.703848 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1bf65-2f4f-4d07-8029-946b88373f05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:23.713597 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1bf65-2f4f-4d07-8029-946b88373f05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:23.715078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1bf65-2f4f-4d07-8029-946b88373f05 service glance] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:23.724631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1198/2374] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:56:30.140923 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aee3d4-29c3-4417-b3db-df49d80b9503 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:30.142784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-82aee3d4-29c3-4417-b3db-df49d80b9503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:30.223647 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aee3d4-29c3-4417-b3db-df49d80b9503 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:30.230333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:30.230333 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:30.230638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:30.230929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] PATH_INFO: `/v3/users/d889e44c8687438e8fe74a0fbb463962` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:30.233154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d889e44c8687438e8fe74a0fbb463962)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:30.238640 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:30.245062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:30.292645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd889e44c8687438e8fe74a0fbb463962'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:30.293307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd889e44c8687438e8fe74a0fbb463962'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:30.307827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd889e44c8687438e8fe74a0fbb463962'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:30.308694 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd889e44c8687438e8fe74a0fbb463962'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:30.316821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd889e44c8687438e8fe74a0fbb463962'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:30.336202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1177/2375] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:56:30 2022] DELETE /identity/v3/users/d889e44c8687438e8fe74a0fbb463962 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:30.342453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73c25-3040-4bbd-aaf9-664e0cc01139 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:30.343178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73c25-3040-4bbd-aaf9-664e0cc01139 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:30.343178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73c25-3040-4bbd-aaf9-664e0cc01139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:30.364657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-feb73c25-3040-4bbd-aaf9-664e0cc01139 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:30.365883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-feb73c25-3040-4bbd-aaf9-664e0cc01139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:30.433250 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1199/2376] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:30.445313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:30.446852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:30.522300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9fd52-3f35-41d0-9929-509eece8d84c admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:30.526934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22295c8d-703e-4a8c-a6d5-223f7d21a87b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:30.527788 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22295c8d-703e-4a8c-a6d5-223f7d21a87b service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:30.528068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22295c8d-703e-4a8c-a6d5-223f7d21a87b service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:30.528362 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22295c8d-703e-4a8c-a6d5-223f7d21a87b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:30.540444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22295c8d-703e-4a8c-a6d5-223f7d21a87b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:30.542126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22295c8d-703e-4a8c-a6d5-223f7d21a87b service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:30.555795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1178/2377] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:30.961562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb73c25-3040-4bbd-aaf9-664e0cc01139 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:30.963164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-feb73c25-3040-4bbd-aaf9-664e0cc01139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:30.993467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb73c25-3040-4bbd-aaf9-664e0cc01139 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:31.000646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:31.001489 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.009633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.009760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] PATH_INFO: `/v3/projects/f8cc116824f244fcb801b8c6a11e27ce` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.013810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8cc116824f244fcb801b8c6a11e27ce)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:31.016511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:31.103177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8cc116824f244fcb801b8c6a11e27ce', 'request_id': 'req-d0dfeebc-74e4-4f0f-98b7-175294853b86'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:31.143462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8cc116824f244fcb801b8c6a11e27ce', 'request_id': 'req-d0dfeebc-74e4-4f0f-98b7-175294853b86'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:31.152209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8cc116824f244fcb801b8c6a11e27ce', 'request_id': 'req-d0dfeebc-74e4-4f0f-98b7-175294853b86'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:31.171851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] The token cache is being invalidate because project f8cc116824f244fcb801b8c6a11e27ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:56:31.172149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:31.172831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d0dfeebc-74e4-4f0f-98b7-175294853b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:31.178040 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1200/2378] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:56:30 2022] DELETE /identity/v3/projects/f8cc116824f244fcb801b8c6a11e27ce => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:31.180793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a1b38-7c6d-4b8a-8c02-2267b2bcf0a8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.181294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a1b38-7c6d-4b8a-8c02-2267b2bcf0a8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.181551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a1b38-7c6d-4b8a-8c02-2267b2bcf0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.226713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-8c7a1b38-7c6d-4b8a-8c02-2267b2bcf0a8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:31.228138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8c7a1b38-7c6d-4b8a-8c02-2267b2bcf0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:31.309732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1179/2379] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:31.318544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fdd26-8314-45f1-bdbe-38d99291704f None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.318937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fdd26-8314-45f1-bdbe-38d99291704f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.319535 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fdd26-8314-45f1-bdbe-38d99291704f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.345775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4c5fdd26-8314-45f1-bdbe-38d99291704f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:31.347145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4c5fdd26-8314-45f1-bdbe-38d99291704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:31.358192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1201/2380] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:56:31.362601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a1b38-7c6d-4b8a-8c02-2267b2bcf0a8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:31.373911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a1b38-7c6d-4b8a-8c02-2267b2bcf0a8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:31.378878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60be39c-a6bb-45fa-b0d8-919f8bc7a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:31.379613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60be39c-a6bb-45fa-b0d8-919f8bc7a5cf admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.379964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60be39c-a6bb-45fa-b0d8-919f8bc7a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.380305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60be39c-a6bb-45fa-b0d8-919f8bc7a5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.381339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60be39c-a6bb-45fa-b0d8-919f8bc7a5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:56:31.381821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60be39c-a6bb-45fa-b0d8-919f8bc7a5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:31.383842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60be39c-a6bb-45fa-b0d8-919f8bc7a5cf admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:31.399778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1180/2381] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 16:56:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:56:31.401290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fdd26-8314-45f1-bdbe-38d99291704f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:31.411654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fdd26-8314-45f1-bdbe-38d99291704f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:31.417250 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b1caf-edc9-4850-bc9a-1cdf5637fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:31.417890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b1caf-edc9-4850-bc9a-1cdf5637fdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.418169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b1caf-edc9-4850-bc9a-1cdf5637fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.418441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b1caf-edc9-4850-bc9a-1cdf5637fdf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.419161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b1caf-edc9-4850-bc9a-1cdf5637fdf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:31.421077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b1caf-edc9-4850-bc9a-1cdf5637fdf1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:31.436916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:31.456010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1202/2382] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:56:31 2022] POST /identity/v3/projects => generated 372 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:56:31.460202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60be39c-a6bb-45fa-b0d8-919f8bc7a5cf admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:31.471175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60be39c-a6bb-45fa-b0d8-919f8bc7a5cf admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:31.486935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:31.548385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b03a1-a608-4a5c-866b-77938abc1089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:31.548643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b03a1-a608-4a5c-866b-77938abc1089 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.548808 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b03a1-a608-4a5c-866b-77938abc1089 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.549172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b03a1-a608-4a5c-866b-77938abc1089 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.549912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b03a1-a608-4a5c-866b-77938abc1089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:31.552103 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b03a1-a608-4a5c-866b-77938abc1089 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:31.578588 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1181/2383] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:56:31 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:56:31.582435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b1caf-edc9-4850-bc9a-1cdf5637fdf1 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:31.594502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b1caf-edc9-4850-bc9a-1cdf5637fdf1 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:31.599497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d8e56-f12f-433b-91f5-923d6c5eba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:31.600016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d8e56-f12f-433b-91f5-923d6c5eba72 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.600307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d8e56-f12f-433b-91f5-923d6c5eba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.600783 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d8e56-f12f-433b-91f5-923d6c5eba72 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.601690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d8e56-f12f-433b-91f5-923d6c5eba72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:31.603414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d8e56-f12f-433b-91f5-923d6c5eba72 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:31.625628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1203/2384] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:31 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:56:31.628088 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b03a1-a608-4a5c-866b-77938abc1089 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:31.641521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b03a1-a608-4a5c-866b-77938abc1089 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:31.649897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3240b1-83ce-46ea-a3b6-47c3ca57981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:31.650666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3240b1-83ce-46ea-a3b6-47c3ca57981c admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.650846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3240b1-83ce-46ea-a3b6-47c3ca57981c admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.651303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3240b1-83ce-46ea-a3b6-47c3ca57981c admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.652489 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3240b1-83ce-46ea-a3b6-47c3ca57981c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:31.654710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3240b1-83ce-46ea-a3b6-47c3ca57981c admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:31.679210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1182/2385] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:31 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:56:31.683735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d8e56-f12f-433b-91f5-923d6c5eba72 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:31.702306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d8e56-f12f-433b-91f5-923d6c5eba72 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:31.707012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed998a-1205-4c39-8beb-4b748a3d8453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:31.707701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed998a-1205-4c39-8beb-4b748a3d8453 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.707973 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed998a-1205-4c39-8beb-4b748a3d8453 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.708244 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed998a-1205-4c39-8beb-4b748a3d8453 admin admin] PATH_INFO: `/v3/projects/52027819059b40298dc3a64e2a8a65a4/users/0dc8894b1bce490dbb939bed975f1ada/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.725827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed998a-1205-4c39-8beb-4b748a3d8453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52027819059b40298dc3a64e2a8a65a4, user_id=0dc8894b1bce490dbb939bed975f1ada, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:31.728427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed998a-1205-4c39-8beb-4b748a3d8453 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:31.747566 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1204/2386] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:56:31 2022] PUT /identity/v3/projects/52027819059b40298dc3a64e2a8a65a4/users/0dc8894b1bce490dbb939bed975f1ada/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:31.749172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8bb63-467d-4f47-b27e-6144144f0bd7 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.749508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8bb63-467d-4f47-b27e-6144144f0bd7 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.749788 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8bb63-467d-4f47-b27e-6144144f0bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.771210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-c7a8bb63-467d-4f47-b27e-6144144f0bd7 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:31.772639 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c7a8bb63-467d-4f47-b27e-6144144f0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:31.868895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1183/2387] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:31.880362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed998a-1205-4c39-8beb-4b748a3d8453 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:31.882231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b3ed998a-1205-4c39-8beb-4b748a3d8453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:31.976017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed998a-1205-4c39-8beb-4b748a3d8453 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:31.980908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe22077-efc6-43ff-b969-e460fd33e3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:31.981580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe22077-efc6-43ff-b969-e460fd33e3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.981824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe22077-efc6-43ff-b969-e460fd33e3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.982130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe22077-efc6-43ff-b969-e460fd33e3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.994714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe22077-efc6-43ff-b969-e460fd33e3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:31.996947 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe22077-efc6-43ff-b969-e460fd33e3c3 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:32.009564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1205/2388] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:32.119794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8bb63-467d-4f47-b27e-6144144f0bd7 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:32.121287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c7a8bb63-467d-4f47-b27e-6144144f0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:32.205240 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8bb63-467d-4f47-b27e-6144144f0bd7 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:32.215773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f52a6-e915-4499-ab7e-9c046cfd8915 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:32.216895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f52a6-e915-4499-ab7e-9c046cfd8915 service placement] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:32.216895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f52a6-e915-4499-ab7e-9c046cfd8915 service placement] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:32.217051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f52a6-e915-4499-ab7e-9c046cfd8915 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:32.218897 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cf4f52a6-e915-4499-ab7e-9c046cfd8915 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:32.232731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f52a6-e915-4499-ab7e-9c046cfd8915 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:32.234277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f52a6-e915-4499-ab7e-9c046cfd8915 service placement] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:32.246214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1184/2389] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:37.656446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b3149-8846-4fa7-8ea7-26832068cc5d None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:37.657388 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b3149-8846-4fa7-8ea7-26832068cc5d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:37.657817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b3149-8846-4fa7-8ea7-26832068cc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:37.692557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-639b3149-8846-4fa7-8ea7-26832068cc5d None None] MFA Rules not processed for user `0dc8894b1bce490dbb939bed975f1ada`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:37.694045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-639b3149-8846-4fa7-8ea7-26832068cc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:37.762042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1206/2390] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:37.766718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f52a6-e915-4499-ab7e-9c046cfd8915 service placement] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:37.777711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f52a6-e915-4499-ab7e-9c046cfd8915 service placement] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:37.782776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e080d-fb06-42d6-b212-6cf98b4e5b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:37.783970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e080d-fb06-42d6-b212-6cf98b4e5b55 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:37.784260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e080d-fb06-42d6-b212-6cf98b4e5b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:37.784544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e080d-fb06-42d6-b212-6cf98b4e5b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:37.785233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e080d-fb06-42d6-b212-6cf98b4e5b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:37.787251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e080d-fb06-42d6-b212-6cf98b4e5b55 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:37.818639 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1185/2391] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 16:56:37 2022] POST /identity/v3/projects => generated 374 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:56:37.823225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b3149-8846-4fa7-8ea7-26832068cc5d None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:37.835106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b3149-8846-4fa7-8ea7-26832068cc5d None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:37.894124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:37.915613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c606b7-f3ee-4b4a-8121-36bd64d2cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:37.916279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c606b7-f3ee-4b4a-8121-36bd64d2cf03 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:37.916557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c606b7-f3ee-4b4a-8121-36bd64d2cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:37.916826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c606b7-f3ee-4b4a-8121-36bd64d2cf03 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:37.917511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c606b7-f3ee-4b4a-8121-36bd64d2cf03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:37.919616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c606b7-f3ee-4b4a-8121-36bd64d2cf03 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:37.952131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1207/2392] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 16:56:37 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:56:37.955938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e080d-fb06-42d6-b212-6cf98b4e5b55 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:37.965391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:37.974737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e080d-fb06-42d6-b212-6cf98b4e5b55 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:37.982031 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754f80a-65bf-4e9a-a84c-c48c471acf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:37.983097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754f80a-65bf-4e9a-a84c-c48c471acf66 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:37.983714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754f80a-65bf-4e9a-a84c-c48c471acf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:37.984173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754f80a-65bf-4e9a-a84c-c48c471acf66 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:37.985085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754f80a-65bf-4e9a-a84c-c48c471acf66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:37.987324 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754f80a-65bf-4e9a-a84c-c48c471acf66 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:38.000862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1186/2393] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:37 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:56:38.004883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c606b7-f3ee-4b4a-8121-36bd64d2cf03 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:38.017821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c606b7-f3ee-4b4a-8121-36bd64d2cf03 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:38.023280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d4353-4f09-4399-9613-45c243faad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:38.024581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d4353-4f09-4399-9613-45c243faad1b admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:38.024581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d4353-4f09-4399-9613-45c243faad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:38.024581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d4353-4f09-4399-9613-45c243faad1b admin admin] PATH_INFO: `/v3/projects/a9a44b2bbc994388859519b1effa6f1e/users/a280927b5a054b3d9ea859fb6653c302/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:38.043702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d4353-4f09-4399-9613-45c243faad1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a44b2bbc994388859519b1effa6f1e, user_id=a280927b5a054b3d9ea859fb6653c302, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:38.048178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d4353-4f09-4399-9613-45c243faad1b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:38.072600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1208/2394] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:56:38 2022] PUT /identity/v3/projects/a9a44b2bbc994388859519b1effa6f1e/users/a280927b5a054b3d9ea859fb6653c302/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:38.072821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754f80a-65bf-4e9a-a84c-c48c471acf66 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:38.104593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754f80a-65bf-4e9a-a84c-c48c471acf66 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:38.260627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95bd17-1d99-4354-acfc-9f52db26e01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:38.261341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95bd17-1d99-4354-acfc-9f52db26e01f admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:38.261629 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95bd17-1d99-4354-acfc-9f52db26e01f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:38.262030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95bd17-1d99-4354-acfc-9f52db26e01f admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:38.263716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95bd17-1d99-4354-acfc-9f52db26e01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:38.265752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95bd17-1d99-4354-acfc-9f52db26e01f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:38.279311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1187/2395] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 16:56:38 2022] GET /identity/v3/roles => generated 1427 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:56:38.283558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d4353-4f09-4399-9613-45c243faad1b admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:38.301417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d4353-4f09-4399-9613-45c243faad1b admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:38.307606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e53071-2642-4800-bfaf-eb550b987d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:38.308602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e53071-2642-4800-bfaf-eb550b987d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:38.308602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e53071-2642-4800-bfaf-eb550b987d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:38.308890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e53071-2642-4800-bfaf-eb550b987d53 admin admin] PATH_INFO: `/v3/projects/a9a44b2bbc994388859519b1effa6f1e/users/a280927b5a054b3d9ea859fb6653c302/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:38.322875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e53071-2642-4800-bfaf-eb550b987d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a44b2bbc994388859519b1effa6f1e, user_id=a280927b5a054b3d9ea859fb6653c302, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:38.326363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e53071-2642-4800-bfaf-eb550b987d53 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:38.338609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1209/2396] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 16:56:38 2022] PUT /identity/v3/projects/a9a44b2bbc994388859519b1effa6f1e/users/a280927b5a054b3d9ea859fb6653c302/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:41.726463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd3bb4-38f4-4203-9372-f0ed4a79edb4 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:41.726974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd3bb4-38f4-4203-9372-f0ed4a79edb4 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:41.727263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd3bb4-38f4-4203-9372-f0ed4a79edb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:41.808229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-4bfd3bb4-38f4-4203-9372-f0ed4a79edb4 None None] MFA Rules not processed for user `329a85e5f5e9446c80dc45cafd329108`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:41.810287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4bfd3bb4-38f4-4203-9372-f0ed4a79edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:41.935809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1188/2397] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:45.285653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e81b4-80f1-45e3-9426-cb1148a2b9d9 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:45.286110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e81b4-80f1-45e3-9426-cb1148a2b9d9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:45.286110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e81b4-80f1-45e3-9426-cb1148a2b9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:45.318518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a74e81b4-80f1-45e3-9426-cb1148a2b9d9 None None] MFA Rules not processed for user `a280927b5a054b3d9ea859fb6653c302`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:45.319553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a74e81b4-80f1-45e3-9426-cb1148a2b9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:45.477274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1210/2398] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:45.490780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd3bb4-38f4-4203-9372-f0ed4a79edb4 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:45.492556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-4bfd3bb4-38f4-4203-9372-f0ed4a79edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:45.589201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd3bb4-38f4-4203-9372-f0ed4a79edb4 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:45.594835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f5562-b5fc-417f-88b3-83f8f05874b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:45.595526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f5562-b5fc-417f-88b3-83f8f05874b7 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:45.595805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f5562-b5fc-417f-88b3-83f8f05874b7 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:45.596115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f5562-b5fc-417f-88b3-83f8f05874b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:45.631754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:45.668701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f5562-b5fc-417f-88b3-83f8f05874b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:45.670361 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f5562-b5fc-417f-88b3-83f8f05874b7 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:45.685936 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1189/2399] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:46.926165 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc13b-19ee-42c2-bac6-0f6d7fa7a7df None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:46.927103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc13b-19ee-42c2-bac6-0f6d7fa7a7df None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:46.928439 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc13b-19ee-42c2-bac6-0f6d7fa7a7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:46.973372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-1b1fc13b-19ee-42c2-bac6-0f6d7fa7a7df None None] MFA Rules not processed for user `0dc8894b1bce490dbb939bed975f1ada`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:46.975183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1b1fc13b-19ee-42c2-bac6-0f6d7fa7a7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:46.983798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1211/2400] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:52.278862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f5562-b5fc-417f-88b3-83f8f05874b7 service nova] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:52.359041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f5562-b5fc-417f-88b3-83f8f05874b7 service nova] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:52.363121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e2df3-1fc0-475f-825e-0b4d66cc2847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:52.364069 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e2df3-1fc0-475f-825e-0b4d66cc2847 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:52.364951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e2df3-1fc0-475f-825e-0b4d66cc2847 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:52.365627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e2df3-1fc0-475f-825e-0b4d66cc2847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:52.367969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3a5e2df3-1fc0-475f-825e-0b4d66cc2847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:52.469909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e2df3-1fc0-475f-825e-0b4d66cc2847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:52.471501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e2df3-1fc0-475f-825e-0b4d66cc2847 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:52.484178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1190/2401] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:56.964078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=58,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:57.982384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1b40-f2f8-4a2b-bb6c-2f6c4b403524 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:57.983077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1b40-f2f8-4a2b-bb6c-2f6c4b403524 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:57.983077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1b40-f2f8-4a2b-bb6c-2f6c4b403524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:58.011590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-db1e1b40-f2f8-4a2b-bb6c-2f6c4b403524 None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:58.012813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-db1e1b40-f2f8-4a2b-bb6c-2f6c4b403524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:58.076996 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1212/2402] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:56:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:56:58.090886 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e2df3-1fc0-475f-825e-0b4d66cc2847 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:58.092943 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3a5e2df3-1fc0-475f-825e-0b4d66cc2847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:58.181210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e2df3-1fc0-475f-825e-0b4d66cc2847 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:58.187684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae5414-c52c-4436-bc21-770c609d9300 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:58.188343 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5414-c52c-4436-bc21-770c609d9300 service swift] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:58.188651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5414-c52c-4436-bc21-770c609d9300 service swift] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:58.188901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5414-c52c-4436-bc21-770c609d9300 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:58.199634 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae5414-c52c-4436-bc21-770c609d9300 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:58.201668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae5414-c52c-4436-bc21-770c609d9300 service swift] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:58.213726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1191/2403] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:56:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:56:59.046373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e1b40-f2f8-4a2b-bb6c-2f6c4b403524 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:59.049929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-db1e1b40-f2f8-4a2b-bb6c-2f6c4b403524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:59.216773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e1b40-f2f8-4a2b-bb6c-2f6c4b403524 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:59.222196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:59.222939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:59.223770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:59.224190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] PATH_INFO: `/v3/users/d61d7e8345b34ba68f192242a29c4edb` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:59.225528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61d7e8345b34ba68f192242a29c4edb)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:59.233627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:59.307532 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61d7e8345b34ba68f192242a29c4edb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:59.320945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61d7e8345b34ba68f192242a29c4edb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:59.353392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61d7e8345b34ba68f192242a29c4edb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:59.355088 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61d7e8345b34ba68f192242a29c4edb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:59.359041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61d7e8345b34ba68f192242a29c4edb'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:56:59.406320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1213/2404] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 16:56:59 2022] DELETE /identity/v3/users/d61d7e8345b34ba68f192242a29c4edb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:56:59.407901 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf82c2-de1f-444b-96ef-a5339701b7d7 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:59.408717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf82c2-de1f-444b-96ef-a5339701b7d7 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:59.408717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf82c2-de1f-444b-96ef-a5339701b7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:59.448525 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-fcdf82c2-de1f-444b-96ef-a5339701b7d7 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:59.449805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fcdf82c2-de1f-444b-96ef-a5339701b7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:59.455001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:59.539322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1192/2405] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:59.547495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:59.549283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:59.594318 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:59.649120 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb59e0-78c0-4e72-b616-c33153b420e0 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:59.653937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186f922-94fc-4404-8023-2b6a10a445be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:59.654583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186f922-94fc-4404-8023-2b6a10a445be service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:59.654848 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186f922-94fc-4404-8023-2b6a10a445be service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:59.655179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186f922-94fc-4404-8023-2b6a10a445be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:59.684420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186f922-94fc-4404-8023-2b6a10a445be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:59.685808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186f922-94fc-4404-8023-2b6a10a445be service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:59.702531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1214/2406] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:57:00.391133 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf82c2-de1f-444b-96ef-a5339701b7d7 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:00.392837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fcdf82c2-de1f-444b-96ef-a5339701b7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:00.407649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf82c2-de1f-444b-96ef-a5339701b7d7 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:00.421827 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:00.422671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:00.423162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:00.423606 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] PATH_INFO: `/v3/projects/e6bb93f9970c4fb98fd7ac3d844e4934` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:00.424941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bb93f9970c4fb98fd7ac3d844e4934)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:00.428597 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:00.508519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bb93f9970c4fb98fd7ac3d844e4934', 'request_id': 'req-9ced7207-680b-4f2c-9d93-c760830b41b6'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:57:00.517624 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bb93f9970c4fb98fd7ac3d844e4934', 'request_id': 'req-9ced7207-680b-4f2c-9d93-c760830b41b6'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:57:00.529998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bb93f9970c4fb98fd7ac3d844e4934', 'request_id': 'req-9ced7207-680b-4f2c-9d93-c760830b41b6'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:57:00.548160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] The token cache is being invalidate because project e6bb93f9970c4fb98fd7ac3d844e4934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:57:00.548472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:57:00.549252 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9ced7207-680b-4f2c-9d93-c760830b41b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:57:00.551760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1193/2407] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 16:57:00 2022] DELETE /identity/v3/projects/e6bb93f9970c4fb98fd7ac3d844e4934 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:57:09.699439 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=15 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:10.544723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:15.620864 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e5e95-bbfa-4550-b914-8a41d8e57258 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:15.621472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e5e95-bbfa-4550-b914-8a41d8e57258 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:15.621717 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e5e95-bbfa-4550-b914-8a41d8e57258 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:15.623310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1215/2408] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 16:57:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:15.630762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649aa89-44a6-42ce-baf1-2c3f2d591ae3 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:15.631313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649aa89-44a6-42ce-baf1-2c3f2d591ae3 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:15.631435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649aa89-44a6-42ce-baf1-2c3f2d591ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:15.654271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6649aa89-44a6-42ce-baf1-2c3f2d591ae3 None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:15.655558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6649aa89-44a6-42ce-baf1-2c3f2d591ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:15.741882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1194/2409] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 16:57:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:15.754294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e5e95-bbfa-4550-b914-8a41d8e57258 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:15.756947 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d79e5e95-bbfa-4550-b914-8a41d8e57258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:15.828214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e5e95-bbfa-4550-b914-8a41d8e57258 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:15.831857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285baed-3ff8-461b-aef2-f777c6f30401 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1cabb41d38a40acb7d41c169cc90cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:15.832460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285baed-3ff8-461b-aef2-f777c6f30401 service glance] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:15.832739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285baed-3ff8-461b-aef2-f777c6f30401 service glance] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:15.833011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285baed-3ff8-461b-aef2-f777c6f30401 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:15.860419 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285baed-3ff8-461b-aef2-f777c6f30401 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:15.862013 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285baed-3ff8-461b-aef2-f777c6f30401 service glance] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:15.874931 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1216/2410] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:15.968461 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d4eb3-6377-4441-a3ec-e6bef27071f8 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:15.968780 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d4eb3-6377-4441-a3ec-e6bef27071f8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:15.969014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d4eb3-6377-4441-a3ec-e6bef27071f8 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:15.970418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1195/2411] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 16:57:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:15.976007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9463dd-2527-431f-81f9-6e12023adf8c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:15.976602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9463dd-2527-431f-81f9-6e12023adf8c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:15.976977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9463dd-2527-431f-81f9-6e12023adf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:15.999162 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-fb9463dd-2527-431f-81f9-6e12023adf8c None None] MFA Rules not processed for user `dcfe4d6c32064d79835c415d9fc02cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:16.000388 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-fb9463dd-2527-431f-81f9-6e12023adf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:16.053784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1217/2412] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 16:57:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:16.065717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d4eb3-6377-4441-a3ec-e6bef27071f8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:16.067648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a90d4eb3-6377-4441-a3ec-e6bef27071f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:16.081627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d4eb3-6377-4441-a3ec-e6bef27071f8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:16.085836 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb520d7-4a2d-4f3f-8056-ea092d35909e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:16.086601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb520d7-4a2d-4f3f-8056-ea092d35909e service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:16.086898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb520d7-4a2d-4f3f-8056-ea092d35909e service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:16.087265 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb520d7-4a2d-4f3f-8056-ea092d35909e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:16.096000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb520d7-4a2d-4f3f-8056-ea092d35909e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:16.097555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb520d7-4a2d-4f3f-8056-ea092d35909e service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:16.107406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1196/2413] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:16.202295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9cee9-e6d1-4b94-ad29-7cc804e7a267 None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:16.202295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9cee9-e6d1-4b94-ad29-7cc804e7a267 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:16.203037 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9cee9-e6d1-4b94-ad29-7cc804e7a267 None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:16.204005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1218/2414] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 16:57:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:16.210973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebfcf3-9eae-47bf-b3cc-562df7d425a2 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:16.211268 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebfcf3-9eae-47bf-b3cc-562df7d425a2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:16.211553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebfcf3-9eae-47bf-b3cc-562df7d425a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:16.235526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-01ebfcf3-9eae-47bf-b3cc-562df7d425a2 None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:16.236775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-01ebfcf3-9eae-47bf-b3cc-562df7d425a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:16.246659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1197/2415] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 16:57:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:16.259443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9cee9-e6d1-4b94-ad29-7cc804e7a267 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:16.272323 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9cee9-e6d1-4b94-ad29-7cc804e7a267 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:16.277615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151768a2-b582-4522-8a9a-3774963f747d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:16.278656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151768a2-b582-4522-8a9a-3774963f747d service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:16.278941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151768a2-b582-4522-8a9a-3774963f747d service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:16.279241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151768a2-b582-4522-8a9a-3774963f747d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:16.294810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151768a2-b582-4522-8a9a-3774963f747d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:16.296501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151768a2-b582-4522-8a9a-3774963f747d service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:16.308841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1219/2416] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:22.292028 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e3d3-a13a-4d38-8ea5-853f0ad35779 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:22.292585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e3d3-a13a-4d38-8ea5-853f0ad35779 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:22.292585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e3d3-a13a-4d38-8ea5-853f0ad35779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:22.313510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-10b3e3d3-a13a-4d38-8ea5-853f0ad35779 None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:22.314740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-10b3e3d3-a13a-4d38-8ea5-853f0ad35779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:22.378154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1198/2417] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 16:57:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:22.402320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151768a2-b582-4522-8a9a-3774963f747d service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:22.403809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-151768a2-b582-4522-8a9a-3774963f747d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:22.475578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151768a2-b582-4522-8a9a-3774963f747d service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:22.480836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e88165-5d48-47e6-9df2-e6634928f713 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:22.481451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e88165-5d48-47e6-9df2-e6634928f713 service swift] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:22.481730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e88165-5d48-47e6-9df2-e6634928f713 service swift] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:22.482097 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e88165-5d48-47e6-9df2-e6634928f713 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:22.490762 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e88165-5d48-47e6-9df2-e6634928f713 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:22.492368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e88165-5d48-47e6-9df2-e6634928f713 service swift] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:22.501173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1220/2418] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:57:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 16:57:32.370175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=65 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:32.497640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=87 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:45.634655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3e3d3-a13a-4d38-8ea5-853f0ad35779 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:45.644755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3e3d3-a13a-4d38-8ea5-853f0ad35779 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:45.648938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815b07-19d9-40fc-9ce1-02bc78fa5cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:45.649577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815b07-19d9-40fc-9ce1-02bc78fa5cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:45.649840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815b07-19d9-40fc-9ce1-02bc78fa5cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:45.650111 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815b07-19d9-40fc-9ce1-02bc78fa5cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:45.652228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-33815b07-19d9-40fc-9ce1-02bc78fa5cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:45.734083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33815b07-19d9-40fc-9ce1-02bc78fa5cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:45.735644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33815b07-19d9-40fc-9ce1-02bc78fa5cc1 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:45.747760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1199/2419] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:48.181503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb350f-f27c-42d2-aa21-c6f8e3b32494 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:48.182053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb350f-f27c-42d2-aa21-c6f8e3b32494 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:48.182053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb350f-f27c-42d2-aa21-c6f8e3b32494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:48.213797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-59fb350f-f27c-42d2-aa21-c6f8e3b32494 None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:48.214646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-59fb350f-f27c-42d2-aa21-c6f8e3b32494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:48.223936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1221/2420] 10.222.0.124 () {58 vars in 972 bytes} [Mon Aug 1 16:57:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:48.237483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815b07-19d9-40fc-9ce1-02bc78fa5cc1 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:48.252068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815b07-19d9-40fc-9ce1-02bc78fa5cc1 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:48.258087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe2cca-6dc7-48cc-a003-49983c6c0180 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:48.258801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe2cca-6dc7-48cc-a003-49983c6c0180 service swift] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:48.259180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe2cca-6dc7-48cc-a003-49983c6c0180 service swift] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:48.260001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe2cca-6dc7-48cc-a003-49983c6c0180 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:48.269044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe2cca-6dc7-48cc-a003-49983c6c0180 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:48.270799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe2cca-6dc7-48cc-a003-49983c6c0180 service swift] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:48.280865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1200/2421] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:57:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:57:58.201590 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:58.277739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=36 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:33.947710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb350f-f27c-42d2-aa21-c6f8e3b32494 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:58:33.949666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-59fb350f-f27c-42d2-aa21-c6f8e3b32494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:58:33.962642 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb350f-f27c-42d2-aa21-c6f8e3b32494 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:58:33.967279 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef184b-0fbe-44d7-b236-99ba89e8177a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:58:33.967905 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef184b-0fbe-44d7-b236-99ba89e8177a service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:58:33.968161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef184b-0fbe-44d7-b236-99ba89e8177a service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:58:33.968452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef184b-0fbe-44d7-b236-99ba89e8177a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:58:33.970759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-98ef184b-0fbe-44d7-b236-99ba89e8177a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:58:33.985600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef184b-0fbe-44d7-b236-99ba89e8177a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:58:33.987080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef184b-0fbe-44d7-b236-99ba89e8177a service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:58:33.998240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1222/2422] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:58:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:58:34.229074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe2cca-6dc7-48cc-a003-49983c6c0180 service swift] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:58:34.231381 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-85fe2cca-6dc7-48cc-a003-49983c6c0180 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:58:34.297768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe2cca-6dc7-48cc-a003-49983c6c0180 service swift] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:58:34.301703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58460852-7b49-49e1-8001-8e349e086ddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:58:34.302322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460852-7b49-49e1-8001-8e349e086ddb service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:58:34.302602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460852-7b49-49e1-8001-8e349e086ddb service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:58:34.302885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460852-7b49-49e1-8001-8e349e086ddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:58:34.304921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-58460852-7b49-49e1-8001-8e349e086ddb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:58:34.319693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58460852-7b49-49e1-8001-8e349e086ddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:58:34.321126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58460852-7b49-49e1-8001-8e349e086ddb service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:58:34.333263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1201/2423] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:58:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:58:43.993275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=6 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:44.327635 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=26 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:48.036056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef184b-0fbe-44d7-b236-99ba89e8177a service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:58:48.037741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-98ef184b-0fbe-44d7-b236-99ba89e8177a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:58:48.053445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef184b-0fbe-44d7-b236-99ba89e8177a service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:58:48.061403 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200497-29f9-48bd-939d-1037513c0cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:58:48.062386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200497-29f9-48bd-939d-1037513c0cc7 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:58:48.062896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200497-29f9-48bd-939d-1037513c0cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:58:48.063427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200497-29f9-48bd-939d-1037513c0cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:58:48.066362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-78200497-29f9-48bd-939d-1037513c0cc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:58:48.130039 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78200497-29f9-48bd-939d-1037513c0cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:58:48.131678 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78200497-29f9-48bd-939d-1037513c0cc7 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:58:48.141802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1223/2424] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:58:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:58:50.181230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58460852-7b49-49e1-8001-8e349e086ddb service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:58:50.194466 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58460852-7b49-49e1-8001-8e349e086ddb service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:58:50.201484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff138170-0a76-4d14-9105-2e30a78bd804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:58:50.202101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138170-0a76-4d14-9105-2e30a78bd804 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:58:50.202376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138170-0a76-4d14-9105-2e30a78bd804 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:58:50.202646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138170-0a76-4d14-9105-2e30a78bd804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:58:50.204584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ff138170-0a76-4d14-9105-2e30a78bd804 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:58:50.266228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff138170-0a76-4d14-9105-2e30a78bd804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:58:50.267853 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff138170-0a76-4d14-9105-2e30a78bd804 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:58:50.277991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1202/2425] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:58:56.776602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200497-29f9-48bd-939d-1037513c0cc7 service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:58:56.778226 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-78200497-29f9-48bd-939d-1037513c0cc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:58:56.793509 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200497-29f9-48bd-939d-1037513c0cc7 service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:58:56.803717 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140907a7-e6dc-4b41-907f-621b87f2a5be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:58:56.804433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140907a7-e6dc-4b41-907f-621b87f2a5be service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:58:56.804715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140907a7-e6dc-4b41-907f-621b87f2a5be service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:58:56.805033 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140907a7-e6dc-4b41-907f-621b87f2a5be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:58:56.806879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-140907a7-e6dc-4b41-907f-621b87f2a5be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:58:56.873337 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140907a7-e6dc-4b41-907f-621b87f2a5be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:58:56.875168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140907a7-e6dc-4b41-907f-621b87f2a5be service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:58:56.884803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1224/2426] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:58:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:59:00.273554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=28 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:03.655937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14a4fa-a0a3-4360-b2ec-b9531918ffdb None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:03.656733 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14a4fa-a0a3-4360-b2ec-b9531918ffdb None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:03.656733 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14a4fa-a0a3-4360-b2ec-b9531918ffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:03.694691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-bb14a4fa-a0a3-4360-b2ec-b9531918ffdb None None] MFA Rules not processed for user `8ef71e3a38c245d5a008368c23e701d7`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:59:03.696520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-bb14a4fa-a0a3-4360-b2ec-b9531918ffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:03.707235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1203/2427] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:59:04.846038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140907a7-e6dc-4b41-907f-621b87f2a5be service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:04.857133 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140907a7-e6dc-4b41-907f-621b87f2a5be service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:04.861062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdeb95-14b0-48f5-ae1b-bb7317872d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:04.861816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdeb95-14b0-48f5-ae1b-bb7317872d6d service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:04.862096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdeb95-14b0-48f5-ae1b-bb7317872d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:04.862363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdeb95-14b0-48f5-ae1b-bb7317872d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:04.864376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5efdeb95-14b0-48f5-ae1b-bb7317872d6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:04.874707 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdeb95-14b0-48f5-ae1b-bb7317872d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:04.876169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdeb95-14b0-48f5-ae1b-bb7317872d6d service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:04.884334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1225/2428] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:59:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:59:08.750976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3e78-6c4f-4304-9da7-046f4b553ad1 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:08.751548 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3e78-6c4f-4304-9da7-046f4b553ad1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:08.751712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3e78-6c4f-4304-9da7-046f4b553ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:08.779357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-da6c3e78-6c4f-4304-9da7-046f4b553ad1 None None] MFA Rules not processed for user `329a85e5f5e9446c80dc45cafd329108`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:59:08.780634 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-da6c3e78-6c4f-4304-9da7-046f4b553ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:08.787849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1204/2429] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:59:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:59:09.114408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdeb95-14b0-48f5-ae1b-bb7317872d6d service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:09.123824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdeb95-14b0-48f5-ae1b-bb7317872d6d service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:09.128059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf31bbc-854d-4d95-9b77-77465f2afd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:09.128685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf31bbc-854d-4d95-9b77-77465f2afd72 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:09.128957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf31bbc-854d-4d95-9b77-77465f2afd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:09.129232 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf31bbc-854d-4d95-9b77-77465f2afd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:09.131175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3cf31bbc-854d-4d95-9b77-77465f2afd72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:09.142370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf31bbc-854d-4d95-9b77-77465f2afd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:09.143842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf31bbc-854d-4d95-9b77-77465f2afd72 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:09.152561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1226/2430] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:59:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:59:09.500277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c3e78-6c4f-4304-9da7-046f4b553ad1 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:09.501935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-da6c3e78-6c4f-4304-9da7-046f4b553ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:09.579161 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c3e78-6c4f-4304-9da7-046f4b553ad1 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:09.585218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b0ae2-d66b-4f5a-aed3-e58972569ced service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:09.585962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b0ae2-d66b-4f5a-aed3-e58972569ced service placement] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:09.586243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b0ae2-d66b-4f5a-aed3-e58972569ced service placement] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:09.586514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b0ae2-d66b-4f5a-aed3-e58972569ced service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:09.588552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c83b0ae2-d66b-4f5a-aed3-e58972569ced service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:09.601751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b0ae2-d66b-4f5a-aed3-e58972569ced service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:09.603398 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b0ae2-d66b-4f5a-aed3-e58972569ced service placement] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:09.614895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1205/2431] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:59:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:59:13.742175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b8b39-02d3-4065-80e7-0835cc098e58 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:13.742792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b8b39-02d3-4065-80e7-0835cc098e58 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:13.742792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b8b39-02d3-4065-80e7-0835cc098e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:13.766649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-e69b8b39-02d3-4065-80e7-0835cc098e58 None None] MFA Rules not processed for user `36ab34b69abc4a8dbe7bb0a40ad768b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:59:13.767934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-e69b8b39-02d3-4065-80e7-0835cc098e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:13.775988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1227/2432] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 16:59:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:59:14.257443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b0ae2-d66b-4f5a-aed3-e58972569ced service placement] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:14.270658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b0ae2-d66b-4f5a-aed3-e58972569ced service placement] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:14.276524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0f089-a7d9-44a3-8f86-ef9b88295eef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:14.277229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0f089-a7d9-44a3-8f86-ef9b88295eef service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:14.277572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0f089-a7d9-44a3-8f86-ef9b88295eef service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:14.277916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0f089-a7d9-44a3-8f86-ef9b88295eef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:14.280010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-dbb0f089-a7d9-44a3-8f86-ef9b88295eef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:14.292767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0f089-a7d9-44a3-8f86-ef9b88295eef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:14.294354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0f089-a7d9-44a3-8f86-ef9b88295eef service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:14.305799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1206/2433] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:59:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:59:23.759535 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=71 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:24.301934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=44 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:25.027825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b8b39-02d3-4065-80e7-0835cc098e58 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:25.047651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b8b39-02d3-4065-80e7-0835cc098e58 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:25.054164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c6fc8-22b2-4fad-a647-d317d9a9e59d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:25.054853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6fc8-22b2-4fad-a647-d317d9a9e59d service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:25.055175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6fc8-22b2-4fad-a647-d317d9a9e59d service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:25.055453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6fc8-22b2-4fad-a647-d317d9a9e59d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:25.057250 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-dc4c6fc8-22b2-4fad-a647-d317d9a9e59d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:25.072274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c6fc8-22b2-4fad-a647-d317d9a9e59d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:25.074174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c6fc8-22b2-4fad-a647-d317d9a9e59d service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:25.092077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1228/2434] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:59:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:59:26.447229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0f089-a7d9-44a3-8f86-ef9b88295eef service nova] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:26.459749 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0f089-a7d9-44a3-8f86-ef9b88295eef service nova] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:26.466160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89b2a5-0750-4145-bc34-8231b335b826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:26.466782 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89b2a5-0750-4145-bc34-8231b335b826 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:26.467107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89b2a5-0750-4145-bc34-8231b335b826 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:26.467384 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89b2a5-0750-4145-bc34-8231b335b826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:26.471968 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ba89b2a5-0750-4145-bc34-8231b335b826 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:26.483016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89b2a5-0750-4145-bc34-8231b335b826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:26.484715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89b2a5-0750-4145-bc34-8231b335b826 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:26.502682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1207/2435] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 16:59:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:59:35.082589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=6 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:36.491427 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=6 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:55.035937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d12a3-a729-48c4-a69c-3ed31f39f7e4 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:55.036442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d12a3-a729-48c4-a69c-3ed31f39f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:55.036442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d12a3-a729-48c4-a69c-3ed31f39f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:55.057900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-1c3d12a3-a729-48c4-a69c-3ed31f39f7e4 None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:59:55.059398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1c3d12a3-a729-48c4-a69c-3ed31f39f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:55.067474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1229/2436] 10.222.0.124 () {58 vars in 972 bytes} [Mon Aug 1 16:59:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:59:55.121587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89b2a5-0750-4145-bc34-8231b335b826 service nova] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:55.133470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89b2a5-0750-4145-bc34-8231b335b826 service nova] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:55.140088 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589c6e2-a61c-4d9a-8288-d81e74c37776 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:55.140713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c6e2-a61c-4d9a-8288-d81e74c37776 service swift] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:55.140994 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c6e2-a61c-4d9a-8288-d81e74c37776 service swift] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:55.141269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c6e2-a61c-4d9a-8288-d81e74c37776 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:55.150446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589c6e2-a61c-4d9a-8288-d81e74c37776 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:55.152242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589c6e2-a61c-4d9a-8288-d81e74c37776 service swift] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:55.160973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1208/2437] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 16:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:00:02.446344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d12a3-a729-48c4-a69c-3ed31f39f7e4 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:02.448065 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1c3d12a3-a729-48c4-a69c-3ed31f39f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:02.526543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d12a3-a729-48c4-a69c-3ed31f39f7e4 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:02.531224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:02.531876 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:02.532152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:02.532424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] PATH_INFO: `/v3/users/e73396a25e87410fb73697ac8e92833f` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:02.533582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73396a25e87410fb73697ac8e92833f)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:02.535582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:02.590215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73396a25e87410fb73697ac8e92833f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:02.599203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73396a25e87410fb73697ac8e92833f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:02.606002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73396a25e87410fb73697ac8e92833f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:02.608916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73396a25e87410fb73697ac8e92833f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:02.608916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73396a25e87410fb73697ac8e92833f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:02.624559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1230/2438] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:00:02 2022] DELETE /identity/v3/users/e73396a25e87410fb73697ac8e92833f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:00:02.815426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589c6e2-a61c-4d9a-8288-d81e74c37776 service swift] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:02.827527 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589c6e2-a61c-4d9a-8288-d81e74c37776 service swift] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:02.901024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:02.901720 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:02.902699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:02.902699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] PATH_INFO: `/v3/projects/0384eb2e221e4886ae55816625f7a2d8` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:02.904157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0384eb2e221e4886ae55816625f7a2d8)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:02.906154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:02.955286 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0384eb2e221e4886ae55816625f7a2d8', 'request_id': 'req-f86aba9a-e557-4935-867a-e7799cb589e4'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:02.961791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0384eb2e221e4886ae55816625f7a2d8', 'request_id': 'req-f86aba9a-e557-4935-867a-e7799cb589e4'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:02.968196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0384eb2e221e4886ae55816625f7a2d8', 'request_id': 'req-f86aba9a-e557-4935-867a-e7799cb589e4'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:02.982775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] The token cache is being invalidate because project 0384eb2e221e4886ae55816625f7a2d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:00:02.983098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:02.983755 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:02.985308 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1209/2439] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:00:02 2022] DELETE /identity/v3/projects/0384eb2e221e4886ae55816625f7a2d8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:00:02.989688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:02.991483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:03.005755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469af9fd-a6bb-488b-aef7-2e25a678608d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:03.066693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:03.067366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:03.067648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:03.067951 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] PATH_INFO: `/v3/users/24b085bd5b0c418d99f38130837241c8` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:03.069144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=24b085bd5b0c418d99f38130837241c8)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:03.071118 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:03.085268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:03.122143 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24b085bd5b0c418d99f38130837241c8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:03.131424 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24b085bd5b0c418d99f38130837241c8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:03.138581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24b085bd5b0c418d99f38130837241c8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:03.139307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24b085bd5b0c418d99f38130837241c8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:03.139986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24b085bd5b0c418d99f38130837241c8'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:03.159203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1231/2440] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:00:02 2022] DELETE /identity/v3/users/24b085bd5b0c418d99f38130837241c8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:00:03.352026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:03.353532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:03.367703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aba9a-e557-4935-867a-e7799cb589e4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:03.430220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:03.430874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:03.431190 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:03.431463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] PATH_INFO: `/v3/projects/2729ff31fe7e46d7b9011d49164646c5` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:03.432678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2729ff31fe7e46d7b9011d49164646c5)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:03.434627 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:03.459819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:03.493391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2729ff31fe7e46d7b9011d49164646c5', 'request_id': 'req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:03.500460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2729ff31fe7e46d7b9011d49164646c5', 'request_id': 'req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:03.507176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2729ff31fe7e46d7b9011d49164646c5', 'request_id': 'req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:03.535908 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] The token cache is being invalidate because project 2729ff31fe7e46d7b9011d49164646c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:00:03.536193 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:03.536944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:03.539907 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1210/2441] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:00:03 2022] DELETE /identity/v3/projects/2729ff31fe7e46d7b9011d49164646c5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:00:13.155058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:13.525340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:33.489595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:33.491321 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:33.554774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36b6c-1f4a-4dc3-88e6-599cb102fe0d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:33.607617 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83e17f-37df-4236-ad3a-992df77e226a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:33.608241 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e17f-37df-4236-ad3a-992df77e226a service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:33.608522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e17f-37df-4236-ad3a-992df77e226a service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:33.608793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e17f-37df-4236-ad3a-992df77e226a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:33.610974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-bd83e17f-37df-4236-ad3a-992df77e226a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:33.675930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83e17f-37df-4236-ad3a-992df77e226a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:33.677403 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83e17f-37df-4236-ad3a-992df77e226a service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:33.688412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1232/2442] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:00:37.268046 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:37.269581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:37.339727 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83e17f-37df-4236-ad3a-992df77e226a service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:37.341217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-bd83e17f-37df-4236-ad3a-992df77e226a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:37.354829 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83e17f-37df-4236-ad3a-992df77e226a service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:37.360220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b3f26-8f7c-4bab-902e-1ab75d5b3af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:37.360805 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b3f26-8f7c-4bab-902e-1ab75d5b3af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:37.361089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b3f26-8f7c-4bab-902e-1ab75d5b3af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:37.361378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b3f26-8f7c-4bab-902e-1ab75d5b3af8 admin admin] PATH_INFO: `/v3/users/8ef71e3a38c245d5a008368c23e701d7` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:37.362581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b3f26-8f7c-4bab-902e-1ab75d5b3af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef71e3a38c245d5a008368c23e701d7)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:37.364585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b3f26-8f7c-4bab-902e-1ab75d5b3af8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:37.368684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d6f48-9de3-4780-a3de-2bf52a1d0d15 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:37.373973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435791d-daf5-4520-8574-325a6251b480 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:37.374789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435791d-daf5-4520-8574-325a6251b480 service placement] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:37.375104 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435791d-daf5-4520-8574-325a6251b480 service placement] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:37.375381 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435791d-daf5-4520-8574-325a6251b480 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:37.377170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d435791d-daf5-4520-8574-325a6251b480 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:37.395910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435791d-daf5-4520-8574-325a6251b480 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:37.397593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435791d-daf5-4520-8574-325a6251b480 service placement] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:37.409049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1211/2443] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:00:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:00:37.422170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-078b3f26-8f7c-4bab-902e-1ab75d5b3af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef71e3a38c245d5a008368c23e701d7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:37.431793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-078b3f26-8f7c-4bab-902e-1ab75d5b3af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef71e3a38c245d5a008368c23e701d7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:37.437515 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:37.441741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-078b3f26-8f7c-4bab-902e-1ab75d5b3af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef71e3a38c245d5a008368c23e701d7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:37.442668 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-078b3f26-8f7c-4bab-902e-1ab75d5b3af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef71e3a38c245d5a008368c23e701d7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:37.443767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-078b3f26-8f7c-4bab-902e-1ab75d5b3af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef71e3a38c245d5a008368c23e701d7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:37.462521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1233/2444] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:00:37 2022] DELETE /identity/v3/users/8ef71e3a38c245d5a008368c23e701d7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:00:37.660310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435791d-daf5-4520-8574-325a6251b480 service placement] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:37.673010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435791d-daf5-4520-8574-325a6251b480 service placement] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:37.730599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:37.731258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:37.731625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:37.731904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] PATH_INFO: `/v3/projects/7a976b4e2c5847b395755325c8c85ee9` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:37.733095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a976b4e2c5847b395755325c8c85ee9)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:37.735076 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:37.789770 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a976b4e2c5847b395755325c8c85ee9', 'request_id': 'req-0ba8475f-0b2e-482a-b225-978b2364246b'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:37.796173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a976b4e2c5847b395755325c8c85ee9', 'request_id': 'req-0ba8475f-0b2e-482a-b225-978b2364246b'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:37.801823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a976b4e2c5847b395755325c8c85ee9', 'request_id': 'req-0ba8475f-0b2e-482a-b225-978b2364246b'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:37.816840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] The token cache is being invalidate because project 7a976b4e2c5847b395755325c8c85ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:00:37.817124 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:37.817760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-0ba8475f-0b2e-482a-b225-978b2364246b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:00:37.819387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1212/2445] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:00:37 2022] DELETE /identity/v3/projects/7a976b4e2c5847b395755325c8c85ee9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:00:37.824573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577130-6079-423a-a99c-3448a45d08f1 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:37.824862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577130-6079-423a-a99c-3448a45d08f1 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:37.825165 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577130-6079-423a-a99c-3448a45d08f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:37.846381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-d9577130-6079-423a-a99c-3448a45d08f1 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:00:37.847671 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d9577130-6079-423a-a99c-3448a45d08f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:37.909625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1234/2446] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:00:37.917523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfeab2-56a5-4dda-ac02-459295be4d0f None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:37.917795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfeab2-56a5-4dda-ac02-459295be4d0f None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:37.918064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfeab2-56a5-4dda-ac02-459295be4d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:37.938035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d6cfeab2-56a5-4dda-ac02-459295be4d0f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:00:37.939314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d6cfeab2-56a5-4dda-ac02-459295be4d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:37.948052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1213/2447] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:00:37.953295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577130-6079-423a-a99c-3448a45d08f1 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:37.965491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577130-6079-423a-a99c-3448a45d08f1 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:37.971421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f39fd-1e20-4b05-9acf-a4b034bcac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:37.972040 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f39fd-1e20-4b05-9acf-a4b034bcac1f admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:37.972325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f39fd-1e20-4b05-9acf-a4b034bcac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:37.972595 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f39fd-1e20-4b05-9acf-a4b034bcac1f admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:37.973306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f39fd-1e20-4b05-9acf-a4b034bcac1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:00:37.973604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f39fd-1e20-4b05-9acf-a4b034bcac1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:37.975396 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f39fd-1e20-4b05-9acf-a4b034bcac1f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:37.987468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1235/2448] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:00:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:00:37.992531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfeab2-56a5-4dda-ac02-459295be4d0f None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:38.002181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfeab2-56a5-4dda-ac02-459295be4d0f None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:38.007728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d1594-dd03-483a-96cb-dadbc3b071b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:38.008451 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d1594-dd03-483a-96cb-dadbc3b071b3 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:38.008737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d1594-dd03-483a-96cb-dadbc3b071b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:38.009010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d1594-dd03-483a-96cb-dadbc3b071b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:38.009671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d1594-dd03-483a-96cb-dadbc3b071b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:38.011653 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d1594-dd03-483a-96cb-dadbc3b071b3 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:38.024237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:38.046045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1214/2449] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:00:37 2022] POST /identity/v3/projects => generated 378 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:00:38.052638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f39fd-1e20-4b05-9acf-a4b034bcac1f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:38.063258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f39fd-1e20-4b05-9acf-a4b034bcac1f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:38.131507 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117cd30-1a14-480c-9122-fbbddbf8827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:38.132130 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117cd30-1a14-480c-9122-fbbddbf8827e admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:38.132412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117cd30-1a14-480c-9122-fbbddbf8827e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:38.132687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117cd30-1a14-480c-9122-fbbddbf8827e admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:38.133350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117cd30-1a14-480c-9122-fbbddbf8827e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:38.135326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117cd30-1a14-480c-9122-fbbddbf8827e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:38.160282 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1236/2450] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:00:38 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:00:38.164484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d1594-dd03-483a-96cb-dadbc3b071b3 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:38.174811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d1594-dd03-483a-96cb-dadbc3b071b3 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:38.179998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb5070-a8a0-452e-b345-5c2255586a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:38.180614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb5070-a8a0-452e-b345-5c2255586a57 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:38.180896 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb5070-a8a0-452e-b345-5c2255586a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:38.181168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb5070-a8a0-452e-b345-5c2255586a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:38.181887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb5070-a8a0-452e-b345-5c2255586a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:38.183520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb5070-a8a0-452e-b345-5c2255586a57 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:38.193754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1215/2451] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:00:38 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:00:38.198109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117cd30-1a14-480c-9122-fbbddbf8827e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:38.208937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117cd30-1a14-480c-9122-fbbddbf8827e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:38.213977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4315d5-ea10-44bd-aa8e-e72420dbc8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:38.214585 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4315d5-ea10-44bd-aa8e-e72420dbc8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:38.214842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4315d5-ea10-44bd-aa8e-e72420dbc8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:38.215159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4315d5-ea10-44bd-aa8e-e72420dbc8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:38.215861 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4315d5-ea10-44bd-aa8e-e72420dbc8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:38.217461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4315d5-ea10-44bd-aa8e-e72420dbc8d1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:38.229027 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1237/2452] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:00:38 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:00:38.233748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb5070-a8a0-452e-b345-5c2255586a57 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:38.244965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb5070-a8a0-452e-b345-5c2255586a57 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:38.250615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382b05d-a6ba-4e7b-b367-630398a1d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:38.251371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b05d-a6ba-4e7b-b367-630398a1d172 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:38.251681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b05d-a6ba-4e7b-b367-630398a1d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:38.251954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b05d-a6ba-4e7b-b367-630398a1d172 admin admin] PATH_INFO: `/v3/projects/eb8ecf20c2244c1581f3db04d5c6fccf/users/9c00b4f4b424406d8b460e0f489c4703/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:38.267512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382b05d-a6ba-4e7b-b367-630398a1d172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8ecf20c2244c1581f3db04d5c6fccf, user_id=9c00b4f4b424406d8b460e0f489c4703, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:38.270173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382b05d-a6ba-4e7b-b367-630398a1d172 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:38.285694 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1216/2453] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:00:38 2022] PUT /identity/v3/projects/eb8ecf20c2244c1581f3db04d5c6fccf/users/9c00b4f4b424406d8b460e0f489c4703/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:00:38.291058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c20d9-f41a-44a2-b9a9-8601eeb88893 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:38.291412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c20d9-f41a-44a2-b9a9-8601eeb88893 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:38.291750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c20d9-f41a-44a2-b9a9-8601eeb88893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:38.311255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a39c20d9-f41a-44a2-b9a9-8601eeb88893 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:00:38.312467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a39c20d9-f41a-44a2-b9a9-8601eeb88893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:38.357626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:38.384686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1238/2454] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:00:38.394788 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382b05d-a6ba-4e7b-b367-630398a1d172 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:38.396753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a382b05d-a6ba-4e7b-b367-630398a1d172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:38.455408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382b05d-a6ba-4e7b-b367-630398a1d172 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:38.459588 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77495ea4-b222-4430-96c9-8508cd8f0d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:38.460198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77495ea4-b222-4430-96c9-8508cd8f0d8d service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:38.460472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77495ea4-b222-4430-96c9-8508cd8f0d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:38.460744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77495ea4-b222-4430-96c9-8508cd8f0d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:38.471520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77495ea4-b222-4430-96c9-8508cd8f0d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:38.473852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77495ea4-b222-4430-96c9-8508cd8f0d8d service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:38.483621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1217/2455] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:00:40.190756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c20d9-f41a-44a2-b9a9-8601eeb88893 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:40.201235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c20d9-f41a-44a2-b9a9-8601eeb88893 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:40.205800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab3db8-87df-4ad0-a9ef-4ab0b03210a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:40.206433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab3db8-87df-4ad0-a9ef-4ab0b03210a8 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:40.206879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab3db8-87df-4ad0-a9ef-4ab0b03210a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:40.207345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab3db8-87df-4ad0-a9ef-4ab0b03210a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:40.209525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-95ab3db8-87df-4ad0-a9ef-4ab0b03210a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:40.220430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab3db8-87df-4ad0-a9ef-4ab0b03210a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:40.222144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab3db8-87df-4ad0-a9ef-4ab0b03210a8 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:40.240058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1239/2456] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:00:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:00:40.398576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce559-bac2-4832-8b25-0b3aa303c488 None None] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:40.399176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce559-bac2-4832-8b25-0b3aa303c488 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:40.399176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce559-bac2-4832-8b25-0b3aa303c488 None None] PATH_INFO: `/` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:40.400872 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1218/2457] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 17:00:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:00:40.407345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7bc61-86d0-453d-811d-e1f88560617d None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:40.407656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7bc61-86d0-453d-811d-e1f88560617d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:40.407993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7bc61-86d0-453d-811d-e1f88560617d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:40.436186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-7ba7bc61-86d0-453d-811d-e1f88560617d None None] MFA Rules not processed for user `dcfe4d6c32064d79835c415d9fc02cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:00:40.439758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7ba7bc61-86d0-453d-811d-e1f88560617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:40.449101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1240/2458] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 17:00:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:00:40.469886 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fce559-bac2-4832-8b25-0b3aa303c488 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:40.489859 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fce559-bac2-4832-8b25-0b3aa303c488 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:40.495882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9727da-2f1b-4712-a8a0-478e5327c0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:40.497026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9727da-2f1b-4712-a8a0-478e5327c0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:40.497318 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9727da-2f1b-4712-a8a0-478e5327c0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:40.497600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9727da-2f1b-4712-a8a0-478e5327c0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:40.507207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9727da-2f1b-4712-a8a0-478e5327c0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:40.509342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9727da-2f1b-4712-a8a0-478e5327c0f2 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:40.522811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1219/2459] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:00:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:00:40.675735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eff83-cc84-4417-b48d-1fbed0d0403a None None] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:40.676272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eff83-cc84-4417-b48d-1fbed0d0403a None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:40.676705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eff83-cc84-4417-b48d-1fbed0d0403a None None] PATH_INFO: `/` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:40.678758 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1241/2460] 10.222.0.124 () {54 vars in 926 bytes} [Mon Aug 1 17:00:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:00:40.685857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb584-f04d-4728-9460-11d473efe872 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:40.686255 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb584-f04d-4728-9460-11d473efe872 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:40.686674 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb584-f04d-4728-9460-11d473efe872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:40.713742 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e4edb584-f04d-4728-9460-11d473efe872 None None] MFA Rules not processed for user `9728f2fe7b5a40cd9f8ead5cf99af581`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:00:40.715223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e4edb584-f04d-4728-9460-11d473efe872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:40.794332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1220/2461] 10.222.0.124 () {58 vars in 1023 bytes} [Mon Aug 1 17:00:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:00:40.805525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eff83-cc84-4417-b48d-1fbed0d0403a None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:40.807483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4a7eff83-cc84-4417-b48d-1fbed0d0403a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:40.825486 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eff83-cc84-4417-b48d-1fbed0d0403a None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:40.830077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02470ac8-bc15-456b-a46a-b86cce9a30fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:40.831154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02470ac8-bc15-456b-a46a-b86cce9a30fe service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:40.831457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02470ac8-bc15-456b-a46a-b86cce9a30fe service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:40.831729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02470ac8-bc15-456b-a46a-b86cce9a30fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:40.844910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02470ac8-bc15-456b-a46a-b86cce9a30fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:40.846780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02470ac8-bc15-456b-a46a-b86cce9a30fe service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:40.860316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1242/2462] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:00:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:00:43.668086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a433d-4501-48b2-b962-68bcf72ca5f2 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:43.668641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a433d-4501-48b2-b962-68bcf72ca5f2 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:43.668641 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a433d-4501-48b2-b962-68bcf72ca5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:43.700891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-929a433d-4501-48b2-b962-68bcf72ca5f2 None None] MFA Rules not processed for user `9c00b4f4b424406d8b460e0f489c4703`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:00:43.702501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-929a433d-4501-48b2-b962-68bcf72ca5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:43.732087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:43.774705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1221/2463] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:00:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:00:43.789127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02470ac8-bc15-456b-a46a-b86cce9a30fe service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:00:43.790579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-02470ac8-bc15-456b-a46a-b86cce9a30fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:43.806046 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02470ac8-bc15-456b-a46a-b86cce9a30fe service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:00:43.812500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d56b6d-c078-4dca-a6e6-b2a9801a1bce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:00:43.813048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d56b6d-c078-4dca-a6e6-b2a9801a1bce service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:43.813323 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d56b6d-c078-4dca-a6e6-b2a9801a1bce service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:43.813591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d56b6d-c078-4dca-a6e6-b2a9801a1bce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:43.822018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d56b6d-c078-4dca-a6e6-b2a9801a1bce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:00:43.823703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d56b6d-c078-4dca-a6e6-b2a9801a1bce service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:00:43.833746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1243/2464] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:00:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:00:45.280898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545041e-ae3e-4ab7-b506-245eab39797e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:00:45.281503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545041e-ae3e-4ab7-b506-245eab39797e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:00:45.281503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545041e-ae3e-4ab7-b506-245eab39797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:00:45.301145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6545041e-ae3e-4ab7-b506-245eab39797e None None] MFA Rules not processed for user `9c00b4f4b424406d8b460e0f489c4703`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:00:45.302377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6545041e-ae3e-4ab7-b506-245eab39797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:00:45.309718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1222/2465] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:00:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:00:53.829694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=28 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:55.295793 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=18 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:01.028442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515a759-fc63-4c29-9238-e35260620e6f None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:01.029559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515a759-fc63-4c29-9238-e35260620e6f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:01.030390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515a759-fc63-4c29-9238-e35260620e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:01.051090 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4515a759-fc63-4c29-9238-e35260620e6f None None] MFA Rules not processed for user `329a85e5f5e9446c80dc45cafd329108`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:01.052307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4515a759-fc63-4c29-9238-e35260620e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:01.114222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1244/2466] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:01:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:01:11.107683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=25 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:20.627840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ca83d-eec2-45e8-a2d5-ae692b34cbce None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:20.628342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ca83d-eec2-45e8-a2d5-ae692b34cbce None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:20.628448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ca83d-eec2-45e8-a2d5-ae692b34cbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:20.680669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-2a6ca83d-eec2-45e8-a2d5-ae692b34cbce None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:20.682188 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2a6ca83d-eec2-45e8-a2d5-ae692b34cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:20.768895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1223/2467] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 17:01:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:01:20.821842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515a759-fc63-4c29-9238-e35260620e6f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:20.823711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4515a759-fc63-4c29-9238-e35260620e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:20.929815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515a759-fc63-4c29-9238-e35260620e6f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:20.937794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d78e1-3e3d-4643-bbdb-17f0768d12f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:20.938705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d78e1-3e3d-4643-bbdb-17f0768d12f6 service swift] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:20.938994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d78e1-3e3d-4643-bbdb-17f0768d12f6 service swift] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:20.940181 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d78e1-3e3d-4643-bbdb-17f0768d12f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:20.952813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d78e1-3e3d-4643-bbdb-17f0768d12f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:20.954400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d78e1-3e3d-4643-bbdb-17f0768d12f6 service swift] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:20.963079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1245/2468] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 17:01:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:01:30.765903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=45 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:30.959606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=47 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:34.232917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ca83d-eec2-45e8-a2d5-ae692b34cbce None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:34.234608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-2a6ca83d-eec2-45e8-a2d5-ae692b34cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:34.335718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ca83d-eec2-45e8-a2d5-ae692b34cbce None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:34.341443 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d7d7c-f5b6-4206-be93-5cfa9139adf3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:34.342064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7d7c-f5b6-4206-be93-5cfa9139adf3 service placement] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:34.342343 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7d7c-f5b6-4206-be93-5cfa9139adf3 service placement] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:34.342615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7d7c-f5b6-4206-be93-5cfa9139adf3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:34.345093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8c0d7d7c-f5b6-4206-be93-5cfa9139adf3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:34.361884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d7d7c-f5b6-4206-be93-5cfa9139adf3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:34.363500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d7d7c-f5b6-4206-be93-5cfa9139adf3 service placement] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:34.374275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1224/2469] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:01:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:01:38.487804 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d9fb-df96-4e4b-a0c3-6ca2f6a51878 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:38.488618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d9fb-df96-4e4b-a0c3-6ca2f6a51878 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:38.488618 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d9fb-df96-4e4b-a0c3-6ca2f6a51878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:38.511111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-22e9d9fb-df96-4e4b-a0c3-6ca2f6a51878 None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:38.512348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-22e9d9fb-df96-4e4b-a0c3-6ca2f6a51878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:38.519955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1246/2470] 10.222.0.124 () {58 vars in 1014 bytes} [Mon Aug 1 17:01:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:01:38.532178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d7d7c-f5b6-4206-be93-5cfa9139adf3 service placement] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:38.544374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d7d7c-f5b6-4206-be93-5cfa9139adf3 service placement] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:38.550519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78890ff-b98f-43aa-a1ca-c420e53d54f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:38.551168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78890ff-b98f-43aa-a1ca-c420e53d54f1 service swift] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:38.551485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78890ff-b98f-43aa-a1ca-c420e53d54f1 service swift] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:38.551746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78890ff-b98f-43aa-a1ca-c420e53d54f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:38.560643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78890ff-b98f-43aa-a1ca-c420e53d54f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:38.562244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78890ff-b98f-43aa-a1ca-c420e53d54f1 service swift] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:38.570560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1225/2471] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 17:01:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:01:48.505682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:48.567066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=47 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:02.042794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cea68-f629-4ee5-b110-f1a1d37bfb2c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:02:02.043314 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cea68-f629-4ee5-b110-f1a1d37bfb2c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:02:02.043425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cea68-f629-4ee5-b110-f1a1d37bfb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:02:02.069667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-099cea68-f629-4ee5-b110-f1a1d37bfb2c None None] MFA Rules not processed for user `c5e98d3e170a4e95bc03daf2a950e5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:02:02.071219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-099cea68-f629-4ee5-b110-f1a1d37bfb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:02:02.079900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1247/2472] 10.222.0.124 () {58 vars in 972 bytes} [Mon Aug 1 17:02:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:02:02.094603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78890ff-b98f-43aa-a1ca-c420e53d54f1 service swift] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:02:02.106248 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78890ff-b98f-43aa-a1ca-c420e53d54f1 service swift] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:02:02.112344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae397c-c12c-40a5-8230-d5785173e14e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b46aa077b4147c9836b646cf42cff50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:02:02.112990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae397c-c12c-40a5-8230-d5785173e14e service swift] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:02:02.113279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae397c-c12c-40a5-8230-d5785173e14e service swift] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:02:02.113554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae397c-c12c-40a5-8230-d5785173e14e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:02:02.130798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae397c-c12c-40a5-8230-d5785173e14e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:02:02.132469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae397c-c12c-40a5-8230-d5785173e14e service swift] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:02:02.141775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1226/2473] 10.222.0.124 () {60 vars in 1389 bytes} [Mon Aug 1 17:02:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:02:12.061336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:12.138183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=6 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:42.258989 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cea68-f629-4ee5-b110-f1a1d37bfb2c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:02:42.279578 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cea68-f629-4ee5-b110-f1a1d37bfb2c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:02:42.283869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a0b8b-6360-458e-9de8-6456422eeff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:02:42.294449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a0b8b-6360-458e-9de8-6456422eeff0 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:02:42.294804 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a0b8b-6360-458e-9de8-6456422eeff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:02:42.295101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a0b8b-6360-458e-9de8-6456422eeff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:02:42.298018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-589a0b8b-6360-458e-9de8-6456422eeff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:02:42.370983 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a0b8b-6360-458e-9de8-6456422eeff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:02:42.372266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a0b8b-6360-458e-9de8-6456422eeff0 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:02:42.381615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1248/2474] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:02:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:02:47.215210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae397c-c12c-40a5-8230-d5785173e14e service swift] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:02:47.225527 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae397c-c12c-40a5-8230-d5785173e14e service swift] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:02:47.229938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0942ca7-8cfc-4ccd-ac43-48a64577d3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:02:47.231008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0942ca7-8cfc-4ccd-ac43-48a64577d3cf service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:02:47.231300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0942ca7-8cfc-4ccd-ac43-48a64577d3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:02:47.231593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0942ca7-8cfc-4ccd-ac43-48a64577d3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:02:47.233520 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c0942ca7-8cfc-4ccd-ac43-48a64577d3cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:02:47.270254 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0942ca7-8cfc-4ccd-ac43-48a64577d3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:02:47.271747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0942ca7-8cfc-4ccd-ac43-48a64577d3cf service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:02:47.294468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1227/2475] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:02:52.377378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=32 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:54.256517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a0b8b-6360-458e-9de8-6456422eeff0 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:02:54.258309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-589a0b8b-6360-458e-9de8-6456422eeff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:02:54.273724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a0b8b-6360-458e-9de8-6456422eeff0 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:02:54.278828 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:02:54.279684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:02:54.280061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:02:54.280416 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] PATH_INFO: `/v3/users/0dc8894b1bce490dbb939bed975f1ada` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:02:54.281743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc8894b1bce490dbb939bed975f1ada)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:02:54.283940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:02:54.356787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc8894b1bce490dbb939bed975f1ada'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.366725 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc8894b1bce490dbb939bed975f1ada'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.379212 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc8894b1bce490dbb939bed975f1ada'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.379933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc8894b1bce490dbb939bed975f1ada'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.380553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc8894b1bce490dbb939bed975f1ada'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.402799 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1249/2476] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:02:54 2022] DELETE /identity/v3/users/0dc8894b1bce490dbb939bed975f1ada => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:02:54.609080 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0942ca7-8cfc-4ccd-ac43-48a64577d3cf service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:02:54.622764 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0942ca7-8cfc-4ccd-ac43-48a64577d3cf service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:02:54.702491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:02:54.703270 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:02:54.703624 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:02:54.703976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] PATH_INFO: `/v3/projects/52027819059b40298dc3a64e2a8a65a4` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:02:54.705247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52027819059b40298dc3a64e2a8a65a4)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:02:54.707707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:02:54.760165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52027819059b40298dc3a64e2a8a65a4', 'request_id': 'req-278851a1-14fb-43d3-b12a-15df5a509d95'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.767050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52027819059b40298dc3a64e2a8a65a4', 'request_id': 'req-278851a1-14fb-43d3-b12a-15df5a509d95'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.773646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52027819059b40298dc3a64e2a8a65a4', 'request_id': 'req-278851a1-14fb-43d3-b12a-15df5a509d95'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.788148 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] The token cache is being invalidate because project 52027819059b40298dc3a64e2a8a65a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:02:54.788441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.789119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.790650 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1228/2477] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:02:54 2022] DELETE /identity/v3/projects/52027819059b40298dc3a64e2a8a65a4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:02:54.795204 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:02:54.796639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:02:54.811116 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdc533-70b2-4438-8519-1e7f46d466ce admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:02:54.870447 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:02:54.871142 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:02:54.871428 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:02:54.871673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] PATH_INFO: `/v3/users/a280927b5a054b3d9ea859fb6653c302` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:02:54.872874 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a280927b5a054b3d9ea859fb6653c302)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:02:54.874833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:02:54.921297 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a280927b5a054b3d9ea859fb6653c302'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.929306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a280927b5a054b3d9ea859fb6653c302'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.936635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a280927b5a054b3d9ea859fb6653c302'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.937271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a280927b5a054b3d9ea859fb6653c302'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.937885 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a280927b5a054b3d9ea859fb6653c302'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:54.946129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:54.957575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1250/2478] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:02:54 2022] DELETE /identity/v3/users/a280927b5a054b3d9ea859fb6653c302 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:02:55.231754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:02:55.233316 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:02:55.245799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278851a1-14fb-43d3-b12a-15df5a509d95 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:02:55.300015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:55.314983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:02:55.315667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:02:55.315939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:02:55.316217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] PATH_INFO: `/v3/projects/a9a44b2bbc994388859519b1effa6f1e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:02:55.317407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a44b2bbc994388859519b1effa6f1e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:02:55.319418 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:02:55.368779 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a44b2bbc994388859519b1effa6f1e', 'request_id': 'req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:55.375029 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a44b2bbc994388859519b1effa6f1e', 'request_id': 'req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:55.380413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a44b2bbc994388859519b1effa6f1e', 'request_id': 'req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:55.395010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] The token cache is being invalidate because project a9a44b2bbc994388859519b1effa6f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:02:55.395314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:55.395953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:02:55.397517 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1229/2479] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:02:55 2022] DELETE /identity/v3/projects/a9a44b2bbc994388859519b1effa6f1e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:02.599368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:02.601022 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:02.685800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaabc8f-38ae-4f1b-a419-03af0897060a admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:02.738971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd5c54-f713-4e12-9b84-cd9509f88187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:02.739652 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd5c54-f713-4e12-9b84-cd9509f88187 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:02.739920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd5c54-f713-4e12-9b84-cd9509f88187 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:02.740196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd5c54-f713-4e12-9b84-cd9509f88187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:02.742045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2efd5c54-f713-4e12-9b84-cd9509f88187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:02.808558 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd5c54-f713-4e12-9b84-cd9509f88187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:02.810081 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd5c54-f713-4e12-9b84-cd9509f88187 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:02.821324 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1251/2480] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:05.391735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:05.985177 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:05.986685 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:06.054082 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd5c54-f713-4e12-9b84-cd9509f88187 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:06.055592 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2efd5c54-f713-4e12-9b84-cd9509f88187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:06.070809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd5c54-f713-4e12-9b84-cd9509f88187 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:06.075607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2b925-6ec2-4785-b6fb-086845e48316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:06.076255 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2b925-6ec2-4785-b6fb-086845e48316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:06.076511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2b925-6ec2-4785-b6fb-086845e48316 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:06.076917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2b925-6ec2-4785-b6fb-086845e48316 admin admin] PATH_INFO: `/v3/users/329a85e5f5e9446c80dc45cafd329108` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:06.078648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2b925-6ec2-4785-b6fb-086845e48316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=329a85e5f5e9446c80dc45cafd329108)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:06.079989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e8b7b-1806-4538-bfba-3f48df7c39f0 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:06.080716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2b925-6ec2-4785-b6fb-086845e48316 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:06.085435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4b010-95eb-4788-92c8-ddf5943b2b92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:06.086135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4b010-95eb-4788-92c8-ddf5943b2b92 service placement] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:06.086427 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4b010-95eb-4788-92c8-ddf5943b2b92 service placement] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:06.086704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4b010-95eb-4788-92c8-ddf5943b2b92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:06.088633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-69b4b010-95eb-4788-92c8-ddf5943b2b92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:06.101121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4b010-95eb-4788-92c8-ddf5943b2b92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:06.102821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4b010-95eb-4788-92c8-ddf5943b2b92 service placement] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:06.115748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1230/2481] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:06.135900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:06.142768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-daa2b925-6ec2-4785-b6fb-086845e48316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '329a85e5f5e9446c80dc45cafd329108'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:06.151535 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-daa2b925-6ec2-4785-b6fb-086845e48316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '329a85e5f5e9446c80dc45cafd329108'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:06.158920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-daa2b925-6ec2-4785-b6fb-086845e48316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '329a85e5f5e9446c80dc45cafd329108'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:06.159625 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-daa2b925-6ec2-4785-b6fb-086845e48316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '329a85e5f5e9446c80dc45cafd329108'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:06.160234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-daa2b925-6ec2-4785-b6fb-086845e48316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '329a85e5f5e9446c80dc45cafd329108'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:06.181687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1252/2482] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:06 2022] DELETE /identity/v3/users/329a85e5f5e9446c80dc45cafd329108 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:03:06.365802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4b010-95eb-4788-92c8-ddf5943b2b92 service placement] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:06.377054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4b010-95eb-4788-92c8-ddf5943b2b92 service placement] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:06.449640 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:06.450387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:06.450655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:06.450892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] PATH_INFO: `/v3/projects/0e436c6c21474648a2c116e96cb303b0` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:06.452371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e436c6c21474648a2c116e96cb303b0)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:06.454369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:06.507294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e436c6c21474648a2c116e96cb303b0', 'request_id': 'req-c51217f1-ecef-4b96-94d9-c09a05f398a8'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:06.515047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e436c6c21474648a2c116e96cb303b0', 'request_id': 'req-c51217f1-ecef-4b96-94d9-c09a05f398a8'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:06.521760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e436c6c21474648a2c116e96cb303b0', 'request_id': 'req-c51217f1-ecef-4b96-94d9-c09a05f398a8'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:06.536937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] The token cache is being invalidate because project 0e436c6c21474648a2c116e96cb303b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:06.537193 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:06.537876 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-c51217f1-ecef-4b96-94d9-c09a05f398a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:06.539612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1231/2483] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:06 2022] DELETE /identity/v3/projects/0e436c6c21474648a2c116e96cb303b0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:06.545694 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9580d7f-8f1a-49de-b6cc-0e8375454319 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:06.546150 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9580d7f-8f1a-49de-b6cc-0e8375454319 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:06.546547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9580d7f-8f1a-49de-b6cc-0e8375454319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:06.614309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-f9580d7f-8f1a-49de-b6cc-0e8375454319 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:06.615639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f9580d7f-8f1a-49de-b6cc-0e8375454319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:06.678810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1253/2484] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:06.691066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746e21f-28cf-4da7-93a9-84a604e139d1 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:06.691431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746e21f-28cf-4da7-93a9-84a604e139d1 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:06.691785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746e21f-28cf-4da7-93a9-84a604e139d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:06.719345 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d746e21f-28cf-4da7-93a9-84a604e139d1 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:06.721009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d746e21f-28cf-4da7-93a9-84a604e139d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:06.731117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1232/2485] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:06.736333 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9580d7f-8f1a-49de-b6cc-0e8375454319 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:06.749515 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9580d7f-8f1a-49de-b6cc-0e8375454319 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:06.755290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799416e-ed4c-4bfd-9dcf-c66eedd3c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:06.755926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799416e-ed4c-4bfd-9dcf-c66eedd3c34a admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:06.756206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799416e-ed4c-4bfd-9dcf-c66eedd3c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:06.756475 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799416e-ed4c-4bfd-9dcf-c66eedd3c34a admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:06.757179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799416e-ed4c-4bfd-9dcf-c66eedd3c34a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:06.757482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799416e-ed4c-4bfd-9dcf-c66eedd3c34a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:06.759136 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799416e-ed4c-4bfd-9dcf-c66eedd3c34a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:06.772025 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1254/2486] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:06.777608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746e21f-28cf-4da7-93a9-84a604e139d1 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:06.788214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746e21f-28cf-4da7-93a9-84a604e139d1 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:06.794237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e0e25-c321-4575-a2fa-5a4166a90bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:06.794847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e0e25-c321-4575-a2fa-5a4166a90bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:06.795151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e0e25-c321-4575-a2fa-5a4166a90bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:06.795420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e0e25-c321-4575-a2fa-5a4166a90bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:06.796349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e0e25-c321-4575-a2fa-5a4166a90bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:06.798279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e0e25-c321-4575-a2fa-5a4166a90bd9 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:06.810514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:06.830806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1233/2487] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:06 2022] POST /identity/v3/projects => generated 380 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:06.835904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799416e-ed4c-4bfd-9dcf-c66eedd3c34a admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:06.847380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799416e-ed4c-4bfd-9dcf-c66eedd3c34a admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:06.929485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd6799-3340-480f-b325-9a58d6a2cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:06.930131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd6799-3340-480f-b325-9a58d6a2cfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:06.930417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd6799-3340-480f-b325-9a58d6a2cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:06.930698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd6799-3340-480f-b325-9a58d6a2cfe5 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:06.931468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd6799-3340-480f-b325-9a58d6a2cfe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:06.933434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd6799-3340-480f-b325-9a58d6a2cfe5 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:06.958104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1255/2488] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:06 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:06.962524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e0e25-c321-4575-a2fa-5a4166a90bd9 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:06.974503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e0e25-c321-4575-a2fa-5a4166a90bd9 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:06.979731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd17b7-16b8-4a55-b0bf-adfd71a7924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:06.980364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd17b7-16b8-4a55-b0bf-adfd71a7924a admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:06.980665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd17b7-16b8-4a55-b0bf-adfd71a7924a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:06.980909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd17b7-16b8-4a55-b0bf-adfd71a7924a admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:06.981634 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd17b7-16b8-4a55-b0bf-adfd71a7924a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:06.983349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd17b7-16b8-4a55-b0bf-adfd71a7924a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:06.994108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1234/2489] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:06 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:06.998644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd6799-3340-480f-b325-9a58d6a2cfe5 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:07.005736 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:07.009912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd6799-3340-480f-b325-9a58d6a2cfe5 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:07.017369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9644e0-802a-43fd-97d1-3ab457e0e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:07.018139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9644e0-802a-43fd-97d1-3ab457e0e8dc admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:07.018684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9644e0-802a-43fd-97d1-3ab457e0e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:07.019006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9644e0-802a-43fd-97d1-3ab457e0e8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:07.019746 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9644e0-802a-43fd-97d1-3ab457e0e8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:07.021421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9644e0-802a-43fd-97d1-3ab457e0e8dc admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:07.035934 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1256/2490] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:06 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:07.041542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd17b7-16b8-4a55-b0bf-adfd71a7924a admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:07.054480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd17b7-16b8-4a55-b0bf-adfd71a7924a admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:07.059996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe9f82-d580-49b6-aa96-ddaf6f50ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:07.060679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe9f82-d580-49b6-aa96-ddaf6f50ce65 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:07.060961 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe9f82-d580-49b6-aa96-ddaf6f50ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:07.061238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe9f82-d580-49b6-aa96-ddaf6f50ce65 admin admin] PATH_INFO: `/v3/projects/a221254b617b41fb80d1bd08fc5df626/users/94c5d846ac134f14a9315aa388e05cb1/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:07.080465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe9f82-d580-49b6-aa96-ddaf6f50ce65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a221254b617b41fb80d1bd08fc5df626, user_id=94c5d846ac134f14a9315aa388e05cb1, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:07.083244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe9f82-d580-49b6-aa96-ddaf6f50ce65 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:07.098762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1235/2491] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:07 2022] PUT /identity/v3/projects/a221254b617b41fb80d1bd08fc5df626/users/94c5d846ac134f14a9315aa388e05cb1/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:07.110459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627a5b-f897-4c6b-a3a0-07b3c6810cac None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:07.111803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627a5b-f897-4c6b-a3a0-07b3c6810cac None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:07.111803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627a5b-f897-4c6b-a3a0-07b3c6810cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:07.142627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-78627a5b-f897-4c6b-a3a0-07b3c6810cac None None] MFA Rules not processed for user `94c5d846ac134f14a9315aa388e05cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:07.143984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-78627a5b-f897-4c6b-a3a0-07b3c6810cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:07.227083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1257/2492] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:07.234586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe9f82-d580-49b6-aa96-ddaf6f50ce65 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:07.301805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe9f82-d580-49b6-aa96-ddaf6f50ce65 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:07.306576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6790bd9-2496-4bd7-8a79-7ff3adbccdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:07.307220 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6790bd9-2496-4bd7-8a79-7ff3adbccdd3 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:07.307501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6790bd9-2496-4bd7-8a79-7ff3adbccdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:07.307774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6790bd9-2496-4bd7-8a79-7ff3adbccdd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:07.308447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6790bd9-2496-4bd7-8a79-7ff3adbccdd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:07.310387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6790bd9-2496-4bd7-8a79-7ff3adbccdd3 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:07.341605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1236/2493] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:07 2022] POST /identity/v3/projects => generated 382 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:07.346368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78627a5b-f897-4c6b-a3a0-07b3c6810cac None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:07.360309 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78627a5b-f897-4c6b-a3a0-07b3c6810cac None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:07.431451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe1cf1-69bd-4371-91de-06f13d2757cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:07.432263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe1cf1-69bd-4371-91de-06f13d2757cd admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:07.432545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe1cf1-69bd-4371-91de-06f13d2757cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:07.432964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe1cf1-69bd-4371-91de-06f13d2757cd admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:07.433939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe1cf1-69bd-4371-91de-06f13d2757cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:07.436294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe1cf1-69bd-4371-91de-06f13d2757cd admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:07.460956 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1258/2494] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:07 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:07.465295 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6790bd9-2496-4bd7-8a79-7ff3adbccdd3 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:07.476442 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6790bd9-2496-4bd7-8a79-7ff3adbccdd3 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:07.481207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb623d95-7bca-4400-87bd-17a64508995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:07.481857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb623d95-7bca-4400-87bd-17a64508995c admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:07.482138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb623d95-7bca-4400-87bd-17a64508995c admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:07.482410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb623d95-7bca-4400-87bd-17a64508995c admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:07.483142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb623d95-7bca-4400-87bd-17a64508995c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:07.484904 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb623d95-7bca-4400-87bd-17a64508995c admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:07.496454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1237/2495] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:07 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:07.500724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe1cf1-69bd-4371-91de-06f13d2757cd admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:07.511592 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe1cf1-69bd-4371-91de-06f13d2757cd admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:07.517049 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f6e1a-d9b2-43ed-ae76-0ff00ea6a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:07.517724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f6e1a-d9b2-43ed-ae76-0ff00ea6a2f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:07.518004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f6e1a-d9b2-43ed-ae76-0ff00ea6a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:07.518289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f6e1a-d9b2-43ed-ae76-0ff00ea6a2f9 admin admin] PATH_INFO: `/v3/projects/cf3fee294a5c45b18dcc6a146d96b66c/users/54ab8ec0ae124aabaab62627623ddd34/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:07.535325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f6e1a-d9b2-43ed-ae76-0ff00ea6a2f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3fee294a5c45b18dcc6a146d96b66c, user_id=54ab8ec0ae124aabaab62627623ddd34, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:07.538033 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f6e1a-d9b2-43ed-ae76-0ff00ea6a2f9 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:07.553817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1259/2496] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:07 2022] PUT /identity/v3/projects/cf3fee294a5c45b18dcc6a146d96b66c/users/54ab8ec0ae124aabaab62627623ddd34/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:07.558895 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb623d95-7bca-4400-87bd-17a64508995c admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:07.571311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb623d95-7bca-4400-87bd-17a64508995c admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:07.633226 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a40e2-738b-4308-83d9-2455cff4d838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:07.633852 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a40e2-738b-4308-83d9-2455cff4d838 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:07.634135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a40e2-738b-4308-83d9-2455cff4d838 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:07.634414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a40e2-738b-4308-83d9-2455cff4d838 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:07.635145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a40e2-738b-4308-83d9-2455cff4d838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:07.636789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a40e2-738b-4308-83d9-2455cff4d838 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:07.647703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1238/2497] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:07 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:07.654010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f6e1a-d9b2-43ed-ae76-0ff00ea6a2f9 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:07.670628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f6e1a-d9b2-43ed-ae76-0ff00ea6a2f9 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:07.677487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfcfcc-dadd-4e76-8afa-aab9a07d7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:07.678262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfcfcc-dadd-4e76-8afa-aab9a07d7583 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:07.678594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfcfcc-dadd-4e76-8afa-aab9a07d7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:07.678878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfcfcc-dadd-4e76-8afa-aab9a07d7583 admin admin] PATH_INFO: `/v3/projects/cf3fee294a5c45b18dcc6a146d96b66c/users/54ab8ec0ae124aabaab62627623ddd34/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:07.681254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfcfcc-dadd-4e76-8afa-aab9a07d7583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3fee294a5c45b18dcc6a146d96b66c, user_id=54ab8ec0ae124aabaab62627623ddd34, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:07.684262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfcfcc-dadd-4e76-8afa-aab9a07d7583 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:07.697784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1260/2498] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:07 2022] PUT /identity/v3/projects/cf3fee294a5c45b18dcc6a146d96b66c/users/54ab8ec0ae124aabaab62627623ddd34/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:07.711404 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432f5b-4523-4887-af5c-ad63567fa503 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:07.711688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432f5b-4523-4887-af5c-ad63567fa503 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:07.711979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432f5b-4523-4887-af5c-ad63567fa503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:07.744845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b1432f5b-4523-4887-af5c-ad63567fa503 None None] MFA Rules not processed for user `54ab8ec0ae124aabaab62627623ddd34`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:07.746399 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b1432f5b-4523-4887-af5c-ad63567fa503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:07.765588 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:07.833822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1239/2499] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:07.845359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfcfcc-dadd-4e76-8afa-aab9a07d7583 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:07.847435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b6bfcfcc-dadd-4e76-8afa-aab9a07d7583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:07.892941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:07.943705 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfcfcc-dadd-4e76-8afa-aab9a07d7583 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:07.948051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d11e8-7d39-42ff-a27e-6e182080b610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:07.948676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d11e8-7d39-42ff-a27e-6e182080b610 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:07.948962 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d11e8-7d39-42ff-a27e-6e182080b610 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:07.949233 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d11e8-7d39-42ff-a27e-6e182080b610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:07.959499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d11e8-7d39-42ff-a27e-6e182080b610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:07.960938 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d11e8-7d39-42ff-a27e-6e182080b610 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:07.971670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1261/2500] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:08.051445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1432f5b-4523-4887-af5c-ad63567fa503 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:08.053016 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b1432f5b-4523-4887-af5c-ad63567fa503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:08.066337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1432f5b-4523-4887-af5c-ad63567fa503 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:08.070303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b97b5-2ca1-47da-9ce8-4b6310a495c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:08.071044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b97b5-2ca1-47da-9ce8-4b6310a495c1 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:08.071236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b97b5-2ca1-47da-9ce8-4b6310a495c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:08.071495 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b97b5-2ca1-47da-9ce8-4b6310a495c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:08.132445 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b97b5-2ca1-47da-9ce8-4b6310a495c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:08.133911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b97b5-2ca1-47da-9ce8-4b6310a495c1 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:08.144182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1240/2501] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:15.297945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d11e8-7d39-42ff-a27e-6e182080b610 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:15.362815 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d11e8-7d39-42ff-a27e-6e182080b610 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:15.367708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6879e-383d-4866-9d6a-244d9e5e1a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:15.368363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6879e-383d-4866-9d6a-244d9e5e1a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:15.368640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6879e-383d-4866-9d6a-244d9e5e1a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:15.368909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6879e-383d-4866-9d6a-244d9e5e1a68 admin admin] PATH_INFO: `/v3/users/94c5d846ac134f14a9315aa388e05cb1` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:15.370126 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6879e-383d-4866-9d6a-244d9e5e1a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c5d846ac134f14a9315aa388e05cb1)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:15.372108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6879e-383d-4866-9d6a-244d9e5e1a68 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:15.432979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3ee6879e-383d-4866-9d6a-244d9e5e1a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c5d846ac134f14a9315aa388e05cb1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:15.442842 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3ee6879e-383d-4866-9d6a-244d9e5e1a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c5d846ac134f14a9315aa388e05cb1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:15.451229 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3ee6879e-383d-4866-9d6a-244d9e5e1a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c5d846ac134f14a9315aa388e05cb1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:15.451739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3ee6879e-383d-4866-9d6a-244d9e5e1a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c5d846ac134f14a9315aa388e05cb1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:15.452367 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3ee6879e-383d-4866-9d6a-244d9e5e1a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c5d846ac134f14a9315aa388e05cb1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:15.473955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1262/2502] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:15 2022] DELETE /identity/v3/users/94c5d846ac134f14a9315aa388e05cb1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:15.475305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b97b5-2ca1-47da-9ce8-4b6310a495c1 service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:15.476959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-c56b97b5-2ca1-47da-9ce8-4b6310a495c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:15.478467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd129a-f713-4bf3-8199-273c6ef4f4de None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:15.478763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd129a-f713-4bf3-8199-273c6ef4f4de None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:15.479071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd129a-f713-4bf3-8199-273c6ef4f4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:15.499163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-dfbd129a-f713-4bf3-8199-273c6ef4f4de None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:15.500641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-dfbd129a-f713-4bf3-8199-273c6ef4f4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:15.538731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:15.549629 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b97b5-2ca1-47da-9ce8-4b6310a495c1 service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:15.573421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1263/2503] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:15.584068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd129a-f713-4bf3-8199-273c6ef4f4de None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:15.585635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-dfbd129a-f713-4bf3-8199-273c6ef4f4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:15.604301 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbf237-1d99-4517-ad1d-0190e01678e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:15.604990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf237-1d99-4517-ad1d-0190e01678e1 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:15.605271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf237-1d99-4517-ad1d-0190e01678e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:15.605547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf237-1d99-4517-ad1d-0190e01678e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:15.607473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a5fbf237-1d99-4517-ad1d-0190e01678e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:15.620624 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbf237-1d99-4517-ad1d-0190e01678e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:15.622041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbf237-1d99-4517-ad1d-0190e01678e1 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:15.632872 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1241/2504] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:15.653143 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd129a-f713-4bf3-8199-273c6ef4f4de None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:15.656917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2090c19-0028-4a28-81b1-d5aa098bd02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:15.657646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2090c19-0028-4a28-81b1-d5aa098bd02e service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:15.657861 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2090c19-0028-4a28-81b1-d5aa098bd02e service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:15.658133 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2090c19-0028-4a28-81b1-d5aa098bd02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:15.668495 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2090c19-0028-4a28-81b1-d5aa098bd02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:15.669967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2090c19-0028-4a28-81b1-d5aa098bd02e service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:15.682280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1264/2505] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:16.218662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbf237-1d99-4517-ad1d-0190e01678e1 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:16.220767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a5fbf237-1d99-4517-ad1d-0190e01678e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:16.253573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbf237-1d99-4517-ad1d-0190e01678e1 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:16.259409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:16.260683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:16.260683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:16.260683 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] PATH_INFO: `/v3/projects/a221254b617b41fb80d1bd08fc5df626` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:16.262415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a221254b617b41fb80d1bd08fc5df626)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:16.265063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:16.268614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=100 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:16.328083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a221254b617b41fb80d1bd08fc5df626', 'request_id': 'req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:16.334971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a221254b617b41fb80d1bd08fc5df626', 'request_id': 'req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:16.341744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a221254b617b41fb80d1bd08fc5df626', 'request_id': 'req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:16.357074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] The token cache is being invalidate because project a221254b617b41fb80d1bd08fc5df626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:16.357368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:16.358406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:16.360236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1242/2506] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:16 2022] DELETE /identity/v3/projects/a221254b617b41fb80d1bd08fc5df626 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:16.364580 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2090c19-0028-4a28-81b1-d5aa098bd02e service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:16.376454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2090c19-0028-4a28-81b1-d5aa098bd02e service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:16.437396 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd4955-52c3-4c36-8c4b-0fb059052d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:16.438050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd4955-52c3-4c36-8c4b-0fb059052d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:16.438326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd4955-52c3-4c36-8c4b-0fb059052d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:16.438600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd4955-52c3-4c36-8c4b-0fb059052d19 admin admin] PATH_INFO: `/v3/users/54ab8ec0ae124aabaab62627623ddd34` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:16.439914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd4955-52c3-4c36-8c4b-0fb059052d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ab8ec0ae124aabaab62627623ddd34)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:16.441851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd4955-52c3-4c36-8c4b-0fb059052d19 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:16.498149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dafd4955-52c3-4c36-8c4b-0fb059052d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ab8ec0ae124aabaab62627623ddd34'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:16.508878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dafd4955-52c3-4c36-8c4b-0fb059052d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ab8ec0ae124aabaab62627623ddd34'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:16.517051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dafd4955-52c3-4c36-8c4b-0fb059052d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ab8ec0ae124aabaab62627623ddd34'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:16.517831 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dafd4955-52c3-4c36-8c4b-0fb059052d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ab8ec0ae124aabaab62627623ddd34'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:16.518537 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-dafd4955-52c3-4c36-8c4b-0fb059052d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ab8ec0ae124aabaab62627623ddd34'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:16.533720 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:16.539396 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1265/2507] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:16 2022] DELETE /identity/v3/users/54ab8ec0ae124aabaab62627623ddd34 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:03:16.845920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:16.847603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:16.867872 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc126d2e-4ad3-4f23-91f4-26e1e510b7e1 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:16.944811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:16.945471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:16.946152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:16.946152 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] PATH_INFO: `/v3/projects/cf3fee294a5c45b18dcc6a146d96b66c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:16.947213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3fee294a5c45b18dcc6a146d96b66c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:16.949162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:17.011773 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3fee294a5c45b18dcc6a146d96b66c', 'request_id': 'req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:17.018583 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3fee294a5c45b18dcc6a146d96b66c', 'request_id': 'req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:17.024211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3fee294a5c45b18dcc6a146d96b66c', 'request_id': 'req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:17.040391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] The token cache is being invalidate because project cf3fee294a5c45b18dcc6a146d96b66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:17.040822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:17.041564 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-acbe45a7-0ebb-4f69-bb62-e4f7fa856004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:17.043505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1243/2508] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:16 2022] DELETE /identity/v3/projects/cf3fee294a5c45b18dcc6a146d96b66c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:17.048793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb3ca8-3c60-44ee-b5a0-c74afdf20820 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.049017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb3ca8-3c60-44ee-b5a0-c74afdf20820 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.049300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb3ca8-3c60-44ee-b5a0-c74afdf20820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.070326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a6fb3ca8-3c60-44ee-b5a0-c74afdf20820 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:17.071638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a6fb3ca8-3c60-44ee-b5a0-c74afdf20820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:17.136575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1266/2509] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:17.144907 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ea8c-4b5b-4f59-b92e-1076839224b3 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.145193 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ea8c-4b5b-4f59-b92e-1076839224b3 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.145469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ea8c-4b5b-4f59-b92e-1076839224b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.165480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-9580ea8c-4b5b-4f59-b92e-1076839224b3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:17.166706 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9580ea8c-4b5b-4f59-b92e-1076839224b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:17.175669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1244/2510] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:17.180018 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb3ca8-3c60-44ee-b5a0-c74afdf20820 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:17.189878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb3ca8-3c60-44ee-b5a0-c74afdf20820 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:17.195632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8118bb-bf23-4850-a690-495cde1bbd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:17.196405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8118bb-bf23-4850-a690-495cde1bbd9e admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.196695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8118bb-bf23-4850-a690-495cde1bbd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.196969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8118bb-bf23-4850-a690-495cde1bbd9e admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.197785 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8118bb-bf23-4850-a690-495cde1bbd9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:17.198093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8118bb-bf23-4850-a690-495cde1bbd9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:17.199844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8118bb-bf23-4850-a690-495cde1bbd9e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:17.212893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1267/2511] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:17.217313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580ea8c-4b5b-4f59-b92e-1076839224b3 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:17.226873 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580ea8c-4b5b-4f59-b92e-1076839224b3 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:17.231784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c4b8f-ff63-4956-8cc6-279acca47d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:17.232414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4b8f-ff63-4956-8cc6-279acca47d09 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.232692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4b8f-ff63-4956-8cc6-279acca47d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.232964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4b8f-ff63-4956-8cc6-279acca47d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.233777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c4b8f-ff63-4956-8cc6-279acca47d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:17.235718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c4b8f-ff63-4956-8cc6-279acca47d09 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:17.252327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:17.271015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1245/2512] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:17 2022] POST /identity/v3/projects => generated 364 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:17.272209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8118bb-bf23-4850-a690-495cde1bbd9e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:17.283544 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8118bb-bf23-4850-a690-495cde1bbd9e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:17.348258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f73e3a-0742-4017-b3b6-f0d0a734c026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:17.348890 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f73e3a-0742-4017-b3b6-f0d0a734c026 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.349413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f73e3a-0742-4017-b3b6-f0d0a734c026 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.349692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f73e3a-0742-4017-b3b6-f0d0a734c026 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.350364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f73e3a-0742-4017-b3b6-f0d0a734c026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:17.352427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f73e3a-0742-4017-b3b6-f0d0a734c026 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:17.385837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1268/2513] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:17 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:17.387944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c4b8f-ff63-4956-8cc6-279acca47d09 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:17.399959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c4b8f-ff63-4956-8cc6-279acca47d09 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:17.406996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb65db-178d-4d56-a4a8-74169bdc2c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:17.407661 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb65db-178d-4d56-a4a8-74169bdc2c56 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.407942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb65db-178d-4d56-a4a8-74169bdc2c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.408655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb65db-178d-4d56-a4a8-74169bdc2c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.408940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb65db-178d-4d56-a4a8-74169bdc2c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:17.410558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb65db-178d-4d56-a4a8-74169bdc2c56 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:17.422876 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1246/2514] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:17 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:17.427238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f73e3a-0742-4017-b3b6-f0d0a734c026 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:17.439528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f73e3a-0742-4017-b3b6-f0d0a734c026 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:17.445124 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236341f-bcbc-4d53-ae2d-6452afcdff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:17.445984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236341f-bcbc-4d53-ae2d-6452afcdff50 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.446356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236341f-bcbc-4d53-ae2d-6452afcdff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.446808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236341f-bcbc-4d53-ae2d-6452afcdff50 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.447679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236341f-bcbc-4d53-ae2d-6452afcdff50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:17.449385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236341f-bcbc-4d53-ae2d-6452afcdff50 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:17.466469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1269/2515] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:17 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:17.468311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb65db-178d-4d56-a4a8-74169bdc2c56 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:17.480458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb65db-178d-4d56-a4a8-74169bdc2c56 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:17.485978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4c707-7e6a-409e-a5fe-a4257b49bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:17.486978 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4c707-7e6a-409e-a5fe-a4257b49bf31 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.487362 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4c707-7e6a-409e-a5fe-a4257b49bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.487670 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4c707-7e6a-409e-a5fe-a4257b49bf31 admin admin] PATH_INFO: `/v3/projects/762dc8b787ac4a48b8d5c672a4002c7e/users/eb33c75a0f104c6c87c8fbe111eace4f/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.506245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4c707-7e6a-409e-a5fe-a4257b49bf31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762dc8b787ac4a48b8d5c672a4002c7e, user_id=eb33c75a0f104c6c87c8fbe111eace4f, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:17.509263 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4c707-7e6a-409e-a5fe-a4257b49bf31 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:17.534237 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1247/2516] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:17 2022] PUT /identity/v3/projects/762dc8b787ac4a48b8d5c672a4002c7e/users/eb33c75a0f104c6c87c8fbe111eace4f/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:17.536737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce3217-8de5-4e19-8888-a1617ad4a484 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.537052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce3217-8de5-4e19-8888-a1617ad4a484 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.537329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce3217-8de5-4e19-8888-a1617ad4a484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.574682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-09ce3217-8de5-4e19-8888-a1617ad4a484 None None] MFA Rules not processed for user `eb33c75a0f104c6c87c8fbe111eace4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:17.576149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-09ce3217-8de5-4e19-8888-a1617ad4a484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:17.637201 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:17.648552 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1270/2517] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:17.652637 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4c707-7e6a-409e-a5fe-a4257b49bf31 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:17.724966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4c707-7e6a-409e-a5fe-a4257b49bf31 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:17.731033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7acc9c-6ae6-4c57-b776-e15a9af9e6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:17.732027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7acc9c-6ae6-4c57-b776-e15a9af9e6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.732328 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7acc9c-6ae6-4c57-b776-e15a9af9e6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.732583 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7acc9c-6ae6-4c57-b776-e15a9af9e6c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.733243 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7acc9c-6ae6-4c57-b776-e15a9af9e6c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:17.735967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7acc9c-6ae6-4c57-b776-e15a9af9e6c1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:17.767878 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1248/2518] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:17 2022] POST /identity/v3/projects => generated 366 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:17.772079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce3217-8de5-4e19-8888-a1617ad4a484 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:17.785175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce3217-8de5-4e19-8888-a1617ad4a484 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:17.853294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c250a4e-f477-4d59-a8da-3cde95699b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:17.854550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c250a4e-f477-4d59-a8da-3cde95699b77 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.854930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c250a4e-f477-4d59-a8da-3cde95699b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.855360 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c250a4e-f477-4d59-a8da-3cde95699b77 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.856131 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c250a4e-f477-4d59-a8da-3cde95699b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:17.859012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c250a4e-f477-4d59-a8da-3cde95699b77 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:17.889472 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7acc9c-6ae6-4c57-b776-e15a9af9e6c1 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:17.890070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1271/2519] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:17 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:17.901185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7acc9c-6ae6-4c57-b776-e15a9af9e6c1 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:17.907835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3adf2-49eb-4275-b687-f8145e6cad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:17.908541 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3adf2-49eb-4275-b687-f8145e6cad89 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.908835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3adf2-49eb-4275-b687-f8145e6cad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.909110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3adf2-49eb-4275-b687-f8145e6cad89 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.910205 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3adf2-49eb-4275-b687-f8145e6cad89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:17.911613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3adf2-49eb-4275-b687-f8145e6cad89 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:17.925147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1249/2520] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:17 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:17.929554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c250a4e-f477-4d59-a8da-3cde95699b77 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:17.943972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c250a4e-f477-4d59-a8da-3cde95699b77 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:17.960075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de287be-52e0-411d-ad16-b29af224a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:17.960794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de287be-52e0-411d-ad16-b29af224a419 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:17.961080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de287be-52e0-411d-ad16-b29af224a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:17.961359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de287be-52e0-411d-ad16-b29af224a419 admin admin] PATH_INFO: `/v3/projects/3563187526dc4a38b84d5e662134d4a6/users/fba7ec8bda1b4a3aa05df7651fc064fd/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:17.978024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de287be-52e0-411d-ad16-b29af224a419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3563187526dc4a38b84d5e662134d4a6, user_id=fba7ec8bda1b4a3aa05df7651fc064fd, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:17.980745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de287be-52e0-411d-ad16-b29af224a419 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:17.999086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1272/2521] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:17 2022] PUT /identity/v3/projects/3563187526dc4a38b84d5e662134d4a6/users/fba7ec8bda1b4a3aa05df7651fc064fd/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:18.003558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3adf2-49eb-4275-b687-f8145e6cad89 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:18.016440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3adf2-49eb-4275-b687-f8145e6cad89 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:18.085207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3d971-b7a3-4a6a-a076-a6efdf123ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:18.085840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3d971-b7a3-4a6a-a076-a6efdf123ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:18.086126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3d971-b7a3-4a6a-a076-a6efdf123ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:18.086383 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3d971-b7a3-4a6a-a076-a6efdf123ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:18.087123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3d971-b7a3-4a6a-a076-a6efdf123ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:18.088861 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3d971-b7a3-4a6a-a076-a6efdf123ee5 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:18.100575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1250/2522] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:18 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:18.104942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de287be-52e0-411d-ad16-b29af224a419 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:18.127776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de287be-52e0-411d-ad16-b29af224a419 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:18.132808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc453c5-e9c7-4ca1-a4a7-e09618f5f68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:18.133669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc453c5-e9c7-4ca1-a4a7-e09618f5f68d admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:18.134086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc453c5-e9c7-4ca1-a4a7-e09618f5f68d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:18.134421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc453c5-e9c7-4ca1-a4a7-e09618f5f68d admin admin] PATH_INFO: `/v3/projects/3563187526dc4a38b84d5e662134d4a6/users/fba7ec8bda1b4a3aa05df7651fc064fd/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:18.136527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc453c5-e9c7-4ca1-a4a7-e09618f5f68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3563187526dc4a38b84d5e662134d4a6, user_id=fba7ec8bda1b4a3aa05df7651fc064fd, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:18.142067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc453c5-e9c7-4ca1-a4a7-e09618f5f68d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:18.159455 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1273/2523] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:18 2022] PUT /identity/v3/projects/3563187526dc4a38b84d5e662134d4a6/users/fba7ec8bda1b4a3aa05df7651fc064fd/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:18.172481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7474ca-4ca1-4f62-86ca-bcd2200ab595 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:18.172887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7474ca-4ca1-4f62-86ca-bcd2200ab595 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:18.173280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7474ca-4ca1-4f62-86ca-bcd2200ab595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:18.204592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-0c7474ca-4ca1-4f62-86ca-bcd2200ab595 None None] MFA Rules not processed for user `fba7ec8bda1b4a3aa05df7651fc064fd`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:18.205842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0c7474ca-4ca1-4f62-86ca-bcd2200ab595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:18.224542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:18.283944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1251/2524] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:18.297166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc453c5-e9c7-4ca1-a4a7-e09618f5f68d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:18.299138 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7fc453c5-e9c7-4ca1-a4a7-e09618f5f68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:18.363759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc453c5-e9c7-4ca1-a4a7-e09618f5f68d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:18.367813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87127f-3556-4cb1-b02e-18967de3b6b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:18.368460 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87127f-3556-4cb1-b02e-18967de3b6b4 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:18.368741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87127f-3556-4cb1-b02e-18967de3b6b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:18.369014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87127f-3556-4cb1-b02e-18967de3b6b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:18.380357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87127f-3556-4cb1-b02e-18967de3b6b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:18.382220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87127f-3556-4cb1-b02e-18967de3b6b4 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:18.393750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1274/2525] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:18.962611 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7474ca-4ca1-4f62-86ca-bcd2200ab595 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:19.051339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7474ca-4ca1-4f62-86ca-bcd2200ab595 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:19.057679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:19.058411 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:19.058700 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:19.059000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] PATH_INFO: `/v3/users/eb33c75a0f104c6c87c8fbe111eace4f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:19.060463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb33c75a0f104c6c87c8fbe111eace4f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:19.062486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:19.133086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb33c75a0f104c6c87c8fbe111eace4f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.134000 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb33c75a0f104c6c87c8fbe111eace4f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.148498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb33c75a0f104c6c87c8fbe111eace4f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.150359 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb33c75a0f104c6c87c8fbe111eace4f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.160135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb33c75a0f104c6c87c8fbe111eace4f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.177506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1252/2526] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:18 2022] DELETE /identity/v3/users/eb33c75a0f104c6c87c8fbe111eace4f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:19.182203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2775db-3fed-43c8-82dd-f62ae363bf17 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:19.182538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2775db-3fed-43c8-82dd-f62ae363bf17 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:19.185070 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2775db-3fed-43c8-82dd-f62ae363bf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:19.209549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4b2775db-3fed-43c8-82dd-f62ae363bf17 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:19.210976 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4b2775db-3fed-43c8-82dd-f62ae363bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:19.274766 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:19.290698 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1275/2527] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:19.301346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:19.303158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:19.342818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:19.356893 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2775db-3fed-43c8-82dd-f62ae363bf17 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:19.358518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4b2775db-3fed-43c8-82dd-f62ae363bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:19.375689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c12bfb-5085-40b4-a121-87792191782e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:19.379702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570824ff-1583-4239-b127-17f98ec8f871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:19.380433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570824ff-1583-4239-b127-17f98ec8f871 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:19.380783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570824ff-1583-4239-b127-17f98ec8f871 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:19.381130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570824ff-1583-4239-b127-17f98ec8f871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:19.382338 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2775db-3fed-43c8-82dd-f62ae363bf17 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:19.387723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:19.388387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:19.389292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:19.389602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] PATH_INFO: `/v3/users/36ab34b69abc4a8dbe7bb0a40ad768b9` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:19.390978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ab34b69abc4a8dbe7bb0a40ad768b9)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:19.391330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570824ff-1583-4239-b127-17f98ec8f871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:19.392861 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570824ff-1583-4239-b127-17f98ec8f871 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:19.393065 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:19.402730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1253/2528] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:19.444967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ab34b69abc4a8dbe7bb0a40ad768b9'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.454121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ab34b69abc4a8dbe7bb0a40ad768b9'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.462002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ab34b69abc4a8dbe7bb0a40ad768b9'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.463107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ab34b69abc4a8dbe7bb0a40ad768b9'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.463722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ab34b69abc4a8dbe7bb0a40ad768b9'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.482710 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1276/2529] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:19 2022] DELETE /identity/v3/users/36ab34b69abc4a8dbe7bb0a40ad768b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:19.679148 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570824ff-1583-4239-b127-17f98ec8f871 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:19.691991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570824ff-1583-4239-b127-17f98ec8f871 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:19.702052 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:19.703856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:19.765678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:19.766435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:19.766843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:19.767177 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] PATH_INFO: `/v3/projects/bb8be263b24942b79a5144739412c870` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:19.768542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb8be263b24942b79a5144739412c870)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:19.770469 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:19.779688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4ba39-06b5-4025-bcaf-fc83335c2f66 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:19.784560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:19.785528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:19.785810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:19.786086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] PATH_INFO: `/v3/projects/762dc8b787ac4a48b8d5c672a4002c7e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:19.787454 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=762dc8b787ac4a48b8d5c672a4002c7e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:19.789456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:19.821330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8be263b24942b79a5144739412c870', 'request_id': 'req-977fd012-28c6-4296-aa5d-0e9672de6f29'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.828157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8be263b24942b79a5144739412c870', 'request_id': 'req-977fd012-28c6-4296-aa5d-0e9672de6f29'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.833954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8be263b24942b79a5144739412c870', 'request_id': 'req-977fd012-28c6-4296-aa5d-0e9672de6f29'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.841818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762dc8b787ac4a48b8d5c672a4002c7e', 'request_id': 'req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.848013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] The token cache is being invalidate because project bb8be263b24942b79a5144739412c870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:19.848212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.848884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-977fd012-28c6-4296-aa5d-0e9672de6f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.849451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762dc8b787ac4a48b8d5c672a4002c7e', 'request_id': 'req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.850484 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1254/2530] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:19 2022] DELETE /identity/v3/projects/bb8be263b24942b79a5144739412c870 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:19.855463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fcce3-b01c-47e2-a8b4-dfbcb8ce222d None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:19.855902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fcce3-b01c-47e2-a8b4-dfbcb8ce222d None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:19.856201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fcce3-b01c-47e2-a8b4-dfbcb8ce222d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:19.858119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762dc8b787ac4a48b8d5c672a4002c7e', 'request_id': 'req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.859678 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:19.873037 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] The token cache is being invalidate because project 762dc8b787ac4a48b8d5c672a4002c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:19.873441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.874602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:19.876559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1277/2531] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:19 2022] DELETE /identity/v3/projects/762dc8b787ac4a48b8d5c672a4002c7e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:19.879568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-0c2fcce3-b01c-47e2-a8b4-dfbcb8ce222d None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:19.880703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:19.880874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0c2fcce3-b01c-47e2-a8b4-dfbcb8ce222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:19.882238 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:19.942011 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1255/2532] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:19.948473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02424-8edb-4f2d-8d2e-7ef1d836be5d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:19.950712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895748a-b499-42ef-9e01-00a6fc1ad566 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:19.951045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895748a-b499-42ef-9e01-00a6fc1ad566 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:19.951323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895748a-b499-42ef-9e01-00a6fc1ad566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:19.953502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:19.954145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:19.954426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:19.954697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] PATH_INFO: `/v3/users/fba7ec8bda1b4a3aa05df7651fc064fd` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:19.955919 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba7ec8bda1b4a3aa05df7651fc064fd)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:19.957867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:19.965785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:19.972464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-8895748a-b499-42ef-9e01-00a6fc1ad566 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:19.974625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8895748a-b499-42ef-9e01-00a6fc1ad566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:19.996825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1256/2533] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:20.002795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895748a-b499-42ef-9e01-00a6fc1ad566 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.013712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895748a-b499-42ef-9e01-00a6fc1ad566 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.019199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6321f-2824-4e5f-b687-847413daacc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.019848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6321f-2824-4e5f-b687-847413daacc2 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.020127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6321f-2824-4e5f-b687-847413daacc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.020395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6321f-2824-4e5f-b687-847413daacc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.021134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6321f-2824-4e5f-b687-847413daacc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:20.021439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6321f-2824-4e5f-b687-847413daacc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.023130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6321f-2824-4e5f-b687-847413daacc2 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.023445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba7ec8bda1b4a3aa05df7651fc064fd'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:20.032188 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba7ec8bda1b4a3aa05df7651fc064fd'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:20.036388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1257/2534] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:03:20.039960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba7ec8bda1b4a3aa05df7651fc064fd'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:20.040683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba7ec8bda1b4a3aa05df7651fc064fd'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:20.040805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6321f-2824-4e5f-b687-847413daacc2 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.041398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba7ec8bda1b4a3aa05df7651fc064fd'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:20.042621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-07b6321f-2824-4e5f-b687-847413daacc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:20.055758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6321f-2824-4e5f-b687-847413daacc2 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.059878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1278/2535] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:19 2022] DELETE /identity/v3/users/fba7ec8bda1b4a3aa05df7651fc064fd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:20.060739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d19d56-14ac-4ea7-a60f-ca59f507e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.061349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d19d56-14ac-4ea7-a60f-ca59f507e660 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.061830 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d19d56-14ac-4ea7-a60f-ca59f507e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.062244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d19d56-14ac-4ea7-a60f-ca59f507e660 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.062979 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d19d56-14ac-4ea7-a60f-ca59f507e660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.064934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d19d56-14ac-4ea7-a60f-ca59f507e660 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.094530 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1258/2536] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:20 2022] POST /identity/v3/projects => generated 364 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:20.099433 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.169156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b519e-e0bb-49bc-8b4d-a3dd9f78f1e3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.187272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:20.229820 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5d22-a0bb-4dbf-a93d-2cbfae2658de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.230474 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5d22-a0bb-4dbf-a93d-2cbfae2658de admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.231185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5d22-a0bb-4dbf-a93d-2cbfae2658de admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.231465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5d22-a0bb-4dbf-a93d-2cbfae2658de admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.232401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5d22-a0bb-4dbf-a93d-2cbfae2658de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.234415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5d22-a0bb-4dbf-a93d-2cbfae2658de admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.257745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1279/2537] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:20 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:20.261797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d19d56-14ac-4ea7-a60f-ca59f507e660 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.272762 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d19d56-14ac-4ea7-a60f-ca59f507e660 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.277646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab11168-12c9-4b5f-9e1f-394383d25198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.278277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab11168-12c9-4b5f-9e1f-394383d25198 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.278555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab11168-12c9-4b5f-9e1f-394383d25198 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.278816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab11168-12c9-4b5f-9e1f-394383d25198 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.279549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab11168-12c9-4b5f-9e1f-394383d25198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.281590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab11168-12c9-4b5f-9e1f-394383d25198 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.292402 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1259/2538] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:20 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:20.296670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5d22-a0bb-4dbf-a93d-2cbfae2658de admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.308035 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5d22-a0bb-4dbf-a93d-2cbfae2658de admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.313583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab0bc4-4606-49b8-97f8-54426b52f9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.314217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab0bc4-4606-49b8-97f8-54426b52f9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.314500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab0bc4-4606-49b8-97f8-54426b52f9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.314774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab0bc4-4606-49b8-97f8-54426b52f9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.315535 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab0bc4-4606-49b8-97f8-54426b52f9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.317178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab0bc4-4606-49b8-97f8-54426b52f9b8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.333113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1280/2539] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:20 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:20.334105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab11168-12c9-4b5f-9e1f-394383d25198 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.345369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab11168-12c9-4b5f-9e1f-394383d25198 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.358251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c3e0b-4fa2-427b-92e6-92ff5bed37d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.359044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c3e0b-4fa2-427b-92e6-92ff5bed37d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.359327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c3e0b-4fa2-427b-92e6-92ff5bed37d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.359694 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c3e0b-4fa2-427b-92e6-92ff5bed37d5 admin admin] PATH_INFO: `/v3/projects/7e18ece9018e4eeda5d93fdcc767c95d/users/0d998c3260ab43bc9119b2c82584f703/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.364845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab0bc4-4606-49b8-97f8-54426b52f9b8 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.367394 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-b3ab0bc4-4606-49b8-97f8-54426b52f9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:20.381012 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab0bc4-4606-49b8-97f8-54426b52f9b8 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.388167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.388610 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c3e0b-4fa2-427b-92e6-92ff5bed37d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e18ece9018e4eeda5d93fdcc767c95d, user_id=0d998c3260ab43bc9119b2c82584f703, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.389794 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.390533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.391090 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] PATH_INFO: `/v3/projects/3563187526dc4a38b84d5e662134d4a6` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.391647 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c3e0b-4fa2-427b-92e6-92ff5bed37d5 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.392765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3563187526dc4a38b84d5e662134d4a6)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.395264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.411120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1260/2540] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:20 2022] PUT /identity/v3/projects/7e18ece9018e4eeda5d93fdcc767c95d/users/0d998c3260ab43bc9119b2c82584f703/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:20.422840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762eb76-b1fb-4f58-a292-895ec60d004e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.423172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762eb76-b1fb-4f58-a292-895ec60d004e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.423588 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762eb76-b1fb-4f58-a292-895ec60d004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.458409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f762eb76-b1fb-4f58-a292-895ec60d004e None None] MFA Rules not processed for user `0d998c3260ab43bc9119b2c82584f703`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:20.459681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f762eb76-b1fb-4f58-a292-895ec60d004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:20.462000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3563187526dc4a38b84d5e662134d4a6', 'request_id': 'req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:20.470769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3563187526dc4a38b84d5e662134d4a6', 'request_id': 'req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:20.477512 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3563187526dc4a38b84d5e662134d4a6', 'request_id': 'req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:20.492801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] The token cache is being invalidate because project 3563187526dc4a38b84d5e662134d4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:20.493182 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:20.493930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-8b5060b5-bbfb-413f-ae6e-4ff295ae378a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:20.496459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1281/2541] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:20 2022] DELETE /identity/v3/projects/3563187526dc4a38b84d5e662134d4a6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:20.501272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d793b97-1ce5-4023-b678-84f21fb246a0 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.501559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d793b97-1ce5-4023-b678-84f21fb246a0 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.501837 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d793b97-1ce5-4023-b678-84f21fb246a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.523275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-0d793b97-1ce5-4023-b678-84f21fb246a0 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:20.524546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0d793b97-1ce5-4023-b678-84f21fb246a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:20.529164 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1261/2542] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:20.533845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762eb76-b1fb-4f58-a292-895ec60d004e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.535214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f762eb76-b1fb-4f58-a292-895ec60d004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:20.588866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1282/2543] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:20.597010 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab630-419b-4254-b99f-3f1d10bb6593 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.597353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab630-419b-4254-b99f-3f1d10bb6593 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.597640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab630-419b-4254-b99f-3f1d10bb6593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.602234 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762eb76-b1fb-4f58-a292-895ec60d004e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.607673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caa924-3e78-4b1c-b01b-d52ffd8a980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.608442 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa924-3e78-4b1c-b01b-d52ffd8a980b admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.608891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa924-3e78-4b1c-b01b-d52ffd8a980b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.609327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa924-3e78-4b1c-b01b-d52ffd8a980b admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.610493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caa924-3e78-4b1c-b01b-d52ffd8a980b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.613150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caa924-3e78-4b1c-b01b-d52ffd8a980b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.617956 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-183ab630-419b-4254-b99f-3f1d10bb6593 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:20.619213 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-183ab630-419b-4254-b99f-3f1d10bb6593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:20.627378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1283/2544] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:20.631957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ab630-419b-4254-b99f-3f1d10bb6593 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.641390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ab630-419b-4254-b99f-3f1d10bb6593 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.644849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1262/2545] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:20 2022] POST /identity/v3/projects => generated 364 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:20.646027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caa924-3e78-4b1c-b01b-d52ffd8a980b admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.651760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:20.657086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:20.706857 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdedc7b-935a-42d4-9d50-4fd7b64d1e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.707821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdedc7b-935a-42d4-9d50-4fd7b64d1e9d admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.708102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdedc7b-935a-42d4-9d50-4fd7b64d1e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.708378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdedc7b-935a-42d4-9d50-4fd7b64d1e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.709092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdedc7b-935a-42d4-9d50-4fd7b64d1e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:20.709400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdedc7b-935a-42d4-9d50-4fd7b64d1e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.709504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caa924-3e78-4b1c-b01b-d52ffd8a980b admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.711119 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdedc7b-935a-42d4-9d50-4fd7b64d1e9d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.714309 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f59dde-1535-4491-9d32-0aa606c255ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.714922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59dde-1535-4491-9d32-0aa606c255ba admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.715242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59dde-1535-4491-9d32-0aa606c255ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.715514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59dde-1535-4491-9d32-0aa606c255ba admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.716186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f59dde-1535-4491-9d32-0aa606c255ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.718218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f59dde-1535-4491-9d32-0aa606c255ba admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.723307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1284/2546] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:03:20.727465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdedc7b-935a-42d4-9d50-4fd7b64d1e9d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.740513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdedc7b-935a-42d4-9d50-4fd7b64d1e9d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.743140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1263/2547] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:20 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:20.746106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5700ad-48ca-4c02-a079-beab41e71a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.746700 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f59dde-1535-4491-9d32-0aa606c255ba admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.746847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5700ad-48ca-4c02-a079-beab41e71a06 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.747028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5700ad-48ca-4c02-a079-beab41e71a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.747300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5700ad-48ca-4c02-a079-beab41e71a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.747975 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5700ad-48ca-4c02-a079-beab41e71a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.750092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5700ad-48ca-4c02-a079-beab41e71a06 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.758570 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f59dde-1535-4491-9d32-0aa606c255ba admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.764086 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b80ea-ff92-45a1-bbfa-e7b730d0153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.765224 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b80ea-ff92-45a1-bbfa-e7b730d0153f admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.765496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b80ea-ff92-45a1-bbfa-e7b730d0153f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.766336 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b80ea-ff92-45a1-bbfa-e7b730d0153f admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.767135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b80ea-ff92-45a1-bbfa-e7b730d0153f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.768822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b80ea-ff92-45a1-bbfa-e7b730d0153f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.780197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1264/2548] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:20 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:20.784764 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b80ea-ff92-45a1-bbfa-e7b730d0153f admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.794151 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1285/2549] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:20 2022] POST /identity/v3/projects => generated 388 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:20.796019 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b80ea-ff92-45a1-bbfa-e7b730d0153f admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.798631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5700ad-48ca-4c02-a079-beab41e71a06 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.857547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43de68-f4a3-472c-8edb-8df03f05792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.858306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de68-f4a3-472c-8edb-8df03f05792d admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.858605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de68-f4a3-472c-8edb-8df03f05792d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.858985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de68-f4a3-472c-8edb-8df03f05792d admin admin] PATH_INFO: `/v3/projects/ca971047fa6942dda087f8eedca9b3be/users/63c981d54b894ea5bd0a6ae8e300ccc5/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.873861 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5700ad-48ca-4c02-a079-beab41e71a06 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.874831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43de68-f4a3-472c-8edb-8df03f05792d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca971047fa6942dda087f8eedca9b3be, user_id=63c981d54b894ea5bd0a6ae8e300ccc5, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.877058 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43de68-f4a3-472c-8edb-8df03f05792d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.879002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ffa7e-857a-4d0e-bf87-b2f8a5ca2059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.879648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ffa7e-857a-4d0e-bf87-b2f8a5ca2059 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.879933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ffa7e-857a-4d0e-bf87-b2f8a5ca2059 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.880220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ffa7e-857a-4d0e-bf87-b2f8a5ca2059 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.880894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ffa7e-857a-4d0e-bf87-b2f8a5ca2059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.883181 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ffa7e-857a-4d0e-bf87-b2f8a5ca2059 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.892345 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1265/2550] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:20 2022] PUT /identity/v3/projects/ca971047fa6942dda087f8eedca9b3be/users/63c981d54b894ea5bd0a6ae8e300ccc5/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:20.896412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43de68-f4a3-472c-8edb-8df03f05792d admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.907536 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1286/2551] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:20 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:20.911737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ffa7e-857a-4d0e-bf87-b2f8a5ca2059 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.922354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ffa7e-857a-4d0e-bf87-b2f8a5ca2059 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.963242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43de68-f4a3-472c-8edb-8df03f05792d admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.968437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42bb3d-d3db-48dc-866c-9d321b69e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.969092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42bb3d-d3db-48dc-866c-9d321b69e321 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.969360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42bb3d-d3db-48dc-866c-9d321b69e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.969639 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42bb3d-d3db-48dc-866c-9d321b69e321 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.970350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42bb3d-d3db-48dc-866c-9d321b69e321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.971995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42bb3d-d3db-48dc-866c-9d321b69e321 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.979988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0b8d5-cf56-40a2-9b9e-ff04d6b076e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:20.980620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0b8d5-cf56-40a2-9b9e-ff04d6b076e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:20.980898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0b8d5-cf56-40a2-9b9e-ff04d6b076e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:20.981170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0b8d5-cf56-40a2-9b9e-ff04d6b076e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:20.981875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0b8d5-cf56-40a2-9b9e-ff04d6b076e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:20.985867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1266/2552] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:20 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:20.986044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0b8d5-cf56-40a2-9b9e-ff04d6b076e8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:20.986976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42bb3d-d3db-48dc-866c-9d321b69e321 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:20.992321 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:20.994496 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1287/2553] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:20 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:20.998330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42bb3d-d3db-48dc-866c-9d321b69e321 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:20.998684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0b8d5-cf56-40a2-9b9e-ff04d6b076e8 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:21.003631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a5fc7-5b0e-403c-a09e-81e38f2a3a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:21.004305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a5fc7-5b0e-403c-a09e-81e38f2a3a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.004586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a5fc7-5b0e-403c-a09e-81e38f2a3a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.005392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a5fc7-5b0e-403c-a09e-81e38f2a3a56 admin admin] PATH_INFO: `/v3/projects/ca971047fa6942dda087f8eedca9b3be/users/63c981d54b894ea5bd0a6ae8e300ccc5/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.006801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a5fc7-5b0e-403c-a09e-81e38f2a3a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca971047fa6942dda087f8eedca9b3be, user_id=63c981d54b894ea5bd0a6ae8e300ccc5, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:21.008703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0b8d5-cf56-40a2-9b9e-ff04d6b076e8 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:21.009480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a5fc7-5b0e-403c-a09e-81e38f2a3a56 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:21.013449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e4c49-a11c-47ce-9fc8-0055c1ea3d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:21.014102 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4c49-a11c-47ce-9fc8-0055c1ea3d04 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.014385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4c49-a11c-47ce-9fc8-0055c1ea3d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.014723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e4c49-a11c-47ce-9fc8-0055c1ea3d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.015501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e4c49-a11c-47ce-9fc8-0055c1ea3d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:21.017270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e4c49-a11c-47ce-9fc8-0055c1ea3d04 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:21.020288 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1267/2554] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:20 2022] PUT /identity/v3/projects/ca971047fa6942dda087f8eedca9b3be/users/63c981d54b894ea5bd0a6ae8e300ccc5/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:03:21.032368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0496552-be4a-46f6-b22f-c88bde646da0 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.032662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0496552-be4a-46f6-b22f-c88bde646da0 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.032955 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0496552-be4a-46f6-b22f-c88bde646da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.036147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1288/2555] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:20 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:21.040288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e4c49-a11c-47ce-9fc8-0055c1ea3d04 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:21.047148 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:21.053266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e4c49-a11c-47ce-9fc8-0055c1ea3d04 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:21.064496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d0496552-be4a-46f6-b22f-c88bde646da0 None None] MFA Rules not processed for user `63c981d54b894ea5bd0a6ae8e300ccc5`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:21.065734 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d0496552-be4a-46f6-b22f-c88bde646da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:21.113019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeaa80-c05d-43ad-928d-dc1c17f9c733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:21.113615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeaa80-c05d-43ad-928d-dc1c17f9c733 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.113898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeaa80-c05d-43ad-928d-dc1c17f9c733 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.114172 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeaa80-c05d-43ad-928d-dc1c17f9c733 admin admin] PATH_INFO: `/v3/projects/4d2d7cae2c664e58a73b18f434c65dda/users/cd6a19c624c644778d07f7c779825180/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.129277 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbeaa80-c05d-43ad-928d-dc1c17f9c733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2d7cae2c664e58a73b18f434c65dda, user_id=cd6a19c624c644778d07f7c779825180, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:21.132098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbeaa80-c05d-43ad-928d-dc1c17f9c733 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:21.140480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1268/2556] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:21.148195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1289/2557] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:21 2022] PUT /identity/v3/projects/4d2d7cae2c664e58a73b18f434c65dda/users/cd6a19c624c644778d07f7c779825180/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:21.156246 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0496552-be4a-46f6-b22f-c88bde646da0 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:21.157739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d0496552-be4a-46f6-b22f-c88bde646da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:21.159960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e80c-22ed-4b33-a977-fb61763ceb2c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.160249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e80c-22ed-4b33-a977-fb61763ceb2c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.160526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e80c-22ed-4b33-a977-fb61763ceb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.189688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-bc92e80c-22ed-4b33-a977-fb61763ceb2c None None] MFA Rules not processed for user `cd6a19c624c644778d07f7c779825180`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:21.190936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-bc92e80c-22ed-4b33-a977-fb61763ceb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:21.215958 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0496552-be4a-46f6-b22f-c88bde646da0 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:21.260075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1290/2558] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:21.264925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92e80c-22ed-4b33-a977-fb61763ceb2c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:21.271447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ec142-586f-42a8-a4b1-6542817bf459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:21.272091 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ec142-586f-42a8-a4b1-6542817bf459 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.272365 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ec142-586f-42a8-a4b1-6542817bf459 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.272677 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ec142-586f-42a8-a4b1-6542817bf459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.318126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:21.331695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92e80c-22ed-4b33-a977-fb61763ceb2c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:21.336996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ec142-586f-42a8-a4b1-6542817bf459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:21.337268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640a065-5394-4d35-90d3-cfe66c6af278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:21.337898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640a065-5394-4d35-90d3-cfe66c6af278 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.338177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640a065-5394-4d35-90d3-cfe66c6af278 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.338449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640a065-5394-4d35-90d3-cfe66c6af278 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.338612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ec142-586f-42a8-a4b1-6542817bf459 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:21.339190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640a065-5394-4d35-90d3-cfe66c6af278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:21.341083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640a065-5394-4d35-90d3-cfe66c6af278 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:21.348795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1269/2559] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:21.365028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:21.375663 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1291/2560] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:21 2022] POST /identity/v3/projects => generated 388 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:21.376797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ec142-586f-42a8-a4b1-6542817bf459 service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:21.388009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ec142-586f-42a8-a4b1-6542817bf459 service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:21.430639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640a065-5394-4d35-90d3-cfe66c6af278 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:21.446672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d458f-1a32-4e85-a991-9ad3f5d08cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:21.447344 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d458f-1a32-4e85-a991-9ad3f5d08cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.447621 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d458f-1a32-4e85-a991-9ad3f5d08cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.447892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d458f-1a32-4e85-a991-9ad3f5d08cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.448656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d458f-1a32-4e85-a991-9ad3f5d08cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:21.450598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d458f-1a32-4e85-a991-9ad3f5d08cb3 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:21.473530 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1270/2561] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:21 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:21.478008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d458f-1a32-4e85-a991-9ad3f5d08cb3 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:21.488438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d458f-1a32-4e85-a991-9ad3f5d08cb3 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:21.489800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640a065-5394-4d35-90d3-cfe66c6af278 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:21.493264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed4b85-937c-499e-beea-204d568131b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:21.493413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ef8cf-2e17-4e64-8e94-b88b72b5cc42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:21.493953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed4b85-937c-499e-beea-204d568131b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.494064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef8cf-2e17-4e64-8e94-b88b72b5cc42 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.494168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed4b85-937c-499e-beea-204d568131b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.494258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef8cf-2e17-4e64-8e94-b88b72b5cc42 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.494427 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed4b85-937c-499e-beea-204d568131b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.494530 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef8cf-2e17-4e64-8e94-b88b72b5cc42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.495184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed4b85-937c-499e-beea-204d568131b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:21.496942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed4b85-937c-499e-beea-204d568131b8 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:21.513436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1271/2562] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:21 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:21.514986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed4b85-937c-499e-beea-204d568131b8 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:21.526087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed4b85-937c-499e-beea-204d568131b8 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:21.531454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd087685-8cce-4cc8-bd13-f10bf2296271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:21.532139 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd087685-8cce-4cc8-bd13-f10bf2296271 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.532422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd087685-8cce-4cc8-bd13-f10bf2296271 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.532725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd087685-8cce-4cc8-bd13-f10bf2296271 admin admin] PATH_INFO: `/v3/projects/2980098210e34c319d0009113ee8c53b/users/3d75c8ea9b8c487f893c453fa8103cb4/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.548385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd087685-8cce-4cc8-bd13-f10bf2296271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2980098210e34c319d0009113ee8c53b, user_id=3d75c8ea9b8c487f893c453fa8103cb4, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:21.551226 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd087685-8cce-4cc8-bd13-f10bf2296271 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:21.553127 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ef8cf-2e17-4e64-8e94-b88b72b5cc42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:21.554589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ef8cf-2e17-4e64-8e94-b88b72b5cc42 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:21.564206 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1292/2563] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:21.566754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1272/2564] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:21 2022] PUT /identity/v3/projects/2980098210e34c319d0009113ee8c53b/users/3d75c8ea9b8c487f893c453fa8103cb4/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:03:21.572713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ef8cf-2e17-4e64-8e94-b88b72b5cc42 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:21.587798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ef8cf-2e17-4e64-8e94-b88b72b5cc42 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:21.660683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21033ed5-e67d-4308-a0c8-c77f83539be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:21.661320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21033ed5-e67d-4308-a0c8-c77f83539be5 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.661608 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21033ed5-e67d-4308-a0c8-c77f83539be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.661882 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21033ed5-e67d-4308-a0c8-c77f83539be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.662591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21033ed5-e67d-4308-a0c8-c77f83539be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:21.664280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21033ed5-e67d-4308-a0c8-c77f83539be5 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:21.674964 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1293/2565] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:21 2022] GET /identity/v3/roles => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:21.679350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd087685-8cce-4cc8-bd13-f10bf2296271 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:21.690269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd087685-8cce-4cc8-bd13-f10bf2296271 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:21.697747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f46bde-fafd-4e58-bf98-9d2906bef566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:21.699605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46bde-fafd-4e58-bf98-9d2906bef566 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.699928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46bde-fafd-4e58-bf98-9d2906bef566 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.700217 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f46bde-fafd-4e58-bf98-9d2906bef566 admin admin] PATH_INFO: `/v3/projects/2980098210e34c319d0009113ee8c53b/users/3d75c8ea9b8c487f893c453fa8103cb4/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.702431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f46bde-fafd-4e58-bf98-9d2906bef566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2980098210e34c319d0009113ee8c53b, user_id=3d75c8ea9b8c487f893c453fa8103cb4, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:21.705671 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f46bde-fafd-4e58-bf98-9d2906bef566 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:21.721147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1273/2566] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:21 2022] PUT /identity/v3/projects/2980098210e34c319d0009113ee8c53b/users/3d75c8ea9b8c487f893c453fa8103cb4/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:21.733038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a021-6fd5-4847-974a-ea6aac79b807 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:21.733616 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a021-6fd5-4847-974a-ea6aac79b807 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:21.734158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a021-6fd5-4847-974a-ea6aac79b807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:21.767399 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-6040a021-6fd5-4847-974a-ea6aac79b807 None None] MFA Rules not processed for user `3d75c8ea9b8c487f893c453fa8103cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:21.768747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6040a021-6fd5-4847-974a-ea6aac79b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:21.943324 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:21.973075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1294/2567] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:21.985480 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f46bde-fafd-4e58-bf98-9d2906bef566 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:22.044385 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f46bde-fafd-4e58-bf98-9d2906bef566 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:22.048523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8306d1-9b61-41cb-903c-8e5b686ff314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:22.049154 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8306d1-9b61-41cb-903c-8e5b686ff314 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:22.049441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8306d1-9b61-41cb-903c-8e5b686ff314 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:22.049715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8306d1-9b61-41cb-903c-8e5b686ff314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:22.060444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8306d1-9b61-41cb-903c-8e5b686ff314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:22.061926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8306d1-9b61-41cb-903c-8e5b686ff314 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:22.072006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1274/2568] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:22.100908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040a021-6fd5-4847-974a-ea6aac79b807 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:22.166854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040a021-6fd5-4847-974a-ea6aac79b807 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:22.172065 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:22.172742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:22.173015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:22.173296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] PATH_INFO: `/v3/users/cd6a19c624c644778d07f7c779825180` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:22.174521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6a19c624c644778d07f7c779825180)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:22.176540 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:22.230699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6a19c624c644778d07f7c779825180'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:22.241232 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6a19c624c644778d07f7c779825180'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:22.248649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6a19c624c644778d07f7c779825180'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:22.249563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6a19c624c644778d07f7c779825180'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:22.250274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6a19c624c644778d07f7c779825180'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:22.269965 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1295/2569] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:22 2022] DELETE /identity/v3/users/cd6a19c624c644778d07f7c779825180 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:22.274823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c4675-f9ea-4903-b002-6da4384ae3cb None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:22.275158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c4675-f9ea-4903-b002-6da4384ae3cb None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:22.275439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c4675-f9ea-4903-b002-6da4384ae3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:22.294535 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-855c4675-f9ea-4903-b002-6da4384ae3cb None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:22.295842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-855c4675-f9ea-4903-b002-6da4384ae3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:22.315714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:22.361625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1275/2570] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:22.372651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:22.374374 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:22.437178 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837505be-d633-4872-a148-d5fa4c9f52a1 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:22.441586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fd63e-a2ca-4a9d-b18f-fe58fa59f8bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:22.442205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fd63e-a2ca-4a9d-b18f-fe58fa59f8bc service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:22.442462 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fd63e-a2ca-4a9d-b18f-fe58fa59f8bc service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:22.442750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fd63e-a2ca-4a9d-b18f-fe58fa59f8bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:22.453050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fd63e-a2ca-4a9d-b18f-fe58fa59f8bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:22.454471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fd63e-a2ca-4a9d-b18f-fe58fa59f8bc service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:22.458506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:22.466026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1296/2571] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:22.757008 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c4675-f9ea-4903-b002-6da4384ae3cb None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:22.758820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-855c4675-f9ea-4903-b002-6da4384ae3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:22.780108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c4675-f9ea-4903-b002-6da4384ae3cb None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:22.793431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:22.794110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:22.794412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:22.794705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] PATH_INFO: `/v3/projects/4d2d7cae2c664e58a73b18f434c65dda` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:22.796117 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d2d7cae2c664e58a73b18f434c65dda)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:22.798123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:22.854345 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d2d7cae2c664e58a73b18f434c65dda', 'request_id': 'req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:22.861530 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d2d7cae2c664e58a73b18f434c65dda', 'request_id': 'req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:22.868120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d2d7cae2c664e58a73b18f434c65dda', 'request_id': 'req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:22.888481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] The token cache is being invalidate because project 4d2d7cae2c664e58a73b18f434c65dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:22.888776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:22.889519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:22.891566 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1276/2572] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:22 2022] DELETE /identity/v3/projects/4d2d7cae2c664e58a73b18f434c65dda => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:22.896281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fd63e-a2ca-4a9d-b18f-fe58fa59f8bc service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:22.906871 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fd63e-a2ca-4a9d-b18f-fe58fa59f8bc service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:22.966570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c58e19-ad4a-46c4-bf7f-8d2ddfe6e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:22.967269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c58e19-ad4a-46c4-bf7f-8d2ddfe6e898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:22.967654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c58e19-ad4a-46c4-bf7f-8d2ddfe6e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:22.968204 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c58e19-ad4a-46c4-bf7f-8d2ddfe6e898 admin admin] PATH_INFO: `/v3/users/3d75c8ea9b8c487f893c453fa8103cb4` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:22.969410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c58e19-ad4a-46c4-bf7f-8d2ddfe6e898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d75c8ea9b8c487f893c453fa8103cb4)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:22.971388 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c58e19-ad4a-46c4-bf7f-8d2ddfe6e898 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:23.021457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-72c58e19-ad4a-46c4-bf7f-8d2ddfe6e898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d75c8ea9b8c487f893c453fa8103cb4'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:23.029533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-72c58e19-ad4a-46c4-bf7f-8d2ddfe6e898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d75c8ea9b8c487f893c453fa8103cb4'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:23.037106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-72c58e19-ad4a-46c4-bf7f-8d2ddfe6e898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d75c8ea9b8c487f893c453fa8103cb4'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:23.037775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-72c58e19-ad4a-46c4-bf7f-8d2ddfe6e898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d75c8ea9b8c487f893c453fa8103cb4'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:23.038382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-72c58e19-ad4a-46c4-bf7f-8d2ddfe6e898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d75c8ea9b8c487f893c453fa8103cb4'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:23.057219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1297/2573] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:22 2022] DELETE /identity/v3/users/3d75c8ea9b8c487f893c453fa8103cb4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:23.364651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:23.366307 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:23.380590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e46e61-c0e6-48d3-9cc6-1fccde9a26a7 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:23.443195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:23.444199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.444478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.444772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] PATH_INFO: `/v3/projects/2980098210e34c319d0009113ee8c53b` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.445942 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2980098210e34c319d0009113ee8c53b)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:23.447997 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:23.498468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2980098210e34c319d0009113ee8c53b', 'request_id': 'req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:23.498468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:23.505130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2980098210e34c319d0009113ee8c53b', 'request_id': 'req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:23.512031 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2980098210e34c319d0009113ee8c53b', 'request_id': 'req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:23.526119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] The token cache is being invalidate because project 2980098210e34c319d0009113ee8c53b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:23.526410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:23.527101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-fadedf64-ec30-477e-8edc-e0bfc46c3c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:23.528675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1277/2574] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:23 2022] DELETE /identity/v3/projects/2980098210e34c319d0009113ee8c53b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:23.534195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc9f05-946d-45a3-8b40-11f9cee120cf None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.534420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc9f05-946d-45a3-8b40-11f9cee120cf None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.534693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc9f05-946d-45a3-8b40-11f9cee120cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.555002 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-0abc9f05-946d-45a3-8b40-11f9cee120cf None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:23.556417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0abc9f05-946d-45a3-8b40-11f9cee120cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:23.622639 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1298/2575] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:23.631695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846195ab-e9ce-4f44-8adc-4a05eb8558af None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.632006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846195ab-e9ce-4f44-8adc-4a05eb8558af None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.632285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846195ab-e9ce-4f44-8adc-4a05eb8558af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.653753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-846195ab-e9ce-4f44-8adc-4a05eb8558af None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:23.654984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-846195ab-e9ce-4f44-8adc-4a05eb8558af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:23.663739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1278/2576] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:23.668265 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc9f05-946d-45a3-8b40-11f9cee120cf None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:23.678477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc9f05-946d-45a3-8b40-11f9cee120cf None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:23.684514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f361226-4de1-42c9-94cf-6569c103645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:23.685113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361226-4de1-42c9-94cf-6569c103645d admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.685420 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361226-4de1-42c9-94cf-6569c103645d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.685693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361226-4de1-42c9-94cf-6569c103645d admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.686403 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f361226-4de1-42c9-94cf-6569c103645d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:23.686929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f361226-4de1-42c9-94cf-6569c103645d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:23.688773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f361226-4de1-42c9-94cf-6569c103645d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:23.701860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1299/2577] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:23.706549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846195ab-e9ce-4f44-8adc-4a05eb8558af None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:23.716556 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846195ab-e9ce-4f44-8adc-4a05eb8558af None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:23.722507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f0f2c-245c-4ecf-ab3c-ec7e0f70769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:23.723147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0f2c-245c-4ecf-ab3c-ec7e0f70769d admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.723429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0f2c-245c-4ecf-ab3c-ec7e0f70769d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.723701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0f2c-245c-4ecf-ab3c-ec7e0f70769d admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.724360 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f0f2c-245c-4ecf-ab3c-ec7e0f70769d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:23.726272 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f0f2c-245c-4ecf-ab3c-ec7e0f70769d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:23.756014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1279/2578] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:23 2022] POST /identity/v3/projects => generated 386 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:23.760405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f361226-4de1-42c9-94cf-6569c103645d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:23.766861 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:23.770473 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f361226-4de1-42c9-94cf-6569c103645d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:23.832628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542564b0-a9cd-424c-b993-78c88c74292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:23.833189 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542564b0-a9cd-424c-b993-78c88c74292c admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.833522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542564b0-a9cd-424c-b993-78c88c74292c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.833805 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542564b0-a9cd-424c-b993-78c88c74292c admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.834494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542564b0-a9cd-424c-b993-78c88c74292c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:23.836488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542564b0-a9cd-424c-b993-78c88c74292c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:23.861017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1300/2579] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:23 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:23.865667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f0f2c-245c-4ecf-ab3c-ec7e0f70769d admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:23.877063 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f0f2c-245c-4ecf-ab3c-ec7e0f70769d admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:23.882240 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49812bb-5fab-40de-885b-2f17e4a52073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:23.882854 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49812bb-5fab-40de-885b-2f17e4a52073 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.883172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49812bb-5fab-40de-885b-2f17e4a52073 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.883449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49812bb-5fab-40de-885b-2f17e4a52073 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.884159 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49812bb-5fab-40de-885b-2f17e4a52073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:23.885820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49812bb-5fab-40de-885b-2f17e4a52073 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:23.896747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1280/2580] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:23 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:23.900932 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542564b0-a9cd-424c-b993-78c88c74292c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:23.911498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542564b0-a9cd-424c-b993-78c88c74292c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:23.916434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ddea5-9575-4b99-bc47-b39e408412f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:23.917048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddea5-9575-4b99-bc47-b39e408412f3 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.917328 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddea5-9575-4b99-bc47-b39e408412f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.917599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddea5-9575-4b99-bc47-b39e408412f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.918306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ddea5-9575-4b99-bc47-b39e408412f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:23.919966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ddea5-9575-4b99-bc47-b39e408412f3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:23.931526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1301/2581] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:23 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:23.935929 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49812bb-5fab-40de-885b-2f17e4a52073 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:23.946980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49812bb-5fab-40de-885b-2f17e4a52073 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:23.951922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677b727-6fce-4479-8f0a-71622462cb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:23.956953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677b727-6fce-4479-8f0a-71622462cb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.956953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677b727-6fce-4479-8f0a-71622462cb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.956953 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677b727-6fce-4479-8f0a-71622462cb0e admin admin] PATH_INFO: `/v3/projects/a1fef87c286a468698bb53f4a973e25a/users/3fcc11b9676545ff8ac571d891c37d0e/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.976705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677b727-6fce-4479-8f0a-71622462cb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fef87c286a468698bb53f4a973e25a, user_id=3fcc11b9676545ff8ac571d891c37d0e, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:23.979395 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677b727-6fce-4479-8f0a-71622462cb0e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:23.993837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1281/2582] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:23 2022] PUT /identity/v3/projects/a1fef87c286a468698bb53f4a973e25a/users/3fcc11b9676545ff8ac571d891c37d0e/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:24.005621 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94034842-0fc8-41e0-bac0-6893d5d3969d None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.005913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94034842-0fc8-41e0-bac0-6893d5d3969d None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.006185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94034842-0fc8-41e0-bac0-6893d5d3969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.034643 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-94034842-0fc8-41e0-bac0-6893d5d3969d None None] MFA Rules not processed for user `3fcc11b9676545ff8ac571d891c37d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:24.035929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-94034842-0fc8-41e0-bac0-6893d5d3969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.104812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1302/2583] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:24.110075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677b727-6fce-4479-8f0a-71622462cb0e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.174093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677b727-6fce-4479-8f0a-71622462cb0e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.186622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914c76c-b0c7-489a-8195-5ee2272e512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.186622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914c76c-b0c7-489a-8195-5ee2272e512e admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.186622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914c76c-b0c7-489a-8195-5ee2272e512e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.186622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914c76c-b0c7-489a-8195-5ee2272e512e admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.187135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914c76c-b0c7-489a-8195-5ee2272e512e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.187135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914c76c-b0c7-489a-8195-5ee2272e512e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.214030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1282/2584] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/projects => generated 386 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:24.218476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94034842-0fc8-41e0-bac0-6893d5d3969d None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.229701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94034842-0fc8-41e0-bac0-6893d5d3969d None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.290398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa245e-b5e6-4a96-ad65-552b72032899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.291159 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa245e-b5e6-4a96-ad65-552b72032899 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.291477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa245e-b5e6-4a96-ad65-552b72032899 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.291749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa245e-b5e6-4a96-ad65-552b72032899 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.292456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa245e-b5e6-4a96-ad65-552b72032899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.298379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa245e-b5e6-4a96-ad65-552b72032899 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.317733 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1303/2585] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:24.321863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914c76c-b0c7-489a-8195-5ee2272e512e admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.333447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914c76c-b0c7-489a-8195-5ee2272e512e admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.339269 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a12e9-9176-4737-a241-c31ed2068b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.339963 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a12e9-9176-4737-a241-c31ed2068b79 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.340242 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a12e9-9176-4737-a241-c31ed2068b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.340504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a12e9-9176-4737-a241-c31ed2068b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.341328 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a12e9-9176-4737-a241-c31ed2068b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.343030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a12e9-9176-4737-a241-c31ed2068b79 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.356692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1283/2586] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:24 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:24.362927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa245e-b5e6-4a96-ad65-552b72032899 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.368185 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:24.375054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a12e9-9176-4737-a241-c31ed2068b79 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.375600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa245e-b5e6-4a96-ad65-552b72032899 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.377113 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a15a12e9-9176-4737-a241-c31ed2068b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.380863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11253f2-cc00-4298-b6c9-3b2d95be79f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.381538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11253f2-cc00-4298-b6c9-3b2d95be79f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.381817 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11253f2-cc00-4298-b6c9-3b2d95be79f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.382086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11253f2-cc00-4298-b6c9-3b2d95be79f8 admin admin] PATH_INFO: `/v3/projects/9e07358bea26450ab2a5302aa3455a09/users/e089aca8eccb45048bf5c30d51430b84/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.390126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a12e9-9176-4737-a241-c31ed2068b79 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.394917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89837f1d-ba43-48b3-8c6a-2fcf76917625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.395601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837f1d-ba43-48b3-8c6a-2fcf76917625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.395893 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837f1d-ba43-48b3-8c6a-2fcf76917625 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.396165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837f1d-ba43-48b3-8c6a-2fcf76917625 admin admin] PATH_INFO: `/v3/users/0d998c3260ab43bc9119b2c82584f703` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.397340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89837f1d-ba43-48b3-8c6a-2fcf76917625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d998c3260ab43bc9119b2c82584f703)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.398514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11253f2-cc00-4298-b6c9-3b2d95be79f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e07358bea26450ab2a5302aa3455a09, user_id=e089aca8eccb45048bf5c30d51430b84, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.399305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89837f1d-ba43-48b3-8c6a-2fcf76917625 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.401181 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11253f2-cc00-4298-b6c9-3b2d95be79f8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.415802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1304/2587] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:24 2022] PUT /identity/v3/projects/9e07358bea26450ab2a5302aa3455a09/users/e089aca8eccb45048bf5c30d51430b84/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:24.419783 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11253f2-cc00-4298-b6c9-3b2d95be79f8 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.450927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:24.453948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-89837f1d-ba43-48b3-8c6a-2fcf76917625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d998c3260ab43bc9119b2c82584f703'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:24.455408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-89837f1d-ba43-48b3-8c6a-2fcf76917625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d998c3260ab43bc9119b2c82584f703'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:24.469426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-89837f1d-ba43-48b3-8c6a-2fcf76917625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d998c3260ab43bc9119b2c82584f703'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:24.470176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-89837f1d-ba43-48b3-8c6a-2fcf76917625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d998c3260ab43bc9119b2c82584f703'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:24.477549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-89837f1d-ba43-48b3-8c6a-2fcf76917625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d998c3260ab43bc9119b2c82584f703'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:24.487737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11253f2-cc00-4298-b6c9-3b2d95be79f8 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.491562 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1284/2588] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:24 2022] DELETE /identity/v3/users/0d998c3260ab43bc9119b2c82584f703 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:24.492442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9c9d1-3c28-4073-96f1-7a1b2d94bd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.493060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9c9d1-3c28-4073-96f1-7a1b2d94bd8b admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.493371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9c9d1-3c28-4073-96f1-7a1b2d94bd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.493644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9c9d1-3c28-4073-96f1-7a1b2d94bd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.494363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9c9d1-3c28-4073-96f1-7a1b2d94bd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.496145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9c9d1-3c28-4073-96f1-7a1b2d94bd8b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.496373 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9f933-75ee-4261-9794-c160c694045c None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.496769 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9f933-75ee-4261-9794-c160c694045c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.497050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9f933-75ee-4261-9794-c160c694045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.508517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1305/2589] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:24 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:24.514219 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9c9d1-3c28-4073-96f1-7a1b2d94bd8b admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.516704 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1cf9c9d1-3c28-4073-96f1-7a1b2d94bd8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.517745 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-bfd9f933-75ee-4261-9794-c160c694045c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:24.518940 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-bfd9f933-75ee-4261-9794-c160c694045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.529856 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9c9d1-3c28-4073-96f1-7a1b2d94bd8b admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.579284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1285/2590] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:24.589796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9f933-75ee-4261-9794-c160c694045c None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.591391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-bfd9f933-75ee-4261-9794-c160c694045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.592889 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f6749-9eb5-42f7-80f3-44e9e1dc621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.593641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6749-9eb5-42f7-80f3-44e9e1dc621f admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.593987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6749-9eb5-42f7-80f3-44e9e1dc621f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.594320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6749-9eb5-42f7-80f3-44e9e1dc621f admin admin] PATH_INFO: `/v3/projects/9e07358bea26450ab2a5302aa3455a09/users/e089aca8eccb45048bf5c30d51430b84/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.596422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f6749-9eb5-42f7-80f3-44e9e1dc621f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e07358bea26450ab2a5302aa3455a09, user_id=e089aca8eccb45048bf5c30d51430b84, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.599161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f6749-9eb5-42f7-80f3-44e9e1dc621f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.610373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1306/2591] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:24 2022] PUT /identity/v3/projects/9e07358bea26450ab2a5302aa3455a09/users/e089aca8eccb45048bf5c30d51430b84/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:24.620779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50d7e8-bb37-4844-9f90-7762d3452349 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.621098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50d7e8-bb37-4844-9f90-7762d3452349 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.621373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50d7e8-bb37-4844-9f90-7762d3452349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.652249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4a50d7e8-bb37-4844-9f90-7762d3452349 None None] MFA Rules not processed for user `e089aca8eccb45048bf5c30d51430b84`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:24.653485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4a50d7e8-bb37-4844-9f90-7762d3452349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.654875 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9f933-75ee-4261-9794-c160c694045c None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.706010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54f3ba-ae65-4677-9f08-cf2bc6521886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.706746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54f3ba-ae65-4677-9f08-cf2bc6521886 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.707126 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54f3ba-ae65-4677-9f08-cf2bc6521886 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.707482 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54f3ba-ae65-4677-9f08-cf2bc6521886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.712933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:24.725745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1307/2592] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:24.737452 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50d7e8-bb37-4844-9f90-7762d3452349 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.739101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4a50d7e8-bb37-4844-9f90-7762d3452349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.743926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:24.776874 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54f3ba-ae65-4677-9f08-cf2bc6521886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.778321 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54f3ba-ae65-4677-9f08-cf2bc6521886 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.788500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1286/2593] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:24.801832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50d7e8-bb37-4844-9f90-7762d3452349 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.808332 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c05f53-06a8-4d57-80cd-7b2593c162b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.808982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05f53-06a8-4d57-80cd-7b2593c162b4 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.809258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05f53-06a8-4d57-80cd-7b2593c162b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.809530 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05f53-06a8-4d57-80cd-7b2593c162b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.824658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c05f53-06a8-4d57-80cd-7b2593c162b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.826258 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c05f53-06a8-4d57-80cd-7b2593c162b4 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.842205 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1308/2594] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:24.913003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54f3ba-ae65-4677-9f08-cf2bc6521886 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.927280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54f3ba-ae65-4677-9f08-cf2bc6521886 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.932012 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.933027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.933352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.933630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] PATH_INFO: `/v3/users/3fcc11b9676545ff8ac571d891c37d0e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.934891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fcc11b9676545ff8ac571d891c37d0e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.937287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.990995 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fcc11b9676545ff8ac571d891c37d0e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:24.991715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fcc11b9676545ff8ac571d891c37d0e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.004560 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fcc11b9676545ff8ac571d891c37d0e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.005315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fcc11b9676545ff8ac571d891c37d0e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.012493 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fcc11b9676545ff8ac571d891c37d0e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.029358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1287/2595] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:24 2022] DELETE /identity/v3/users/3fcc11b9676545ff8ac571d891c37d0e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:25.034342 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bc87a-6254-4e82-8357-17e4cee2ceee None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.034912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bc87a-6254-4e82-8357-17e4cee2ceee None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.035385 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bc87a-6254-4e82-8357-17e4cee2ceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.055560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-0d2bc87a-6254-4e82-8357-17e4cee2ceee None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:25.056802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0d2bc87a-6254-4e82-8357-17e4cee2ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.094105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.095623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.135260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1309/2596] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.145493 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bc87a-6254-4e82-8357-17e4cee2ceee None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.147443 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0d2bc87a-6254-4e82-8357-17e4cee2ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.169701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165cbab-1d80-401b-84e0-59dfac22a817 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.174815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.175501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.175786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.176067 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] PATH_INFO: `/v3/projects/7e18ece9018e4eeda5d93fdcc767c95d` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.177274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e18ece9018e4eeda5d93fdcc767c95d)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.179623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.206036 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bc87a-6254-4e82-8357-17e4cee2ceee None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.210042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c501-a817-4fee-8391-921b25328a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.210673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c501-a817-4fee-8391-921b25328a7b service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.210986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c501-a817-4fee-8391-921b25328a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.211228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c501-a817-4fee-8391-921b25328a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.220684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86c501-a817-4fee-8391-921b25328a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.222197 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86c501-a817-4fee-8391-921b25328a7b service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.223167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:25.230677 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e18ece9018e4eeda5d93fdcc767c95d', 'request_id': 'req-8b3ecca7-c071-4a93-8952-768081f77efe'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.233266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1310/2597] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:25.238239 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e18ece9018e4eeda5d93fdcc767c95d', 'request_id': 'req-8b3ecca7-c071-4a93-8952-768081f77efe'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.243849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e18ece9018e4eeda5d93fdcc767c95d', 'request_id': 'req-8b3ecca7-c071-4a93-8952-768081f77efe'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.257777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] The token cache is being invalidate because project 7e18ece9018e4eeda5d93fdcc767c95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:25.258362 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.259172 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.261009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1288/2598] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:25 2022] DELETE /identity/v3/projects/7e18ece9018e4eeda5d93fdcc767c95d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:25.265284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c501-a817-4fee-8391-921b25328a7b service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.275513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c501-a817-4fee-8391-921b25328a7b service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.318613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:25.339967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.340653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.340935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.341210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] PATH_INFO: `/v3/users/63c981d54b894ea5bd0a6ae8e300ccc5` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.342408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c981d54b894ea5bd0a6ae8e300ccc5)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.344946 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.416060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c981d54b894ea5bd0a6ae8e300ccc5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.426742 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c981d54b894ea5bd0a6ae8e300ccc5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.436113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c981d54b894ea5bd0a6ae8e300ccc5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.437149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c981d54b894ea5bd0a6ae8e300ccc5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.437852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c981d54b894ea5bd0a6ae8e300ccc5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.458759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1311/2599] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:25 2022] DELETE /identity/v3/users/63c981d54b894ea5bd0a6ae8e300ccc5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:25.545221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.547857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.566794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ecca7-c071-4a93-8952-768081f77efe admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.630851 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.631616 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.631900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.632185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] PATH_INFO: `/v3/projects/a1fef87c286a468698bb53f4a973e25a` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.633371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fef87c286a468698bb53f4a973e25a)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.635496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.686470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fef87c286a468698bb53f4a973e25a', 'request_id': 'req-3df39adb-481a-4d4c-b6ca-a15841262d51'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.693182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fef87c286a468698bb53f4a973e25a', 'request_id': 'req-3df39adb-481a-4d4c-b6ca-a15841262d51'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.699338 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fef87c286a468698bb53f4a973e25a', 'request_id': 'req-3df39adb-481a-4d4c-b6ca-a15841262d51'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.713823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] The token cache is being invalidate because project a1fef87c286a468698bb53f4a973e25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:25.714236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.714865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.716455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1289/2600] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:25 2022] DELETE /identity/v3/projects/a1fef87c286a468698bb53f4a973e25a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:25.720669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.722093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.735368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc2f79-2876-48d9-9e7e-211fa0078444 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.770387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.773533 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.799904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea979bcb-289e-4902-9539-9af8dad2bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.800711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979bcb-289e-4902-9539-9af8dad2bb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.801019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979bcb-289e-4902-9539-9af8dad2bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.801422 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979bcb-289e-4902-9539-9af8dad2bb8b admin admin] PATH_INFO: `/v3/users/e089aca8eccb45048bf5c30d51430b84` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.802753 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea979bcb-289e-4902-9539-9af8dad2bb8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e089aca8eccb45048bf5c30d51430b84)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.804732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea979bcb-289e-4902-9539-9af8dad2bb8b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.846754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df39adb-481a-4d4c-b6ca-a15841262d51 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.851501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.852221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.852505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.853062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] PATH_INFO: `/v3/projects/ca971047fa6942dda087f8eedca9b3be` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.853702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ea979bcb-289e-4902-9539-9af8dad2bb8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e089aca8eccb45048bf5c30d51430b84'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.854306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca971047fa6942dda087f8eedca9b3be)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.856308 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.857943 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:25.862429 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ea979bcb-289e-4902-9539-9af8dad2bb8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e089aca8eccb45048bf5c30d51430b84'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.869816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:25.872395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ea979bcb-289e-4902-9539-9af8dad2bb8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e089aca8eccb45048bf5c30d51430b84'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.873113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ea979bcb-289e-4902-9539-9af8dad2bb8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e089aca8eccb45048bf5c30d51430b84'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.874080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ea979bcb-289e-4902-9539-9af8dad2bb8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e089aca8eccb45048bf5c30d51430b84'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.893543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1312/2601] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:25 2022] DELETE /identity/v3/users/e089aca8eccb45048bf5c30d51430b84 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:25.911051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca971047fa6942dda087f8eedca9b3be', 'request_id': 'req-8f9b0550-1d10-4956-b042-e2d8067736d7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.917312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca971047fa6942dda087f8eedca9b3be', 'request_id': 'req-8f9b0550-1d10-4956-b042-e2d8067736d7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.922974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca971047fa6942dda087f8eedca9b3be', 'request_id': 'req-8f9b0550-1d10-4956-b042-e2d8067736d7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.936371 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] The token cache is being invalidate because project ca971047fa6942dda087f8eedca9b3be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:25.936663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.937316 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-8f9b0550-1d10-4956-b042-e2d8067736d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:25.938892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1290/2602] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:25 2022] DELETE /identity/v3/projects/ca971047fa6942dda087f8eedca9b3be => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:03:25.945413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a9e1b-2091-4b7d-90ac-44c0882ffb9c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.945658 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a9e1b-2091-4b7d-90ac-44c0882ffb9c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.945945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a9e1b-2091-4b7d-90ac-44c0882ffb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.969425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-cf7a9e1b-2091-4b7d-90ac-44c0882ffb9c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:25.970745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-cf7a9e1b-2091-4b7d-90ac-44c0882ffb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:26.035684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1313/2603] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:26.045050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83d441-4701-4bb7-ad35-38e2fbd90add None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.045348 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83d441-4701-4bb7-ad35-38e2fbd90add None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.045667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83d441-4701-4bb7-ad35-38e2fbd90add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.067649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1d83d441-4701-4bb7-ad35-38e2fbd90add None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:26.069455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1d83d441-4701-4bb7-ad35-38e2fbd90add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:26.078590 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1291/2604] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:26.083543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a9e1b-2091-4b7d-90ac-44c0882ffb9c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.093960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a9e1b-2091-4b7d-90ac-44c0882ffb9c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.098764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70290bc1-c07e-46e7-8493-22dd590be280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.099459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70290bc1-c07e-46e7-8493-22dd590be280 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.099734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70290bc1-c07e-46e7-8493-22dd590be280 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.099999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70290bc1-c07e-46e7-8493-22dd590be280 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.100775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70290bc1-c07e-46e7-8493-22dd590be280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:26.101080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70290bc1-c07e-46e7-8493-22dd590be280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.102679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70290bc1-c07e-46e7-8493-22dd590be280 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.116880 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1314/2605] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:26.121441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83d441-4701-4bb7-ad35-38e2fbd90add None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.132130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83d441-4701-4bb7-ad35-38e2fbd90add None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.137650 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a02b55-ea7f-4d60-84c9-c1fc0c0aa7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.138284 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a02b55-ea7f-4d60-84c9-c1fc0c0aa7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.138567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a02b55-ea7f-4d60-84c9-c1fc0c0aa7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.138844 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a02b55-ea7f-4d60-84c9-c1fc0c0aa7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.139704 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a02b55-ea7f-4d60-84c9-c1fc0c0aa7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.141694 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a02b55-ea7f-4d60-84c9-c1fc0c0aa7f1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.178417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1292/2606] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/projects => generated 388 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:26.180164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70290bc1-c07e-46e7-8493-22dd590be280 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.181227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a02b55-ea7f-4d60-84c9-c1fc0c0aa7f1 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.183108 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d3a02b55-ea7f-4d60-84c9-c1fc0c0aa7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:26.193440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70290bc1-c07e-46e7-8493-22dd590be280 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.253054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a02b55-ea7f-4d60-84c9-c1fc0c0aa7f1 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.254425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e3cfc-a4b3-4a62-85c3-8e2a559bef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.255088 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3cfc-a4b3-4a62-85c3-8e2a559bef34 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.255371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3cfc-a4b3-4a62-85c3-8e2a559bef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.255638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3cfc-a4b3-4a62-85c3-8e2a559bef34 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.256320 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e3cfc-a4b3-4a62-85c3-8e2a559bef34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.258088 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.258271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e3cfc-a4b3-4a62-85c3-8e2a559bef34 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.258732 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.259050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.259331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] PATH_INFO: `/v3/projects/9e07358bea26450ab2a5302aa3455a09` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.260532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e07358bea26450ab2a5302aa3455a09)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.262415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.281873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1315/2607] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:26.286086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e3cfc-a4b3-4a62-85c3-8e2a559bef34 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.296548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e3cfc-a4b3-4a62-85c3-8e2a559bef34 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.301497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa6979-4237-4520-bd92-bf54ba1aed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.302112 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa6979-4237-4520-bd92-bf54ba1aed5f admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.302393 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa6979-4237-4520-bd92-bf54ba1aed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.302669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa6979-4237-4520-bd92-bf54ba1aed5f admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.303409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa6979-4237-4520-bd92-bf54ba1aed5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.305016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa6979-4237-4520-bd92-bf54ba1aed5f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.314974 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e07358bea26450ab2a5302aa3455a09', 'request_id': 'req-ac2a76a9-a939-44a4-857f-b92682172731'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:26.322161 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e07358bea26450ab2a5302aa3455a09', 'request_id': 'req-ac2a76a9-a939-44a4-857f-b92682172731'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:26.325528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1316/2608] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:26.329599 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e07358bea26450ab2a5302aa3455a09', 'request_id': 'req-ac2a76a9-a939-44a4-857f-b92682172731'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:26.331588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa6979-4237-4520-bd92-bf54ba1aed5f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.331770 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:26.345638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa6979-4237-4520-bd92-bf54ba1aed5f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.346134 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] The token cache is being invalidate because project 9e07358bea26450ab2a5302aa3455a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:26.346456 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:26.347193 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ac2a76a9-a939-44a4-857f-b92682172731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:26.348764 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1293/2609] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:26 2022] DELETE /identity/v3/projects/9e07358bea26450ab2a5302aa3455a09 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:26.353571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e99b-3178-4911-a8da-37cf8288238f None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.353851 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e99b-3178-4911-a8da-37cf8288238f None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.354129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e99b-3178-4911-a8da-37cf8288238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.374199 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f0f5e99b-3178-4911-a8da-37cf8288238f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:26.375461 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f0f5e99b-3178-4911-a8da-37cf8288238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:26.389173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:26.407743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53769e38-0b88-491e-aec9-ab26d99628ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.408494 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769e38-0b88-491e-aec9-ab26d99628ab admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.408780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769e38-0b88-491e-aec9-ab26d99628ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.409060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769e38-0b88-491e-aec9-ab26d99628ab admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.409760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53769e38-0b88-491e-aec9-ab26d99628ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.411692 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53769e38-0b88-491e-aec9-ab26d99628ab admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.422252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1317/2610] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:26.426573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53769e38-0b88-491e-aec9-ab26d99628ab admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.428555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-53769e38-0b88-491e-aec9-ab26d99628ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:26.439678 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1294/2611] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:26.445307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53769e38-0b88-491e-aec9-ab26d99628ab admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.447857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09d29e-a092-4bcb-8efe-35c5bb092260 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.448147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09d29e-a092-4bcb-8efe-35c5bb092260 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.448424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09d29e-a092-4bcb-8efe-35c5bb092260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.451056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57f46-d6e3-490c-a7d8-0954c49663fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.451754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57f46-d6e3-490c-a7d8-0954c49663fe admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.452270 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57f46-d6e3-490c-a7d8-0954c49663fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.452574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57f46-d6e3-490c-a7d8-0954c49663fe admin admin] PATH_INFO: `/v3/projects/5e40f38ad1884e378aad508c831d8261/users/3b4e85ce75b7410caccd95fe1c302cdd/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.468432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57f46-d6e3-490c-a7d8-0954c49663fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e40f38ad1884e378aad508c831d8261, user_id=3b4e85ce75b7410caccd95fe1c302cdd, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.468680 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-fa09d29e-a092-4bcb-8efe-35c5bb092260 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:26.469891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fa09d29e-a092-4bcb-8efe-35c5bb092260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:26.471388 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57f46-d6e3-490c-a7d8-0954c49663fe admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.478408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1295/2612] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:26.482737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09d29e-a092-4bcb-8efe-35c5bb092260 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.489497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1318/2613] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:26 2022] PUT /identity/v3/projects/5e40f38ad1884e378aad508c831d8261/users/3b4e85ce75b7410caccd95fe1c302cdd/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:26.492788 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09d29e-a092-4bcb-8efe-35c5bb092260 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.500846 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40426-793a-4408-8e97-e6c001c7e799 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.501288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40426-793a-4408-8e97-e6c001c7e799 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.501564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40426-793a-4408-8e97-e6c001c7e799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.531513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-00d40426-793a-4408-8e97-e6c001c7e799 None None] MFA Rules not processed for user `3b4e85ce75b7410caccd95fe1c302cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:26.532802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-00d40426-793a-4408-8e97-e6c001c7e799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:26.554054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bb500-78dc-44a0-9317-266bc9bd3246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.554717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bb500-78dc-44a0-9317-266bc9bd3246 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.555027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bb500-78dc-44a0-9317-266bc9bd3246 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.555311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bb500-78dc-44a0-9317-266bc9bd3246 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.556039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bb500-78dc-44a0-9317-266bc9bd3246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:26.556349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bb500-78dc-44a0-9317-266bc9bd3246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.557972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bb500-78dc-44a0-9317-266bc9bd3246 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.570309 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1296/2614] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:03:26.574630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bb500-78dc-44a0-9317-266bc9bd3246 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.586486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bb500-78dc-44a0-9317-266bc9bd3246 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.591609 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d3cd1-8e33-440f-81f7-84998fe52b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.592233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d3cd1-8e33-440f-81f7-84998fe52b18 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.592559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d3cd1-8e33-440f-81f7-84998fe52b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.592845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d3cd1-8e33-440f-81f7-84998fe52b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.593660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d3cd1-8e33-440f-81f7-84998fe52b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.595731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d3cd1-8e33-440f-81f7-84998fe52b18 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.603528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1319/2615] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:26.609463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d40426-793a-4408-8e97-e6c001c7e799 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.623296 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d40426-793a-4408-8e97-e6c001c7e799 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.629053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af16cfd-1fbd-4d7d-be02-075b2114677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.629940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af16cfd-1fbd-4d7d-be02-075b2114677b admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.630378 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af16cfd-1fbd-4d7d-be02-075b2114677b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.630723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af16cfd-1fbd-4d7d-be02-075b2114677b admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.631987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af16cfd-1fbd-4d7d-be02-075b2114677b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.633929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af16cfd-1fbd-4d7d-be02-075b2114677b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.643051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1297/2616] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/projects => generated 392 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:26.647114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d3cd1-8e33-440f-81f7-84998fe52b18 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.666978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1320/2617] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/projects => generated 388 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:26.670302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af16cfd-1fbd-4d7d-be02-075b2114677b admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.698746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:26.718293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d3cd1-8e33-440f-81f7-84998fe52b18 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.739556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af16cfd-1fbd-4d7d-be02-075b2114677b admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.744853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d3dc0-d753-4bb4-8a5b-ad0be794b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.745677 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d3dc0-d753-4bb4-8a5b-ad0be794b4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.746020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d3dc0-d753-4bb4-8a5b-ad0be794b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.746368 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d3dc0-d753-4bb4-8a5b-ad0be794b4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.747461 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d3dc0-d753-4bb4-8a5b-ad0be794b4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.749608 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d3dc0-d753-4bb4-8a5b-ad0be794b4a1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.772317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1321/2618] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:26.776437 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d3dc0-d753-4bb4-8a5b-ad0be794b4a1 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.780869 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0110d-a4e2-4c5b-9ed1-5037e62a61b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.781497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0110d-a4e2-4c5b-9ed1-5037e62a61b8 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.781774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0110d-a4e2-4c5b-9ed1-5037e62a61b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.782047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0110d-a4e2-4c5b-9ed1-5037e62a61b8 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.782713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0110d-a4e2-4c5b-9ed1-5037e62a61b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.784657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0110d-a4e2-4c5b-9ed1-5037e62a61b8 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.786355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d3dc0-d753-4bb4-8a5b-ad0be794b4a1 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.791011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e9754-3e29-47e8-834e-ca5adb025042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.791620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9754-3e29-47e8-834e-ca5adb025042 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.791899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9754-3e29-47e8-834e-ca5adb025042 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.792170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9754-3e29-47e8-834e-ca5adb025042 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.792875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e9754-3e29-47e8-834e-ca5adb025042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.794482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e9754-3e29-47e8-834e-ca5adb025042 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.805020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1322/2619] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:26.809136 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1298/2620] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:26.809339 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e9754-3e29-47e8-834e-ca5adb025042 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.814033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0110d-a4e2-4c5b-9ed1-5037e62a61b8 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.815318 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:26.822701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e9754-3e29-47e8-834e-ca5adb025042 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.827389 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0110d-a4e2-4c5b-9ed1-5037e62a61b8 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.830868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9f8fb-706d-4c43-a4f4-4e9216e3c4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.831666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9f8fb-706d-4c43-a4f4-4e9216e3c4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.832069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9f8fb-706d-4c43-a4f4-4e9216e3c4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.832483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9f8fb-706d-4c43-a4f4-4e9216e3c4f2 admin admin] PATH_INFO: `/v3/projects/c8bd1f062f264e31960f246e06249475/users/2800751e3e9944979384272bf086e224/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.832927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083abaa-2375-4e73-a1ea-069395aab1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.833688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083abaa-2375-4e73-a1ea-069395aab1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.833970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083abaa-2375-4e73-a1ea-069395aab1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.834247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083abaa-2375-4e73-a1ea-069395aab1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.834977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083abaa-2375-4e73-a1ea-069395aab1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.836604 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083abaa-2375-4e73-a1ea-069395aab1b6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.847491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1299/2621] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:26.851499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9f8fb-706d-4c43-a4f4-4e9216e3c4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bd1f062f264e31960f246e06249475, user_id=2800751e3e9944979384272bf086e224, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.851737 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083abaa-2375-4e73-a1ea-069395aab1b6 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.854143 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9f8fb-706d-4c43-a4f4-4e9216e3c4f2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.862379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083abaa-2375-4e73-a1ea-069395aab1b6 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.869798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1323/2622] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:26 2022] PUT /identity/v3/projects/c8bd1f062f264e31960f246e06249475/users/2800751e3e9944979384272bf086e224/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:03:26.874888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9f8fb-706d-4c43-a4f4-4e9216e3c4f2 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.930337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9072b3d-f595-48b6-b46a-61ea1d661772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.930998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9072b3d-f595-48b6-b46a-61ea1d661772 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.931283 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9072b3d-f595-48b6-b46a-61ea1d661772 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.931576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9072b3d-f595-48b6-b46a-61ea1d661772 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.932316 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9072b3d-f595-48b6-b46a-61ea1d661772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.933970 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9072b3d-f595-48b6-b46a-61ea1d661772 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.948404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9f8fb-706d-4c43-a4f4-4e9216e3c4f2 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.951614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1300/2623] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:26.955648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981f0a9-016c-468a-acd2-71aaa9b1af06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.956554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f0a9-016c-468a-acd2-71aaa9b1af06 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.956948 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f0a9-016c-468a-acd2-71aaa9b1af06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.958121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f0a9-016c-468a-acd2-71aaa9b1af06 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.958250 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9072b3d-f595-48b6-b46a-61ea1d661772 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.958852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981f0a9-016c-468a-acd2-71aaa9b1af06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.961006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981f0a9-016c-468a-acd2-71aaa9b1af06 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.971417 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9072b3d-f595-48b6-b46a-61ea1d661772 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.974547 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1324/2624] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:26.977300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ea72d-069a-41de-b4d1-472053c5a10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.978165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ea72d-069a-41de-b4d1-472053c5a10b admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.978511 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ea72d-069a-41de-b4d1-472053c5a10b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.978867 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ea72d-069a-41de-b4d1-472053c5a10b admin admin] PATH_INFO: `/v3/projects/6e7c9aceaca7494aad1a481ee1c7e47e/users/b193466065a34949897de959bc5b9b91/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.979039 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981f0a9-016c-468a-acd2-71aaa9b1af06 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.990503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981f0a9-016c-468a-acd2-71aaa9b1af06 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.995696 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43950d15-cb39-4f17-b0dc-a04cbd0323ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.996309 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ea72d-069a-41de-b4d1-472053c5a10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7c9aceaca7494aad1a481ee1c7e47e, user_id=b193466065a34949897de959bc5b9b91, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.996524 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43950d15-cb39-4f17-b0dc-a04cbd0323ef admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.996687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43950d15-cb39-4f17-b0dc-a04cbd0323ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.996941 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43950d15-cb39-4f17-b0dc-a04cbd0323ef admin admin] PATH_INFO: `/v3/projects/c8bd1f062f264e31960f246e06249475/users/2800751e3e9944979384272bf086e224/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.999140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ea72d-069a-41de-b4d1-472053c5a10b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.999307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43950d15-cb39-4f17-b0dc-a04cbd0323ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bd1f062f264e31960f246e06249475, user_id=2800751e3e9944979384272bf086e224, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.002053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43950d15-cb39-4f17-b0dc-a04cbd0323ef admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.013887 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1325/2625] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:26 2022] PUT /identity/v3/projects/c8bd1f062f264e31960f246e06249475/users/2800751e3e9944979384272bf086e224/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:03:27.014198 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1301/2626] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:26 2022] PUT /identity/v3/projects/6e7c9aceaca7494aad1a481ee1c7e47e/users/b193466065a34949897de959bc5b9b91/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:27.026481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9863b-849d-4512-8792-693087f54b5f None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.026760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9863b-849d-4512-8792-693087f54b5f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.030315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9863b-849d-4512-8792-693087f54b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.062520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-2bd9863b-849d-4512-8792-693087f54b5f None None] MFA Rules not processed for user `2800751e3e9944979384272bf086e224`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:27.064795 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2bd9863b-849d-4512-8792-693087f54b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:27.089184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b3656-01cd-4ebb-9163-f58ab2f76994 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.089503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b3656-01cd-4ebb-9163-f58ab2f76994 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.089738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b3656-01cd-4ebb-9163-f58ab2f76994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.124518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e39b3656-01cd-4ebb-9163-f58ab2f76994 None None] MFA Rules not processed for user `b193466065a34949897de959bc5b9b91`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:27.129366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e39b3656-01cd-4ebb-9163-f58ab2f76994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:27.151552 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1326/2627] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:27.162966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9863b-849d-4512-8792-693087f54b5f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.164723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2bd9863b-849d-4512-8792-693087f54b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:27.165654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:27.202500 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1302/2628] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:27.207470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b3656-01cd-4ebb-9163-f58ab2f76994 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.229421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:27.235743 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9863b-849d-4512-8792-693087f54b5f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.240871 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e93c6-7f68-4b0c-b9a4-627758561fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.241967 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e93c6-7f68-4b0c-b9a4-627758561fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.242382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e93c6-7f68-4b0c-b9a4-627758561fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.242779 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e93c6-7f68-4b0c-b9a4-627758561fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.253381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e93c6-7f68-4b0c-b9a4-627758561fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.254812 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e93c6-7f68-4b0c-b9a4-627758561fb0 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.264672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1327/2629] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:27.276406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b3656-01cd-4ebb-9163-f58ab2f76994 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.281781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403dc15-ef8f-4e14-9f06-982117c36ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.282553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403dc15-ef8f-4e14-9f06-982117c36ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.282986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403dc15-ef8f-4e14-9f06-982117c36ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.283343 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403dc15-ef8f-4e14-9f06-982117c36ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.284057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403dc15-ef8f-4e14-9f06-982117c36ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.286042 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403dc15-ef8f-4e14-9f06-982117c36ae4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.319729 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1303/2630] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:27 2022] POST /identity/v3/projects => generated 392 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:27.324106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e93c6-7f68-4b0c-b9a4-627758561fb0 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.335149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e93c6-7f68-4b0c-b9a4-627758561fb0 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.394395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54a667-79e4-4002-b603-a371212a5fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.395063 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54a667-79e4-4002-b603-a371212a5fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.395351 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54a667-79e4-4002-b603-a371212a5fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.395626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54a667-79e4-4002-b603-a371212a5fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.396303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54a667-79e4-4002-b603-a371212a5fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.398276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54a667-79e4-4002-b603-a371212a5fc3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.423532 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1328/2631] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:27 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:27.424786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403dc15-ef8f-4e14-9f06-982117c36ae4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.435638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403dc15-ef8f-4e14-9f06-982117c36ae4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.441312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8010d6-9b21-4eed-b309-77ded006ce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.441932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8010d6-9b21-4eed-b309-77ded006ce68 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.442275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8010d6-9b21-4eed-b309-77ded006ce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.442487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8010d6-9b21-4eed-b309-77ded006ce68 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.443230 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8010d6-9b21-4eed-b309-77ded006ce68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.445125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8010d6-9b21-4eed-b309-77ded006ce68 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.455826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1304/2632] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:27 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:27.460586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54a667-79e4-4002-b603-a371212a5fc3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.471391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54a667-79e4-4002-b603-a371212a5fc3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.476648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b7742-c94c-43d5-af92-cdb8d3573e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.477467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b7742-c94c-43d5-af92-cdb8d3573e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.477744 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b7742-c94c-43d5-af92-cdb8d3573e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.478024 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b7742-c94c-43d5-af92-cdb8d3573e52 admin admin] PATH_INFO: `/v3/projects/262d095de06443aaad151f750ebdce00/users/3ad3f5e8ff56474081475d47a68a036f/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.499476 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b7742-c94c-43d5-af92-cdb8d3573e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262d095de06443aaad151f750ebdce00, user_id=3ad3f5e8ff56474081475d47a68a036f, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.502411 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b7742-c94c-43d5-af92-cdb8d3573e52 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.520707 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1329/2633] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:27 2022] PUT /identity/v3/projects/262d095de06443aaad151f750ebdce00/users/3ad3f5e8ff56474081475d47a68a036f/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:27.524828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8010d6-9b21-4eed-b309-77ded006ce68 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.535518 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8010d6-9b21-4eed-b309-77ded006ce68 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.597552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffe4e4-b641-4662-bdbd-59ee81bd0b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.598310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffe4e4-b641-4662-bdbd-59ee81bd0b36 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.598448 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffe4e4-b641-4662-bdbd-59ee81bd0b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.598752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffe4e4-b641-4662-bdbd-59ee81bd0b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.599533 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffe4e4-b641-4662-bdbd-59ee81bd0b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.601251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffe4e4-b641-4662-bdbd-59ee81bd0b36 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.612850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1305/2634] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:27 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:27.618221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b7742-c94c-43d5-af92-cdb8d3573e52 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.633649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b7742-c94c-43d5-af92-cdb8d3573e52 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.640872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb3e9c-34b1-45d3-b1fa-de52621c82f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.641679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb3e9c-34b1-45d3-b1fa-de52621c82f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.642041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb3e9c-34b1-45d3-b1fa-de52621c82f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.642533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb3e9c-34b1-45d3-b1fa-de52621c82f1 admin admin] PATH_INFO: `/v3/projects/262d095de06443aaad151f750ebdce00/users/3ad3f5e8ff56474081475d47a68a036f/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.645055 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb3e9c-34b1-45d3-b1fa-de52621c82f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262d095de06443aaad151f750ebdce00, user_id=3ad3f5e8ff56474081475d47a68a036f, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.648069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb3e9c-34b1-45d3-b1fa-de52621c82f1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.660294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1330/2635] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:27 2022] PUT /identity/v3/projects/262d095de06443aaad151f750ebdce00/users/3ad3f5e8ff56474081475d47a68a036f/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:27.672083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2874893-d8d6-4ea3-b3f9-1db3c742e100 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.672409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2874893-d8d6-4ea3-b3f9-1db3c742e100 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.672657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2874893-d8d6-4ea3-b3f9-1db3c742e100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.704553 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a2874893-d8d6-4ea3-b3f9-1db3c742e100 None None] MFA Rules not processed for user `3ad3f5e8ff56474081475d47a68a036f`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:27.705909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a2874893-d8d6-4ea3-b3f9-1db3c742e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:27.742390 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:27.783128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1306/2636] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:27.794413 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb3e9c-34b1-45d3-b1fa-de52621c82f1 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.861373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb3e9c-34b1-45d3-b1fa-de52621c82f1 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.865841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790bf07-dec2-4433-a23b-82080502ea67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.866542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790bf07-dec2-4433-a23b-82080502ea67 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.866902 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790bf07-dec2-4433-a23b-82080502ea67 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.867272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790bf07-dec2-4433-a23b-82080502ea67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.877953 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790bf07-dec2-4433-a23b-82080502ea67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.879707 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790bf07-dec2-4433-a23b-82080502ea67 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.883622 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2874893-d8d6-4ea3-b3f9-1db3c742e100 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.891055 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1331/2637] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:27.945574 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790bf07-dec2-4433-a23b-82080502ea67 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.947191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1790bf07-dec2-4433-a23b-82080502ea67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:27.955049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2874893-d8d6-4ea3-b3f9-1db3c742e100 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.959072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790bf07-dec2-4433-a23b-82080502ea67 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.960311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.960967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.961247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.961515 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] PATH_INFO: `/v3/users/3b4e85ce75b7410caccd95fe1c302cdd` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.962740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b715c9-7747-4e7d-9449-1cd9ac3f8811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.962879 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4e85ce75b7410caccd95fe1c302cdd)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.963390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b715c9-7747-4e7d-9449-1cd9ac3f8811 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.963674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b715c9-7747-4e7d-9449-1cd9ac3f8811 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.963948 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b715c9-7747-4e7d-9449-1cd9ac3f8811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.964768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:28.011246 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:28.018323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4e85ce75b7410caccd95fe1c302cdd'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.019034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4e85ce75b7410caccd95fe1c302cdd'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.029541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b715c9-7747-4e7d-9449-1cd9ac3f8811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:28.031121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b715c9-7747-4e7d-9449-1cd9ac3f8811 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:28.032597 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4e85ce75b7410caccd95fe1c302cdd'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.033314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4e85ce75b7410caccd95fe1c302cdd'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.040667 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4e85ce75b7410caccd95fe1c302cdd'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.042787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1332/2638] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:28.055692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1307/2639] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:27 2022] DELETE /identity/v3/users/3b4e85ce75b7410caccd95fe1c302cdd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:03:28.060236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a21e3-183a-48a4-b985-7e63f1892b12 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.060527 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a21e3-183a-48a4-b985-7e63f1892b12 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.060809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a21e3-183a-48a4-b985-7e63f1892b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.080798 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-102a21e3-183a-48a4-b985-7e63f1892b12 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:28.082046 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-102a21e3-183a-48a4-b985-7e63f1892b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:28.147607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1333/2640] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:28.158258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:28.160499 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:28.228857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f801f4-ea01-4c5a-a9ca-e5afb0a890d4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:28.233165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d49ef-72ce-4f06-9193-2f19c8a34874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:28.233928 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d49ef-72ce-4f06-9193-2f19c8a34874 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.234260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d49ef-72ce-4f06-9193-2f19c8a34874 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.234464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d49ef-72ce-4f06-9193-2f19c8a34874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.241345 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:28.247167 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d49ef-72ce-4f06-9193-2f19c8a34874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:28.250215 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d49ef-72ce-4f06-9193-2f19c8a34874 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:28.265150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1308/2641] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:28.568845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a21e3-183a-48a4-b985-7e63f1892b12 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:28.570602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-102a21e3-183a-48a4-b985-7e63f1892b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:28.586108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a21e3-183a-48a4-b985-7e63f1892b12 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:28.593351 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:28.593833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.594109 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.594425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] PATH_INFO: `/v3/projects/5e40f38ad1884e378aad508c831d8261` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.595680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e40f38ad1884e378aad508c831d8261)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:28.597668 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:28.650200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e40f38ad1884e378aad508c831d8261', 'request_id': 'req-393fe582-60ff-4368-83a3-6d54d38ada00'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.658542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e40f38ad1884e378aad508c831d8261', 'request_id': 'req-393fe582-60ff-4368-83a3-6d54d38ada00'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.664292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e40f38ad1884e378aad508c831d8261', 'request_id': 'req-393fe582-60ff-4368-83a3-6d54d38ada00'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.676345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] The token cache is being invalidate because project 5e40f38ad1884e378aad508c831d8261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:28.676634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.677369 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.679007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1334/2642] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:28 2022] DELETE /identity/v3/projects/5e40f38ad1884e378aad508c831d8261 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:28.683277 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d49ef-72ce-4f06-9193-2f19c8a34874 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:28.694358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d49ef-72ce-4f06-9193-2f19c8a34874 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:28.755368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d949430-7278-427a-9470-ad85a53d67a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:28.756015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949430-7278-427a-9470-ad85a53d67a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.756300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949430-7278-427a-9470-ad85a53d67a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.756580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949430-7278-427a-9470-ad85a53d67a7 admin admin] PATH_INFO: `/v3/users/2800751e3e9944979384272bf086e224` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.757805 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d949430-7278-427a-9470-ad85a53d67a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2800751e3e9944979384272bf086e224)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:28.760416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d949430-7278-427a-9470-ad85a53d67a7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:28.809837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-4d949430-7278-427a-9470-ad85a53d67a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2800751e3e9944979384272bf086e224'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.810524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-4d949430-7278-427a-9470-ad85a53d67a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2800751e3e9944979384272bf086e224'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.823814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-4d949430-7278-427a-9470-ad85a53d67a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2800751e3e9944979384272bf086e224'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.824523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-4d949430-7278-427a-9470-ad85a53d67a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2800751e3e9944979384272bf086e224'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.833232 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-4d949430-7278-427a-9470-ad85a53d67a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2800751e3e9944979384272bf086e224'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:28.849772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1309/2643] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:28 2022] DELETE /identity/v3/users/2800751e3e9944979384272bf086e224 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:29.144069 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:29.145609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:29.159602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fe582-60ff-4368-83a3-6d54d38ada00 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:29.222438 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:29.223122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:29.223415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:29.223667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] PATH_INFO: `/v3/projects/c8bd1f062f264e31960f246e06249475` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:29.224839 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8bd1f062f264e31960f246e06249475)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:29.226755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:29.235730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:29.278295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8bd1f062f264e31960f246e06249475', 'request_id': 'req-a116a530-b8f9-42e6-9336-ee20d061a734'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:29.287657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8bd1f062f264e31960f246e06249475', 'request_id': 'req-a116a530-b8f9-42e6-9336-ee20d061a734'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:29.293867 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8bd1f062f264e31960f246e06249475', 'request_id': 'req-a116a530-b8f9-42e6-9336-ee20d061a734'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:29.307998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] The token cache is being invalidate because project c8bd1f062f264e31960f246e06249475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:29.308276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:29.308984 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-a116a530-b8f9-42e6-9336-ee20d061a734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:29.310528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1335/2644] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:29 2022] DELETE /identity/v3/projects/c8bd1f062f264e31960f246e06249475 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:29.315658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646445e-34fd-4823-94e6-ecce997e580b None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:29.315941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646445e-34fd-4823-94e6-ecce997e580b None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:29.316215 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646445e-34fd-4823-94e6-ecce997e580b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:29.337714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-8646445e-34fd-4823-94e6-ecce997e580b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:29.338969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8646445e-34fd-4823-94e6-ecce997e580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:29.427727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1310/2645] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:29.435603 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7b93-a8ad-4d01-919f-ab151cba3b07 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:29.435886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7b93-a8ad-4d01-919f-ab151cba3b07 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:29.436218 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7b93-a8ad-4d01-919f-ab151cba3b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:29.457628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-fbaa7b93-a8ad-4d01-919f-ab151cba3b07 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:29.458863 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-fbaa7b93-a8ad-4d01-919f-ab151cba3b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:29.467732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1336/2646] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:29.471902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646445e-34fd-4823-94e6-ecce997e580b None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:29.482703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646445e-34fd-4823-94e6-ecce997e580b None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:29.488479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc218e71-6fea-474c-9728-7299df8eb028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:29.489218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc218e71-6fea-474c-9728-7299df8eb028 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:29.489623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc218e71-6fea-474c-9728-7299df8eb028 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:29.489973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc218e71-6fea-474c-9728-7299df8eb028 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:29.490767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc218e71-6fea-474c-9728-7299df8eb028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:29.491109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc218e71-6fea-474c-9728-7299df8eb028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:29.492769 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc218e71-6fea-474c-9728-7299df8eb028 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:29.511689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:29.512011 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1311/2647] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:03:29.516091 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa7b93-a8ad-4d01-919f-ab151cba3b07 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:29.526687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa7b93-a8ad-4d01-919f-ab151cba3b07 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:29.531662 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399a31a-f43f-4cd8-a7b9-c54a3e764d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:29.532217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399a31a-f43f-4cd8-a7b9-c54a3e764d13 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:29.532497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399a31a-f43f-4cd8-a7b9-c54a3e764d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:29.532773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399a31a-f43f-4cd8-a7b9-c54a3e764d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:29.533448 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399a31a-f43f-4cd8-a7b9-c54a3e764d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:29.535432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399a31a-f43f-4cd8-a7b9-c54a3e764d13 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:29.567859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1337/2648] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:29 2022] POST /identity/v3/projects => generated 376 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:29.572337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc218e71-6fea-474c-9728-7299df8eb028 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:29.589453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc218e71-6fea-474c-9728-7299df8eb028 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:29.662713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbff2b-73fd-490c-8043-46a16263a437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:29.663416 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbff2b-73fd-490c-8043-46a16263a437 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:29.663705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbff2b-73fd-490c-8043-46a16263a437 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:29.663984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbff2b-73fd-490c-8043-46a16263a437 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:29.664669 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbff2b-73fd-490c-8043-46a16263a437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:29.666872 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbff2b-73fd-490c-8043-46a16263a437 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:29.695197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1312/2649] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:29 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:29.696041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399a31a-f43f-4cd8-a7b9-c54a3e764d13 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:29.706702 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399a31a-f43f-4cd8-a7b9-c54a3e764d13 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:29.711526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56157a61-a2ee-4c1c-84c3-b69653e6e5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:29.712234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157a61-a2ee-4c1c-84c3-b69653e6e5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:29.712582 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157a61-a2ee-4c1c-84c3-b69653e6e5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:29.713063 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157a61-a2ee-4c1c-84c3-b69653e6e5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:29.713676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56157a61-a2ee-4c1c-84c3-b69653e6e5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:29.715306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56157a61-a2ee-4c1c-84c3-b69653e6e5d2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:29.727589 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1338/2650] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:29 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:29.731176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbff2b-73fd-490c-8043-46a16263a437 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:29.742863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbff2b-73fd-490c-8043-46a16263a437 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:29.747918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36492c25-23fe-4a6c-a311-3af702733026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:29.748750 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492c25-23fe-4a6c-a311-3af702733026 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:29.748964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492c25-23fe-4a6c-a311-3af702733026 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:29.749219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492c25-23fe-4a6c-a311-3af702733026 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:29.750036 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36492c25-23fe-4a6c-a311-3af702733026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:29.751670 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36492c25-23fe-4a6c-a311-3af702733026 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:29.765302 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1313/2651] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:29 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:29.769518 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56157a61-a2ee-4c1c-84c3-b69653e6e5d2 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:29.780601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56157a61-a2ee-4c1c-84c3-b69653e6e5d2 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:29.788104 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593f0c5-b877-41d9-9b2e-f97f7312b471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:29.788974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f0c5-b877-41d9-9b2e-f97f7312b471 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:29.789335 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f0c5-b877-41d9-9b2e-f97f7312b471 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:29.789701 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f0c5-b877-41d9-9b2e-f97f7312b471 admin admin] PATH_INFO: `/v3/projects/1f617053e1d74f5f82e59522a6c94ceb/users/5cc3ff80eab64da29d3c1e1f10683a55/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:29.810083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593f0c5-b877-41d9-9b2e-f97f7312b471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f617053e1d74f5f82e59522a6c94ceb, user_id=5cc3ff80eab64da29d3c1e1f10683a55, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:29.813137 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593f0c5-b877-41d9-9b2e-f97f7312b471 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:29.828693 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1339/2652] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:29 2022] PUT /identity/v3/projects/1f617053e1d74f5f82e59522a6c94ceb/users/5cc3ff80eab64da29d3c1e1f10683a55/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:29.840488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3377da-b5df-4f28-b520-61450943e48a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:29.840863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3377da-b5df-4f28-b520-61450943e48a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:29.841207 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3377da-b5df-4f28-b520-61450943e48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:29.873302 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1b3377da-b5df-4f28-b520-61450943e48a None None] MFA Rules not processed for user `5cc3ff80eab64da29d3c1e1f10683a55`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:29.875514 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1b3377da-b5df-4f28-b520-61450943e48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:29.952877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1314/2653] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:29.965826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593f0c5-b877-41d9-9b2e-f97f7312b471 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:29.968061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a593f0c5-b877-41d9-9b2e-f97f7312b471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:30.041596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593f0c5-b877-41d9-9b2e-f97f7312b471 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:30.045204 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e976b-fc25-4f4d-afee-d4e8a1d7cf9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:30.045980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e976b-fc25-4f4d-afee-d4e8a1d7cf9f service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:30.046263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e976b-fc25-4f4d-afee-d4e8a1d7cf9f service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:30.046545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e976b-fc25-4f4d-afee-d4e8a1d7cf9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:30.055690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e976b-fc25-4f4d-afee-d4e8a1d7cf9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:30.057144 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e976b-fc25-4f4d-afee-d4e8a1d7cf9f service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:30.066814 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1340/2654] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:31.501097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3377da-b5df-4f28-b520-61450943e48a None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:31.506733 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1b3377da-b5df-4f28-b520-61450943e48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:31.579710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3377da-b5df-4f28-b520-61450943e48a None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:31.585144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:31.585860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:31.586178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:31.586487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] PATH_INFO: `/v3/users/b193466065a34949897de959bc5b9b91` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:31.587810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b193466065a34949897de959bc5b9b91)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:31.589772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:31.613181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:31.655952 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b193466065a34949897de959bc5b9b91'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:31.656611 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b193466065a34949897de959bc5b9b91'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:31.668537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b193466065a34949897de959bc5b9b91'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:31.669192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b193466065a34949897de959bc5b9b91'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:31.676502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b193466065a34949897de959bc5b9b91'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:31.690973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1315/2655] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:31 2022] DELETE /identity/v3/users/b193466065a34949897de959bc5b9b91 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:31.695959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da7e0d-0e17-4958-bf43-a7a0022d6aad None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:31.696447 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da7e0d-0e17-4958-bf43-a7a0022d6aad None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:31.696559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da7e0d-0e17-4958-bf43-a7a0022d6aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:31.715682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a6da7e0d-0e17-4958-bf43-a7a0022d6aad None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:31.716904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a6da7e0d-0e17-4958-bf43-a7a0022d6aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:31.749792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:31.781826 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1341/2656] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:31.792013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:31.793731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:31.984075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b23cf-ed57-40dd-b548-e97ba2f60b47 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:31.987842 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d123d-d6d4-49e7-bc4d-68238f8ab2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:31.988470 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d123d-d6d4-49e7-bc4d-68238f8ab2fa service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:31.988797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d123d-d6d4-49e7-bc4d-68238f8ab2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:31.989075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d123d-d6d4-49e7-bc4d-68238f8ab2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:31.999050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d123d-d6d4-49e7-bc4d-68238f8ab2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:32.000551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d123d-d6d4-49e7-bc4d-68238f8ab2fa service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:32.010525 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1316/2657] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:32.305669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da7e0d-0e17-4958-bf43-a7a0022d6aad None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:32.307506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a6da7e0d-0e17-4958-bf43-a7a0022d6aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:32.322911 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da7e0d-0e17-4958-bf43-a7a0022d6aad None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:32.336348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:32.337023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:32.337311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:32.337559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] PATH_INFO: `/v3/projects/6e7c9aceaca7494aad1a481ee1c7e47e` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:32.338891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7c9aceaca7494aad1a481ee1c7e47e)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:32.340851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:32.390894 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7c9aceaca7494aad1a481ee1c7e47e', 'request_id': 'req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:32.400169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7c9aceaca7494aad1a481ee1c7e47e', 'request_id': 'req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:32.405770 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7c9aceaca7494aad1a481ee1c7e47e', 'request_id': 'req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:32.417190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] The token cache is being invalidate because project 6e7c9aceaca7494aad1a481ee1c7e47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:32.417396 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:32.418041 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:32.419610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1342/2658] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:32 2022] DELETE /identity/v3/projects/6e7c9aceaca7494aad1a481ee1c7e47e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:32.424200 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d123d-d6d4-49e7-bc4d-68238f8ab2fa service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:32.434221 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d123d-d6d4-49e7-bc4d-68238f8ab2fa service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:32.501444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd6e95-1d4c-4b5e-91c2-edd07311bbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:32.502084 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd6e95-1d4c-4b5e-91c2-edd07311bbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:32.502176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd6e95-1d4c-4b5e-91c2-edd07311bbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:32.502431 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd6e95-1d4c-4b5e-91c2-edd07311bbe4 admin admin] PATH_INFO: `/v3/users/3ad3f5e8ff56474081475d47a68a036f` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:32.503951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd6e95-1d4c-4b5e-91c2-edd07311bbe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad3f5e8ff56474081475d47a68a036f)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:32.506071 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd6e95-1d4c-4b5e-91c2-edd07311bbe4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:32.550178 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:32.565066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-c1cd6e95-1d4c-4b5e-91c2-edd07311bbe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad3f5e8ff56474081475d47a68a036f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:32.565740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-c1cd6e95-1d4c-4b5e-91c2-edd07311bbe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad3f5e8ff56474081475d47a68a036f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:32.578380 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-c1cd6e95-1d4c-4b5e-91c2-edd07311bbe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad3f5e8ff56474081475d47a68a036f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:32.579094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-c1cd6e95-1d4c-4b5e-91c2-edd07311bbe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad3f5e8ff56474081475d47a68a036f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:32.587695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-c1cd6e95-1d4c-4b5e-91c2-edd07311bbe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad3f5e8ff56474081475d47a68a036f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:32.601971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1317/2659] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:32 2022] DELETE /identity/v3/users/3ad3f5e8ff56474081475d47a68a036f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:32.929713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:32.931290 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:32.945637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4d068-b34c-4b28-bba5-e4439b1e12c4 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.006221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.006875 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.007231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.007506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] PATH_INFO: `/v3/projects/262d095de06443aaad151f750ebdce00` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.008776 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=262d095de06443aaad151f750ebdce00)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.010735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.062011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262d095de06443aaad151f750ebdce00', 'request_id': 'req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.071463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262d095de06443aaad151f750ebdce00', 'request_id': 'req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.075406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:33.077822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262d095de06443aaad151f750ebdce00', 'request_id': 'req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.090997 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] The token cache is being invalidate because project 262d095de06443aaad151f750ebdce00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:33.091312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.091993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-077b8ff6-970c-4c5c-b550-8c98fbe23a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.093581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1343/2660] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:32 2022] DELETE /identity/v3/projects/262d095de06443aaad151f750ebdce00 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:33.098665 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f011-cb30-49d1-9c97-809e1e6ff45b None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.098980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f011-cb30-49d1-9c97-809e1e6ff45b None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.099394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f011-cb30-49d1-9c97-809e1e6ff45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.121010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-0ca5f011-cb30-49d1-9c97-809e1e6ff45b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:33.122507 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-0ca5f011-cb30-49d1-9c97-809e1e6ff45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:33.184810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1318/2661] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:33.194272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d08d-fe05-4cb1-9c07-6fdbb40771af None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.194542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d08d-fe05-4cb1-9c07-6fdbb40771af None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.194819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d08d-fe05-4cb1-9c07-6fdbb40771af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.217161 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-04f4d08d-fe05-4cb1-9c07-6fdbb40771af None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:33.218513 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-04f4d08d-fe05-4cb1-9c07-6fdbb40771af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:33.227604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1344/2662] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:33.232306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5f011-cb30-49d1-9c97-809e1e6ff45b None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.243219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5f011-cb30-49d1-9c97-809e1e6ff45b None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.248468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10430286-9251-4d71-ade2-b3cf9ff6a81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.249180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10430286-9251-4d71-ade2-b3cf9ff6a81b admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.249463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10430286-9251-4d71-ade2-b3cf9ff6a81b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.249738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10430286-9251-4d71-ade2-b3cf9ff6a81b admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.250449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10430286-9251-4d71-ade2-b3cf9ff6a81b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:33.250820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10430286-9251-4d71-ade2-b3cf9ff6a81b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.252550 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10430286-9251-4d71-ade2-b3cf9ff6a81b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.265730 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1319/2663] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:33.270521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4d08d-fe05-4cb1-9c07-6fdbb40771af None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.280380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4d08d-fe05-4cb1-9c07-6fdbb40771af None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.286557 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df9678-3c21-4fb4-8964-ecbf91678fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.287236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df9678-3c21-4fb4-8964-ecbf91678fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.287497 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df9678-3c21-4fb4-8964-ecbf91678fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.287757 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df9678-3c21-4fb4-8964-ecbf91678fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.288435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df9678-3c21-4fb4-8964-ecbf91678fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.290329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df9678-3c21-4fb4-8964-ecbf91678fd6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.320066 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1345/2664] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:33 2022] POST /identity/v3/projects => generated 408 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:33.324546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10430286-9251-4d71-ade2-b3cf9ff6a81b admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.335944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10430286-9251-4d71-ade2-b3cf9ff6a81b admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.399558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9e716-d5e7-41a0-b7cf-2603382cc7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.400225 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9e716-d5e7-41a0-b7cf-2603382cc7be admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.400506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9e716-d5e7-41a0-b7cf-2603382cc7be admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.400778 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9e716-d5e7-41a0-b7cf-2603382cc7be admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.401504 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9e716-d5e7-41a0-b7cf-2603382cc7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.403568 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9e716-d5e7-41a0-b7cf-2603382cc7be admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.425861 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1320/2665] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:33 2022] POST /identity/v3/users => generated 305 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:33.430726 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df9678-3c21-4fb4-8964-ecbf91678fd6 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.441418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df9678-3c21-4fb4-8964-ecbf91678fd6 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.446559 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6418f-e9a2-449d-bcea-28fa0e64bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.447212 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6418f-e9a2-449d-bcea-28fa0e64bdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.447488 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6418f-e9a2-449d-bcea-28fa0e64bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.447786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6418f-e9a2-449d-bcea-28fa0e64bdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.448485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6418f-e9a2-449d-bcea-28fa0e64bdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.450067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6418f-e9a2-449d-bcea-28fa0e64bdd5 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.460970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1346/2666] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:33 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:33.465501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9e716-d5e7-41a0-b7cf-2603382cc7be admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.476052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9e716-d5e7-41a0-b7cf-2603382cc7be admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.481441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357c34-6f4f-4920-ad91-21efede6d9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.482066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357c34-6f4f-4920-ad91-21efede6d9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.482341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357c34-6f4f-4920-ad91-21efede6d9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.482613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357c34-6f4f-4920-ad91-21efede6d9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.483483 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42357c34-6f4f-4920-ad91-21efede6d9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.485157 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42357c34-6f4f-4920-ad91-21efede6d9b1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.496332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1321/2667] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:33 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:33.500832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6418f-e9a2-449d-bcea-28fa0e64bdd5 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.511285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6418f-e9a2-449d-bcea-28fa0e64bdd5 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.516330 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c236fa-7790-4f24-a631-947ac154ea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.517021 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c236fa-7790-4f24-a631-947ac154ea1e admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.517283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c236fa-7790-4f24-a631-947ac154ea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.517551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c236fa-7790-4f24-a631-947ac154ea1e admin admin] PATH_INFO: `/v3/projects/121abdfdf6fc480cbc8f7d3a8ff4c650/users/1154d883b8114add97633ef0fcf477c0/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.532810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c236fa-7790-4f24-a631-947ac154ea1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=121abdfdf6fc480cbc8f7d3a8ff4c650, user_id=1154d883b8114add97633ef0fcf477c0, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.535656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c236fa-7790-4f24-a631-947ac154ea1e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.550564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1347/2668] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:33 2022] PUT /identity/v3/projects/121abdfdf6fc480cbc8f7d3a8ff4c650/users/1154d883b8114add97633ef0fcf477c0/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:33.562673 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6500-0abe-4834-8401-ebaf01c30412 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.563449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6500-0abe-4834-8401-ebaf01c30412 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.563449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6500-0abe-4834-8401-ebaf01c30412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.593898 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-92ea6500-0abe-4834-8401-ebaf01c30412 None None] MFA Rules not processed for user `1154d883b8114add97633ef0fcf477c0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:33.595229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-92ea6500-0abe-4834-8401-ebaf01c30412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:33.599717 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:33.668884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1322/2669] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:33 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:33.673866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c236fa-7790-4f24-a631-947ac154ea1e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.740719 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c236fa-7790-4f24-a631-947ac154ea1e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.746135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758aab7-cecf-4dca-ac03-3fcbc3c49af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.746767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758aab7-cecf-4dca-ac03-3fcbc3c49af3 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.747078 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758aab7-cecf-4dca-ac03-3fcbc3c49af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.747356 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758aab7-cecf-4dca-ac03-3fcbc3c49af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.748350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758aab7-cecf-4dca-ac03-3fcbc3c49af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.750377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758aab7-cecf-4dca-ac03-3fcbc3c49af3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.780827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1348/2670] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:33 2022] POST /identity/v3/projects => generated 410 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:33.785739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6500-0abe-4834-8401-ebaf01c30412 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.797726 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6500-0abe-4834-8401-ebaf01c30412 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.859603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa87716-d4b8-40ea-aa60-983f14c362fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.860228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87716-d4b8-40ea-aa60-983f14c362fa admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.860505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87716-d4b8-40ea-aa60-983f14c362fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.860777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87716-d4b8-40ea-aa60-983f14c362fa admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.861449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa87716-d4b8-40ea-aa60-983f14c362fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.863372 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa87716-d4b8-40ea-aa60-983f14c362fa admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.886332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1323/2671] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:33 2022] POST /identity/v3/users => generated 312 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:33.890754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758aab7-cecf-4dca-ac03-3fcbc3c49af3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.901397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758aab7-cecf-4dca-ac03-3fcbc3c49af3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.906182 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b0965-4bdf-4df5-adac-45bdb71d7d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.906787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b0965-4bdf-4df5-adac-45bdb71d7d23 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.907105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b0965-4bdf-4df5-adac-45bdb71d7d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.907387 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b0965-4bdf-4df5-adac-45bdb71d7d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.908096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b0965-4bdf-4df5-adac-45bdb71d7d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.909667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b0965-4bdf-4df5-adac-45bdb71d7d23 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.922453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1349/2672] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:33 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:33.927093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa87716-d4b8-40ea-aa60-983f14c362fa admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.937623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa87716-d4b8-40ea-aa60-983f14c362fa admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.943819 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda8571-2341-49bb-aa5f-2514683e1ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.944536 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda8571-2341-49bb-aa5f-2514683e1ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.944802 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda8571-2341-49bb-aa5f-2514683e1ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.945072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda8571-2341-49bb-aa5f-2514683e1ba4 admin admin] PATH_INFO: `/v3/projects/d563bb222b6f4ed590a8d915ed00513b/users/b973fec7672645f89791b8a917258130/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.963709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda8571-2341-49bb-aa5f-2514683e1ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d563bb222b6f4ed590a8d915ed00513b, user_id=b973fec7672645f89791b8a917258130, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.966916 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda8571-2341-49bb-aa5f-2514683e1ba4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.991055 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1324/2673] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:33 2022] PUT /identity/v3/projects/d563bb222b6f4ed590a8d915ed00513b/users/b973fec7672645f89791b8a917258130/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:33.995572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b0965-4bdf-4df5-adac-45bdb71d7d23 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:34.006269 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b0965-4bdf-4df5-adac-45bdb71d7d23 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:34.065638 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661458b-e680-4338-a9cb-ee5ddd99b5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:34.066266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661458b-e680-4338-a9cb-ee5ddd99b5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:34.066542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661458b-e680-4338-a9cb-ee5ddd99b5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:34.066819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661458b-e680-4338-a9cb-ee5ddd99b5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:34.067562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661458b-e680-4338-a9cb-ee5ddd99b5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:34.069572 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661458b-e680-4338-a9cb-ee5ddd99b5f3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:34.070972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:34.085711 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1350/2674] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:33 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:34.087349 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda8571-2341-49bb-aa5f-2514683e1ba4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:34.099185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda8571-2341-49bb-aa5f-2514683e1ba4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:34.104486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3a6bf-7625-44b2-86b0-580e2956be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:34.105150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3a6bf-7625-44b2-86b0-580e2956be26 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:34.105428 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3a6bf-7625-44b2-86b0-580e2956be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:34.105701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3a6bf-7625-44b2-86b0-580e2956be26 admin admin] PATH_INFO: `/v3/projects/d563bb222b6f4ed590a8d915ed00513b/users/b973fec7672645f89791b8a917258130/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:34.108047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3a6bf-7625-44b2-86b0-580e2956be26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d563bb222b6f4ed590a8d915ed00513b, user_id=b973fec7672645f89791b8a917258130, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:34.110712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3a6bf-7625-44b2-86b0-580e2956be26 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:34.121551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1325/2675] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:34 2022] PUT /identity/v3/projects/d563bb222b6f4ed590a8d915ed00513b/users/b973fec7672645f89791b8a917258130/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:34.132363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3750f9-01b9-4ddb-b2ee-c7bd6ba62754 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:34.132655 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3750f9-01b9-4ddb-b2ee-c7bd6ba62754 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:34.132939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3750f9-01b9-4ddb-b2ee-c7bd6ba62754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:34.164026 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-ab3750f9-01b9-4ddb-b2ee-c7bd6ba62754 None None] MFA Rules not processed for user `b973fec7672645f89791b8a917258130`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:34.165597 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ab3750f9-01b9-4ddb-b2ee-c7bd6ba62754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:34.238684 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1351/2676] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:34 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:34.250013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3a6bf-7625-44b2-86b0-580e2956be26 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:34.252121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-75e3a6bf-7625-44b2-86b0-580e2956be26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:34.321825 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3a6bf-7625-44b2-86b0-580e2956be26 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:34.328903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458b51-4910-496a-8ce8-06807217f010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:34.329603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458b51-4910-496a-8ce8-06807217f010 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:34.329889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458b51-4910-496a-8ce8-06807217f010 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:34.330601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458b51-4910-496a-8ce8-06807217f010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:34.341807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a458b51-4910-496a-8ce8-06807217f010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:34.343498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a458b51-4910-496a-8ce8-06807217f010 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:34.350226 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:34.356171 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1326/2677] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:34 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:34.528377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3750f9-01b9-4ddb-b2ee-c7bd6ba62754 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:34.539832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3750f9-01b9-4ddb-b2ee-c7bd6ba62754 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:34.544442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f924d-c5ed-414d-8b43-2f2a94e994a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:34.545060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f924d-c5ed-414d-8b43-2f2a94e994a1 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:34.545376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f924d-c5ed-414d-8b43-2f2a94e994a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:34.545866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f924d-c5ed-414d-8b43-2f2a94e994a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:34.608626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f924d-c5ed-414d-8b43-2f2a94e994a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:34.610187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f924d-c5ed-414d-8b43-2f2a94e994a1 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:34.620062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1352/2678] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:34 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:40.033965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458b51-4910-496a-8ce8-06807217f010 service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:40.118764 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458b51-4910-496a-8ce8-06807217f010 service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:40.124557 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:40.125352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:40.125682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:40.125943 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] PATH_INFO: `/v3/users/1154d883b8114add97633ef0fcf477c0` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:40.127264 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1154d883b8114add97633ef0fcf477c0)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:40.129481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:40.197862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1154d883b8114add97633ef0fcf477c0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:40.198587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1154d883b8114add97633ef0fcf477c0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:40.214781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1154d883b8114add97633ef0fcf477c0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:40.215708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1154d883b8114add97633ef0fcf477c0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:40.226676 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1154d883b8114add97633ef0fcf477c0'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:40.247147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1327/2679] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:40 2022] DELETE /identity/v3/users/1154d883b8114add97633ef0fcf477c0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:40.252023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da062953-3668-4914-bacc-f256aa778b17 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:40.252935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da062953-3668-4914-bacc-f256aa778b17 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:40.253373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da062953-3668-4914-bacc-f256aa778b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:40.284683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-da062953-3668-4914-bacc-f256aa778b17 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:40.285918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-da062953-3668-4914-bacc-f256aa778b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:40.373993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1353/2680] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:40.387432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:40.389128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:40.464635 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd3b5e-7bd0-4134-ad61-8c5ec3e88e58 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:40.469047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff2fd5-2fe5-404f-8ef1-17b33f1a8b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:40.469676 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2fd5-2fe5-404f-8ef1-17b33f1a8b4c service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:40.469952 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2fd5-2fe5-404f-8ef1-17b33f1a8b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:40.470419 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2fd5-2fe5-404f-8ef1-17b33f1a8b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:40.481626 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff2fd5-2fe5-404f-8ef1-17b33f1a8b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:40.483332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff2fd5-2fe5-404f-8ef1-17b33f1a8b4c service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:40.498478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1328/2681] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:40.844936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da062953-3668-4914-bacc-f256aa778b17 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:40.847005 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-da062953-3668-4914-bacc-f256aa778b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:40.863236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da062953-3668-4914-bacc-f256aa778b17 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:40.869194 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:40.870716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:40.870980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:40.871285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] PATH_INFO: `/v3/projects/121abdfdf6fc480cbc8f7d3a8ff4c650` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:40.872985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=121abdfdf6fc480cbc8f7d3a8ff4c650)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:40.875253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:40.892768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=100 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:40.926250 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121abdfdf6fc480cbc8f7d3a8ff4c650', 'request_id': 'req-1b848607-9bf0-4e82-a263-599b2b966b4f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:40.934054 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121abdfdf6fc480cbc8f7d3a8ff4c650', 'request_id': 'req-1b848607-9bf0-4e82-a263-599b2b966b4f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:40.940083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121abdfdf6fc480cbc8f7d3a8ff4c650', 'request_id': 'req-1b848607-9bf0-4e82-a263-599b2b966b4f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:40.951935 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] The token cache is being invalidate because project 121abdfdf6fc480cbc8f7d3a8ff4c650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:40.952223 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:40.952944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:40.954664 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1354/2682] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:40 2022] DELETE /identity/v3/projects/121abdfdf6fc480cbc8f7d3a8ff4c650 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:40.959223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff2fd5-2fe5-404f-8ef1-17b33f1a8b4c service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:40.971544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff2fd5-2fe5-404f-8ef1-17b33f1a8b4c service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:40.998432 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:41.042988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db4e49-6745-4174-b216-df4aeba320de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:41.043850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4e49-6745-4174-b216-df4aeba320de admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.044150 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4e49-6745-4174-b216-df4aeba320de admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.044412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4e49-6745-4174-b216-df4aeba320de admin admin] PATH_INFO: `/v3/users/b973fec7672645f89791b8a917258130` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.045809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db4e49-6745-4174-b216-df4aeba320de admin admin] RBAC: Authorizing `identity:delete_user(user_id=b973fec7672645f89791b8a917258130)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:41.047887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db4e49-6745-4174-b216-df4aeba320de admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:41.099761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-03db4e49-6745-4174-b216-df4aeba320de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b973fec7672645f89791b8a917258130'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.100421 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-03db4e49-6745-4174-b216-df4aeba320de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b973fec7672645f89791b8a917258130'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.114774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-03db4e49-6745-4174-b216-df4aeba320de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b973fec7672645f89791b8a917258130'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.115587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-03db4e49-6745-4174-b216-df4aeba320de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b973fec7672645f89791b8a917258130'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.123002 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-03db4e49-6745-4174-b216-df4aeba320de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b973fec7672645f89791b8a917258130'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.138092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1329/2683] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:40 2022] DELETE /identity/v3/users/b973fec7672645f89791b8a917258130 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:41.441525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:41.442581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:41.470459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b848607-9bf0-4e82-a263-599b2b966b4f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:41.536004 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:41.536644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.536925 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.537200 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] PATH_INFO: `/v3/projects/d563bb222b6f4ed590a8d915ed00513b` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.538392 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d563bb222b6f4ed590a8d915ed00513b)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:41.540344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:41.593768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd563bb222b6f4ed590a8d915ed00513b', 'request_id': 'req-20aaf8cd-921f-4be7-8d22-db116f8ebf19'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.601348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd563bb222b6f4ed590a8d915ed00513b', 'request_id': 'req-20aaf8cd-921f-4be7-8d22-db116f8ebf19'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.608268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd563bb222b6f4ed590a8d915ed00513b', 'request_id': 'req-20aaf8cd-921f-4be7-8d22-db116f8ebf19'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.620359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] The token cache is being invalidate because project d563bb222b6f4ed590a8d915ed00513b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:41.620655 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.621303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-20aaf8cd-921f-4be7-8d22-db116f8ebf19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.622818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1355/2684] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:41 2022] DELETE /identity/v3/projects/d563bb222b6f4ed590a8d915ed00513b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:41.628197 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c6830-1849-4a0b-97e5-bcc712242278 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.628587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c6830-1849-4a0b-97e5-bcc712242278 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.628972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c6830-1849-4a0b-97e5-bcc712242278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.649046 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-9a6c6830-1849-4a0b-97e5-bcc712242278 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:41.650295 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9a6c6830-1849-4a0b-97e5-bcc712242278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:41.710963 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1330/2685] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:41.720807 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8928f-574b-4c34-b816-0616781b9ff0 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.721096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8928f-574b-4c34-b816-0616781b9ff0 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.721370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8928f-574b-4c34-b816-0616781b9ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.744022 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-04f8928f-574b-4c34-b816-0616781b9ff0 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:41.745256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-04f8928f-574b-4c34-b816-0616781b9ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:41.754810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1356/2686] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:41.759410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c6830-1849-4a0b-97e5-bcc712242278 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:41.770455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c6830-1849-4a0b-97e5-bcc712242278 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:41.775216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3db73-f199-4408-8c2a-8cbf5b94e7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:41.775826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3db73-f199-4408-8c2a-8cbf5b94e7ea admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.776105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3db73-f199-4408-8c2a-8cbf5b94e7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.776379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3db73-f199-4408-8c2a-8cbf5b94e7ea admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.777073 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3db73-f199-4408-8c2a-8cbf5b94e7ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:41.777374 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3db73-f199-4408-8c2a-8cbf5b94e7ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:41.779023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3db73-f199-4408-8c2a-8cbf5b94e7ea admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:41.792444 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1331/2687] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:41.797228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8928f-574b-4c34-b816-0616781b9ff0 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:41.806822 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8928f-574b-4c34-b816-0616781b9ff0 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:41.812371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3803e59-0c5e-4e27-aacc-92d58ec7e7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:41.812991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3803e59-0c5e-4e27-aacc-92d58ec7e7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.813271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3803e59-0c5e-4e27-aacc-92d58ec7e7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.813543 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3803e59-0c5e-4e27-aacc-92d58ec7e7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.814211 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3803e59-0c5e-4e27-aacc-92d58ec7e7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:41.816150 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3803e59-0c5e-4e27-aacc-92d58ec7e7f1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:41.846031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1357/2688] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:41 2022] POST /identity/v3/projects => generated 362 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:41.850597 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3db73-f199-4408-8c2a-8cbf5b94e7ea admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:41.863082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3db73-f199-4408-8c2a-8cbf5b94e7ea admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:41.891629 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:41.929012 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a380512-d565-4969-955b-e040c9f51b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:41.929631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a380512-d565-4969-955b-e040c9f51b0c admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.929912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a380512-d565-4969-955b-e040c9f51b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.930185 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a380512-d565-4969-955b-e040c9f51b0c admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.930857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a380512-d565-4969-955b-e040c9f51b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:41.932892 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a380512-d565-4969-955b-e040c9f51b0c admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:41.956608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1332/2689] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:41 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:41.960791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3803e59-0c5e-4e27-aacc-92d58ec7e7f1 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:41.967699 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:41.971862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3803e59-0c5e-4e27-aacc-92d58ec7e7f1 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:41.977769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c117e3-0018-47e6-a1b5-84bf077a1e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:41.978391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c117e3-0018-47e6-a1b5-84bf077a1e23 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.978963 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c117e3-0018-47e6-a1b5-84bf077a1e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.979401 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c117e3-0018-47e6-a1b5-84bf077a1e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.980203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c117e3-0018-47e6-a1b5-84bf077a1e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:41.982001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c117e3-0018-47e6-a1b5-84bf077a1e23 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:41.992633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1358/2690] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:41 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:41.997412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a380512-d565-4969-955b-e040c9f51b0c admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:42.008925 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a380512-d565-4969-955b-e040c9f51b0c admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:42.014653 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f61b02-e438-4c48-9cb6-dfc4c6883e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:42.015301 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f61b02-e438-4c48-9cb6-dfc4c6883e48 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.015587 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f61b02-e438-4c48-9cb6-dfc4c6883e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.015859 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f61b02-e438-4c48-9cb6-dfc4c6883e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.016563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f61b02-e438-4c48-9cb6-dfc4c6883e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:42.018166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f61b02-e438-4c48-9cb6-dfc4c6883e48 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:42.029105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1333/2691] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:41 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:42.035077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c117e3-0018-47e6-a1b5-84bf077a1e23 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:42.045667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c117e3-0018-47e6-a1b5-84bf077a1e23 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:42.050723 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af017c-dbf4-4033-b1b8-3e1512cfe20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:42.051421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af017c-dbf4-4033-b1b8-3e1512cfe20b admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.051724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af017c-dbf4-4033-b1b8-3e1512cfe20b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.051997 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af017c-dbf4-4033-b1b8-3e1512cfe20b admin admin] PATH_INFO: `/v3/projects/b0e8f0c3e44f4e74a6fdc2ffb05705c7/users/8b168e6ad2d946db924878067152cd8b/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.068680 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af017c-dbf4-4033-b1b8-3e1512cfe20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e8f0c3e44f4e74a6fdc2ffb05705c7, user_id=8b168e6ad2d946db924878067152cd8b, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:42.071372 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af017c-dbf4-4033-b1b8-3e1512cfe20b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:42.087141 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1359/2692] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:42 2022] PUT /identity/v3/projects/b0e8f0c3e44f4e74a6fdc2ffb05705c7/users/8b168e6ad2d946db924878067152cd8b/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:03:42.098710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e1d9a-aca4-41ac-baa2-6ebff172e8c0 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.099290 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e1d9a-aca4-41ac-baa2-6ebff172e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.099388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e1d9a-aca4-41ac-baa2-6ebff172e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.131298 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-bb0e1d9a-aca4-41ac-baa2-6ebff172e8c0 None None] MFA Rules not processed for user `8b168e6ad2d946db924878067152cd8b`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:42.132527 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-bb0e1d9a-aca4-41ac-baa2-6ebff172e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:42.207645 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1334/2693] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:42.240633 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af017c-dbf4-4033-b1b8-3e1512cfe20b admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:42.242409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-28af017c-dbf4-4033-b1b8-3e1512cfe20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:42.303345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af017c-dbf4-4033-b1b8-3e1512cfe20b admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:42.307569 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a4dc0-fe7b-448a-9356-d603d4e5d2f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:42.308187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a4dc0-fe7b-448a-9356-d603d4e5d2f9 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.308463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a4dc0-fe7b-448a-9356-d603d4e5d2f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.308731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a4dc0-fe7b-448a-9356-d603d4e5d2f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.318505 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a4dc0-fe7b-448a-9356-d603d4e5d2f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:42.319959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a4dc0-fe7b-448a-9356-d603d4e5d2f9 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:42.329217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1360/2694] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:42.352329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e1d9a-aca4-41ac-baa2-6ebff172e8c0 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:42.428772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e1d9a-aca4-41ac-baa2-6ebff172e8c0 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:42.433586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:42.434213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.434519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.434795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] PATH_INFO: `/v3/users/8b168e6ad2d946db924878067152cd8b` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.436004 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b168e6ad2d946db924878067152cd8b)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:42.438364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:42.488206 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:42.498815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b168e6ad2d946db924878067152cd8b'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.499844 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b168e6ad2d946db924878067152cd8b'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.514165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b168e6ad2d946db924878067152cd8b'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.514933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b168e6ad2d946db924878067152cd8b'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.522081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b168e6ad2d946db924878067152cd8b'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.537486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1335/2695] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:42 2022] DELETE /identity/v3/users/8b168e6ad2d946db924878067152cd8b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:42.543263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3014-018e-4964-9b45-87af3f5ecb31 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.543752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3014-018e-4964-9b45-87af3f5ecb31 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.543972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3014-018e-4964-9b45-87af3f5ecb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.569735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-926c3014-018e-4964-9b45-87af3f5ecb31 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:42.571001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-926c3014-018e-4964-9b45-87af3f5ecb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:42.631073 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1361/2696] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:42.641524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:42.643294 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:42.715355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d609f2-403a-43cd-a717-2d6b06904234 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:42.719523 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df902e1d-7395-4abf-b3ac-09a67a423f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:42.720143 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df902e1d-7395-4abf-b3ac-09a67a423f6f service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.720434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df902e1d-7395-4abf-b3ac-09a67a423f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.720718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df902e1d-7395-4abf-b3ac-09a67a423f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.731081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df902e1d-7395-4abf-b3ac-09a67a423f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:42.732528 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df902e1d-7395-4abf-b3ac-09a67a423f6f service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:42.747140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1336/2697] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:42.808511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c3014-018e-4964-9b45-87af3f5ecb31 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:42.810292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-926c3014-018e-4964-9b45-87af3f5ecb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:42.825245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c3014-018e-4964-9b45-87af3f5ecb31 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:42.830873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:42.831648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.831999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.832362 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] PATH_INFO: `/v3/users/5cc3ff80eab64da29d3c1e1f10683a55` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.833813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc3ff80eab64da29d3c1e1f10683a55)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:42.835873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:42.887818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc3ff80eab64da29d3c1e1f10683a55'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.900966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc3ff80eab64da29d3c1e1f10683a55'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.909777 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc3ff80eab64da29d3c1e1f10683a55'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.910602 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc3ff80eab64da29d3c1e1f10683a55'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.911400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc3ff80eab64da29d3c1e1f10683a55'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.916143 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:42.932902 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1362/2698] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:42 2022] DELETE /identity/v3/users/5cc3ff80eab64da29d3c1e1f10683a55 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:42.937725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4ff2a-3e45-4042-841a-c7dcb5c460e0 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.938083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4ff2a-3e45-4042-841a-c7dcb5c460e0 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.938354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4ff2a-3e45-4042-841a-c7dcb5c460e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.958771 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-65c4ff2a-3e45-4042-841a-c7dcb5c460e0 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:42.960174 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-65c4ff2a-3e45-4042-841a-c7dcb5c460e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:43.026447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1337/2699] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:43.036975 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.038686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:43.053496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4ff2a-3e45-4042-841a-c7dcb5c460e0 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.054919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-65c4ff2a-3e45-4042-841a-c7dcb5c460e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:43.069425 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4ff2a-3e45-4042-841a-c7dcb5c460e0 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.074353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.075032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.075315 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.075723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] PATH_INFO: `/v3/projects/b0e8f0c3e44f4e74a6fdc2ffb05705c7` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.077848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e8f0c3e44f4e74a6fdc2ffb05705c7)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:43.080125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.108038 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302669e-ba8a-4248-9b4e-cb41ebf06de6 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.111909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dd8b4-73cb-44c3-b07a-29070e3ba7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.112516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dd8b4-73cb-44c3-b07a-29070e3ba7db service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.112811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dd8b4-73cb-44c3-b07a-29070e3ba7db service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.113061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dd8b4-73cb-44c3-b07a-29070e3ba7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.122565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dd8b4-73cb-44c3-b07a-29070e3ba7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:43.124194 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dd8b4-73cb-44c3-b07a-29070e3ba7db service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.130279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e8f0c3e44f4e74a6fdc2ffb05705c7', 'request_id': 'req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:43.134028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1363/2700] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:43.136614 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e8f0c3e44f4e74a6fdc2ffb05705c7', 'request_id': 'req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:43.137986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:43.143861 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e8f0c3e44f4e74a6fdc2ffb05705c7', 'request_id': 'req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:43.158707 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] The token cache is being invalidate because project b0e8f0c3e44f4e74a6fdc2ffb05705c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:43.159034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:43.159685 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a5c113e7-ebed-4c16-b874-c7ebcd6c9536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:43.161259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1338/2701] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:43 2022] DELETE /identity/v3/projects/b0e8f0c3e44f4e74a6fdc2ffb05705c7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:03:43.446203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dd8b4-73cb-44c3-b07a-29070e3ba7db service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.447878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-1a3dd8b4-73cb-44c3-b07a-29070e3ba7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:43.462179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dd8b4-73cb-44c3-b07a-29070e3ba7db service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.523421 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.524080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.524364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.524623 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] PATH_INFO: `/v3/projects/1f617053e1d74f5f82e59522a6c94ceb` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.525810 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f617053e1d74f5f82e59522a6c94ceb)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:43.527803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.578227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f617053e1d74f5f82e59522a6c94ceb', 'request_id': 'req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:43.586734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f617053e1d74f5f82e59522a6c94ceb', 'request_id': 'req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:43.593521 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f617053e1d74f5f82e59522a6c94ceb', 'request_id': 'req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:43.605862 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] The token cache is being invalidate because project 1f617053e1d74f5f82e59522a6c94ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:43.606145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:43.606818 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-da88ddaa-ca7c-4e7d-925c-1d453d0a444e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:43.608485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1364/2702] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:43 2022] DELETE /identity/v3/projects/1f617053e1d74f5f82e59522a6c94ceb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:43.613630 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197ee31-01bf-42bb-a5bc-b2e0e7da8969 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.613919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197ee31-01bf-42bb-a5bc-b2e0e7da8969 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.614196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197ee31-01bf-42bb-a5bc-b2e0e7da8969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.634438 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1197ee31-01bf-42bb-a5bc-b2e0e7da8969 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:43.635705 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1197ee31-01bf-42bb-a5bc-b2e0e7da8969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:43.698927 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1339/2703] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:43.707224 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eea316-42c6-4b32-888d-2b116335d28b None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.707501 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eea316-42c6-4b32-888d-2b116335d28b None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.707774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eea316-42c6-4b32-888d-2b116335d28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.729767 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a7eea316-42c6-4b32-888d-2b116335d28b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:43.731067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a7eea316-42c6-4b32-888d-2b116335d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:43.740714 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1365/2704] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:43.745685 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197ee31-01bf-42bb-a5bc-b2e0e7da8969 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.757052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197ee31-01bf-42bb-a5bc-b2e0e7da8969 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.765519 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ddf9-a0c1-48ec-b480-2ec4ce1e91b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.766140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ddf9-a0c1-48ec-b480-2ec4ce1e91b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.766424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ddf9-a0c1-48ec-b480-2ec4ce1e91b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.766698 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ddf9-a0c1-48ec-b480-2ec4ce1e91b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.767441 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ddf9-a0c1-48ec-b480-2ec4ce1e91b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:43.767747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ddf9-a0c1-48ec-b480-2ec4ce1e91b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:43.769368 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ddf9-a0c1-48ec-b480-2ec4ce1e91b7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.781750 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1340/2705] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:43.788152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eea316-42c6-4b32-888d-2b116335d28b None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.798631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eea316-42c6-4b32-888d-2b116335d28b None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.804453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633b6be-e7ca-47d4-abd6-727933598fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.805092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633b6be-e7ca-47d4-abd6-727933598fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.805374 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633b6be-e7ca-47d4-abd6-727933598fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.805637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633b6be-e7ca-47d4-abd6-727933598fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.806306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633b6be-e7ca-47d4-abd6-727933598fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:43.808249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633b6be-e7ca-47d4-abd6-727933598fc0 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.818886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:43.841234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1366/2706] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:43 2022] POST /identity/v3/projects => generated 374 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:43.845699 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ddf9-a0c1-48ec-b480-2ec4ce1e91b7 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.855691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ddf9-a0c1-48ec-b480-2ec4ce1e91b7 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.913886 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10e11a-0cc1-406e-bcad-27be558263cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.914505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10e11a-0cc1-406e-bcad-27be558263cb admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.914791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10e11a-0cc1-406e-bcad-27be558263cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.915112 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10e11a-0cc1-406e-bcad-27be558263cb admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.915776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10e11a-0cc1-406e-bcad-27be558263cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:43.917708 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10e11a-0cc1-406e-bcad-27be558263cb admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.941132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1341/2707] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:43 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:43.945690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633b6be-e7ca-47d4-abd6-727933598fc0 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.956677 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633b6be-e7ca-47d4-abd6-727933598fc0 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.962546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0d8d5-69d7-44d5-951e-8dc58f64809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.963202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0d8d5-69d7-44d5-951e-8dc58f64809b admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.963481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0d8d5-69d7-44d5-951e-8dc58f64809b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.963751 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0d8d5-69d7-44d5-951e-8dc58f64809b admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.964479 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0d8d5-69d7-44d5-951e-8dc58f64809b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:43.966080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0d8d5-69d7-44d5-951e-8dc58f64809b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.976924 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1367/2708] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:43 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:43.981001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10e11a-0cc1-406e-bcad-27be558263cb admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.992777 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10e11a-0cc1-406e-bcad-27be558263cb admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.998613 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b2199-d70f-4377-93e6-1fa403fdb0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.999262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b2199-d70f-4377-93e6-1fa403fdb0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.999537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b2199-d70f-4377-93e6-1fa403fdb0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.999806 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b2199-d70f-4377-93e6-1fa403fdb0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.000544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b2199-d70f-4377-93e6-1fa403fdb0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.002153 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b2199-d70f-4377-93e6-1fa403fdb0b1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:44.013467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1342/2709] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:43 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:44.017845 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0d8d5-69d7-44d5-951e-8dc58f64809b admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:44.028007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0d8d5-69d7-44d5-951e-8dc58f64809b admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:44.032891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc1925-63b4-45d8-b395-74f42582036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:44.033551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1925-63b4-45d8-b395-74f42582036e admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.033834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1925-63b4-45d8-b395-74f42582036e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.034090 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1925-63b4-45d8-b395-74f42582036e admin admin] PATH_INFO: `/v3/projects/78623007f4b5431ca9af5824ca01c448/users/bba0c234caf54cdeb0a405cc88083028/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.048872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc1925-63b4-45d8-b395-74f42582036e admin admin] RBAC: Authorizing `identity:create_grant(project_id=78623007f4b5431ca9af5824ca01c448, user_id=bba0c234caf54cdeb0a405cc88083028, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.051568 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc1925-63b4-45d8-b395-74f42582036e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:44.066150 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1368/2710] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:44 2022] PUT /identity/v3/projects/78623007f4b5431ca9af5824ca01c448/users/bba0c234caf54cdeb0a405cc88083028/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:44.076891 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10670d-f5e4-4727-a613-8e8e7f9f49b5 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.077229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10670d-f5e4-4727-a613-8e8e7f9f49b5 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.077506 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10670d-f5e4-4727-a613-8e8e7f9f49b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.107352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-8d10670d-f5e4-4727-a613-8e8e7f9f49b5 None None] MFA Rules not processed for user `bba0c234caf54cdeb0a405cc88083028`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:44.108540 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8d10670d-f5e4-4727-a613-8e8e7f9f49b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:44.149952 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:44.178775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1343/2711] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:44.192031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc1925-63b4-45d8-b395-74f42582036e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:44.194268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-98dc1925-63b4-45d8-b395-74f42582036e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:44.253551 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc1925-63b4-45d8-b395-74f42582036e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:44.257936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b12aa-3b8a-48b0-8bfe-b3fce4f00708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:44.258553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b12aa-3b8a-48b0-8bfe-b3fce4f00708 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.258827 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b12aa-3b8a-48b0-8bfe-b3fce4f00708 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.259139 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b12aa-3b8a-48b0-8bfe-b3fce4f00708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.268361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b12aa-3b8a-48b0-8bfe-b3fce4f00708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.269791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b12aa-3b8a-48b0-8bfe-b3fce4f00708 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:44.278933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1369/2712] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:44.304643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10670d-f5e4-4727-a613-8e8e7f9f49b5 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:44.371440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10670d-f5e4-4727-a613-8e8e7f9f49b5 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:44.377479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:44.378123 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.378406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.378680 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] PATH_INFO: `/v3/users/bba0c234caf54cdeb0a405cc88083028` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.380044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba0c234caf54cdeb0a405cc88083028)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.381973 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:44.433364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba0c234caf54cdeb0a405cc88083028'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:44.434029 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba0c234caf54cdeb0a405cc88083028'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:44.446816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba0c234caf54cdeb0a405cc88083028'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:44.447546 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba0c234caf54cdeb0a405cc88083028'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:44.455239 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba0c234caf54cdeb0a405cc88083028'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:44.476455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1344/2713] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:44 2022] DELETE /identity/v3/users/bba0c234caf54cdeb0a405cc88083028 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:44.481210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db96b9b-712e-499d-a7c9-755af62a1ffd None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.481483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db96b9b-712e-499d-a7c9-755af62a1ffd None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.481756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db96b9b-712e-499d-a7c9-755af62a1ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.501386 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-7db96b9b-712e-499d-a7c9-755af62a1ffd None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:44.502690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7db96b9b-712e-499d-a7c9-755af62a1ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:44.572956 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1370/2714] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:44.592367 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:44.593917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:44.652844 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a96346-c872-49d8-9730-bf1bbbc4f417 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:44.657038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa3807-821c-4736-a92a-b012405344e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:44.657652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa3807-821c-4736-a92a-b012405344e7 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.657933 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa3807-821c-4736-a92a-b012405344e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.658204 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa3807-821c-4736-a92a-b012405344e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.668329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa3807-821c-4736-a92a-b012405344e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.669785 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa3807-821c-4736-a92a-b012405344e7 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:44.674870 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:44.680098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1345/2715] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:44.961945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db96b9b-712e-499d-a7c9-755af62a1ffd None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:44.963529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7db96b9b-712e-499d-a7c9-755af62a1ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:44.978179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db96b9b-712e-499d-a7c9-755af62a1ffd None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:44.984546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:44.985043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.985294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.985612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] PATH_INFO: `/v3/projects/78623007f4b5431ca9af5824ca01c448` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.986800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78623007f4b5431ca9af5824ca01c448)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.988759 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:45.057683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78623007f4b5431ca9af5824ca01c448', 'request_id': 'req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:45.061688 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:45.069245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78623007f4b5431ca9af5824ca01c448', 'request_id': 'req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:45.077076 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78623007f4b5431ca9af5824ca01c448', 'request_id': 'req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:45.089169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] The token cache is being invalidate because project 78623007f4b5431ca9af5824ca01c448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:45.089450 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:45.090094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-e5fc83a7-6aa9-42c5-b577-6a9b169c8e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:45.091650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1371/2716] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:44 2022] DELETE /identity/v3/projects/78623007f4b5431ca9af5824ca01c448 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:45.096826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90076a-0d62-4783-a71c-403b2bf710ca None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.097114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90076a-0d62-4783-a71c-403b2bf710ca None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.097387 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90076a-0d62-4783-a71c-403b2bf710ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.118790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-3f90076a-0d62-4783-a71c-403b2bf710ca None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:45.120023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3f90076a-0d62-4783-a71c-403b2bf710ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:45.191003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1346/2717] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:45.200313 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833b3ff-3f50-491e-9f44-b744509ea038 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.200629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833b3ff-3f50-491e-9f44-b744509ea038 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.200968 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833b3ff-3f50-491e-9f44-b744509ea038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.221426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-4833b3ff-3f50-491e-9f44-b744509ea038 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:45.222735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-4833b3ff-3f50-491e-9f44-b744509ea038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:45.231517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1372/2718] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:45.236327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90076a-0d62-4783-a71c-403b2bf710ca None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:45.246471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90076a-0d62-4783-a71c-403b2bf710ca None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:45.254109 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ffb0e-7433-48db-99f9-952771e8413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:45.254731 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ffb0e-7433-48db-99f9-952771e8413b admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.255046 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ffb0e-7433-48db-99f9-952771e8413b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.255320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ffb0e-7433-48db-99f9-952771e8413b admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.256054 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ffb0e-7433-48db-99f9-952771e8413b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:45.256356 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ffb0e-7433-48db-99f9-952771e8413b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:45.257965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ffb0e-7433-48db-99f9-952771e8413b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:45.272224 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1347/2719] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:45.277098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833b3ff-3f50-491e-9f44-b744509ea038 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:45.291152 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833b3ff-3f50-491e-9f44-b744509ea038 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:45.298458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2671c-7ca8-4828-a42c-38a26f36a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:45.299169 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2671c-7ca8-4828-a42c-38a26f36a5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.299451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2671c-7ca8-4828-a42c-38a26f36a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.299720 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2671c-7ca8-4828-a42c-38a26f36a5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.300390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2671c-7ca8-4828-a42c-38a26f36a5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:45.302294 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2671c-7ca8-4828-a42c-38a26f36a5c2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:45.330907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1373/2720] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:45 2022] POST /identity/v3/projects => generated 384 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:45.335823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ffb0e-7433-48db-99f9-952771e8413b admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:45.352005 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ffb0e-7433-48db-99f9-952771e8413b admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:45.413930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985ede2-509d-4cc2-b07c-90ca53e4837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:45.414572 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ede2-509d-4cc2-b07c-90ca53e4837b admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.414859 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ede2-509d-4cc2-b07c-90ca53e4837b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.415158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ede2-509d-4cc2-b07c-90ca53e4837b admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.415817 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985ede2-509d-4cc2-b07c-90ca53e4837b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:45.417727 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985ede2-509d-4cc2-b07c-90ca53e4837b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:45.440848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1348/2721] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:45 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:45.445487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2671c-7ca8-4828-a42c-38a26f36a5c2 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:45.457117 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2671c-7ca8-4828-a42c-38a26f36a5c2 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:45.462980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a5fda-831d-4ef6-b6d6-b70d02c1faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:45.463612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5fda-831d-4ef6-b6d6-b70d02c1faa5 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.463891 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5fda-831d-4ef6-b6d6-b70d02c1faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.464162 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5fda-831d-4ef6-b6d6-b70d02c1faa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.464865 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a5fda-831d-4ef6-b6d6-b70d02c1faa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:45.466480 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a5fda-831d-4ef6-b6d6-b70d02c1faa5 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:45.476860 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1374/2722] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:45 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:45.481015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985ede2-509d-4cc2-b07c-90ca53e4837b admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:45.491681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985ede2-509d-4cc2-b07c-90ca53e4837b admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:45.497426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e961bc-ff2b-428e-802c-030244ba7953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:45.498047 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e961bc-ff2b-428e-802c-030244ba7953 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.498327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e961bc-ff2b-428e-802c-030244ba7953 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.498789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e961bc-ff2b-428e-802c-030244ba7953 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.499982 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e961bc-ff2b-428e-802c-030244ba7953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:45.501579 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e961bc-ff2b-428e-802c-030244ba7953 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:45.514358 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1349/2723] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:45 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:45.518883 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a5fda-831d-4ef6-b6d6-b70d02c1faa5 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:45.530380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a5fda-831d-4ef6-b6d6-b70d02c1faa5 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:45.536735 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc651f6-b3c0-4a17-8b88-d728ec802606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:45.537404 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc651f6-b3c0-4a17-8b88-d728ec802606 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.537686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc651f6-b3c0-4a17-8b88-d728ec802606 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.537961 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc651f6-b3c0-4a17-8b88-d728ec802606 admin admin] PATH_INFO: `/v3/projects/ff52332a4a65491cab25ae4a25dc4a1e/users/e2fbcc9757194e75a93719e34158a020/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.554209 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc651f6-b3c0-4a17-8b88-d728ec802606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff52332a4a65491cab25ae4a25dc4a1e, user_id=e2fbcc9757194e75a93719e34158a020, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:45.556943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc651f6-b3c0-4a17-8b88-d728ec802606 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:45.576917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1375/2724] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:45 2022] PUT /identity/v3/projects/ff52332a4a65491cab25ae4a25dc4a1e/users/e2fbcc9757194e75a93719e34158a020/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:45.584116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714668-e998-46a7-a49b-b734b9bf0d33 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.584407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714668-e998-46a7-a49b-b734b9bf0d33 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.584687 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714668-e998-46a7-a49b-b734b9bf0d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.605946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-07714668-e998-46a7-a49b-b734b9bf0d33 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:45.607322 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-07714668-e998-46a7-a49b-b734b9bf0d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:45.673781 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1350/2725] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:45.685517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc651f6-b3c0-4a17-8b88-d728ec802606 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:45.687969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-6cc651f6-b3c0-4a17-8b88-d728ec802606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:45.757528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc651f6-b3c0-4a17-8b88-d728ec802606 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:45.763957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63543ba-4d93-4975-9592-25d735917290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:45.764852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63543ba-4d93-4975-9592-25d735917290 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.765143 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63543ba-4d93-4975-9592-25d735917290 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.765417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63543ba-4d93-4975-9592-25d735917290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.776039 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63543ba-4d93-4975-9592-25d735917290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:45.777453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63543ba-4d93-4975-9592-25d735917290 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:45.787872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1376/2726] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:46.426969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e5224-519e-4745-a9e4-e3e44f347593 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:46.427496 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e5224-519e-4745-a9e4-e3e44f347593 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:46.427633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e5224-519e-4745-a9e4-e3e44f347593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:46.440926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:46.456424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-1d8e5224-519e-4745-a9e4-e3e44f347593 None None] MFA Rules not processed for user `e2fbcc9757194e75a93719e34158a020`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:46.457763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1d8e5224-519e-4745-a9e4-e3e44f347593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:46.527490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1351/2727] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:46.538482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63543ba-4d93-4975-9592-25d735917290 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:46.539943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-c63543ba-4d93-4975-9592-25d735917290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:46.614523 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63543ba-4d93-4975-9592-25d735917290 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:46.618307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8048ba3-e5e2-4cd7-ae63-7185a688d361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:46.618930 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8048ba3-e5e2-4cd7-ae63-7185a688d361 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:46.619245 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8048ba3-e5e2-4cd7-ae63-7185a688d361 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:46.619522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8048ba3-e5e2-4cd7-ae63-7185a688d361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:46.629203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8048ba3-e5e2-4cd7-ae63-7185a688d361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:46.630648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8048ba3-e5e2-4cd7-ae63-7185a688d361 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:46.643937 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1377/2728] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:48.015734 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8922ecd-470d-4c56-aeb2-54f938517e1e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.016296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8922ecd-470d-4c56-aeb2-54f938517e1e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.016296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8922ecd-470d-4c56-aeb2-54f938517e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.045919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b8922ecd-470d-4c56-aeb2-54f938517e1e None None] MFA Rules not processed for user `e2fbcc9757194e75a93719e34158a020`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:48.047212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b8922ecd-470d-4c56-aeb2-54f938517e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:48.055494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1352/2729] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:48.102819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8048ba3-e5e2-4cd7-ae63-7185a688d361 service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:48.104341 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d8048ba3-e5e2-4cd7-ae63-7185a688d361 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:48.133133 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:48.167389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8048ba3-e5e2-4cd7-ae63-7185a688d361 service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:48.172055 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004bc73-cf9e-4e67-86ca-0e5ced8a9155 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1cabb41d38a40acb7d41c169cc90cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:48.172676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004bc73-cf9e-4e67-86ca-0e5ced8a9155 service glance] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.172955 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004bc73-cf9e-4e67-86ca-0e5ced8a9155 service glance] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.173222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004bc73-cf9e-4e67-86ca-0e5ced8a9155 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.175260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7004bc73-cf9e-4e67-86ca-0e5ced8a9155 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:48.266430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004bc73-cf9e-4e67-86ca-0e5ced8a9155 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:48.267988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004bc73-cf9e-4e67-86ca-0e5ced8a9155 service glance] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:48.292017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1378/2730] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:48.858059 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8922ecd-470d-4c56-aeb2-54f938517e1e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:48.867913 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8922ecd-470d-4c56-aeb2-54f938517e1e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:48.871675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f018a6-4489-4139-9822-008c72980171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:48.872286 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f018a6-4489-4139-9822-008c72980171 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.872573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f018a6-4489-4139-9822-008c72980171 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.872841 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f018a6-4489-4139-9822-008c72980171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.874855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-96f018a6-4489-4139-9822-008c72980171 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:48.889398 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f018a6-4489-4139-9822-008c72980171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:48.890829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f018a6-4489-4139-9822-008c72980171 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:48.902888 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1353/2731] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:58.289276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=53 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:58.899175 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=38 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:17.453275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004bc73-cf9e-4e67-86ca-0e5ced8a9155 service glance] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.454853 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7004bc73-cf9e-4e67-86ca-0e5ced8a9155 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:17.466409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004bc73-cf9e-4e67-86ca-0e5ced8a9155 service glance] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.471160 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2e98a-98d1-4496-a2c0-f44679783998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.471806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e98a-98d1-4496-a2c0-f44679783998 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.472086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e98a-98d1-4496-a2c0-f44679783998 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.472360 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e98a-98d1-4496-a2c0-f44679783998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.474228 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7ae2e98a-98d1-4496-a2c0-f44679783998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:17.484575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2e98a-98d1-4496-a2c0-f44679783998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.486042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2e98a-98d1-4496-a2c0-f44679783998 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.494655 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1379/2732] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:22.528911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485afc6e-9f3c-400e-bb62-227e415107ba None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:22.529437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485afc6e-9f3c-400e-bb62-227e415107ba None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:22.529437 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485afc6e-9f3c-400e-bb62-227e415107ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:22.551030 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-485afc6e-9f3c-400e-bb62-227e415107ba None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:22.552266 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-485afc6e-9f3c-400e-bb62-227e415107ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:22.562259 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1354/2733] 10.222.0.134 () {58 vars in 1021 bytes} [Mon Aug 1 17:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:22.588528 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2e98a-98d1-4496-a2c0-f44679783998 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:22.590058 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7ae2e98a-98d1-4496-a2c0-f44679783998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:22.608168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2e98a-98d1-4496-a2c0-f44679783998 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:22.614601 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11f560-a8e0-48c4-bd7a-913ca56c62e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:22.615291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11f560-a8e0-48c4-bd7a-913ca56c62e8 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:22.615634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11f560-a8e0-48c4-bd7a-913ca56c62e8 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:22.615910 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11f560-a8e0-48c4-bd7a-913ca56c62e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:22.624635 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11f560-a8e0-48c4-bd7a-913ca56c62e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:22.626227 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11f560-a8e0-48c4-bd7a-913ca56c62e8 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:22.635682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1380/2734] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:25.679803 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e779f3-84e2-4a5f-87dd-4c23c3279fce None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.680660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e779f3-84e2-4a5f-87dd-4c23c3279fce None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.680660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e779f3-84e2-4a5f-87dd-4c23c3279fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.703851 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-05e779f3-84e2-4a5f-87dd-4c23c3279fce None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:25.705098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-05e779f3-84e2-4a5f-87dd-4c23c3279fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:25.714275 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1355/2735] 10.222.0.134 () {58 vars in 1021 bytes} [Mon Aug 1 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:25.740511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11f560-a8e0-48c4-bd7a-913ca56c62e8 service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:25.742158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-fe11f560-a8e0-48c4-bd7a-913ca56c62e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:25.757083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11f560-a8e0-48c4-bd7a-913ca56c62e8 service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:25.763417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8dee6-958d-49b1-a8d4-6c14f0661b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:25.764044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8dee6-958d-49b1-a8d4-6c14f0661b78 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.764323 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8dee6-958d-49b1-a8d4-6c14f0661b78 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.764593 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8dee6-958d-49b1-a8d4-6c14f0661b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.773750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8dee6-958d-49b1-a8d4-6c14f0661b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:25.775426 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8dee6-958d-49b1-a8d4-6c14f0661b78 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:25.786598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1381/2736] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:29.942987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd5fcf-fe56-4b60-ade4-f7f8ea9a4371 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:29.943580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd5fcf-fe56-4b60-ade4-f7f8ea9a4371 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:29.943580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd5fcf-fe56-4b60-ade4-f7f8ea9a4371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:29.964249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b0cd5fcf-fe56-4b60-ade4-f7f8ea9a4371 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:29.965644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b0cd5fcf-fe56-4b60-ade4-f7f8ea9a4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:29.977567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1356/2737] 10.222.0.134 () {58 vars in 1021 bytes} [Mon Aug 1 17:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:29.999487 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8dee6-958d-49b1-a8d4-6c14f0661b78 service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:30.011302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8dee6-958d-49b1-a8d4-6c14f0661b78 service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:30.018721 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf09378-b5bb-44a8-82cc-2aa83855ff6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:30.019371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09378-b5bb-44a8-82cc-2aa83855ff6c service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:30.019647 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09378-b5bb-44a8-82cc-2aa83855ff6c service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:30.019923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09378-b5bb-44a8-82cc-2aa83855ff6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:30.029440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf09378-b5bb-44a8-82cc-2aa83855ff6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:30.031049 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf09378-b5bb-44a8-82cc-2aa83855ff6c service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:30.041121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1382/2738] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:33.030482 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4fea5-42b1-4993-8ecc-dcdc09a7b59c None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:33.031087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4fea5-42b1-4993-8ecc-dcdc09a7b59c None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:33.031087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4fea5-42b1-4993-8ecc-dcdc09a7b59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:33.055192 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-fde4fea5-42b1-4993-8ecc-dcdc09a7b59c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:33.056407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fde4fea5-42b1-4993-8ecc-dcdc09a7b59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:33.066050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1357/2739] 10.222.0.134 () {58 vars in 1021 bytes} [Mon Aug 1 17:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:33.090514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf09378-b5bb-44a8-82cc-2aa83855ff6c service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:33.102409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf09378-b5bb-44a8-82cc-2aa83855ff6c service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:33.109792 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736352-628c-48a5-a387-ab66a76788db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:33.110397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736352-628c-48a5-a387-ab66a76788db service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:33.110676 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736352-628c-48a5-a387-ab66a76788db service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:33.110972 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736352-628c-48a5-a387-ab66a76788db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:33.120878 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5736352-628c-48a5-a387-ab66a76788db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:33.122506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5736352-628c-48a5-a387-ab66a76788db service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:33.132213 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1383/2740] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:37.249828 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1976de-9baa-48e2-8c0a-ac11360d5991 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:37.250396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1976de-9baa-48e2-8c0a-ac11360d5991 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:37.250396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1976de-9baa-48e2-8c0a-ac11360d5991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.273775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-8e1976de-9baa-48e2-8c0a-ac11360d5991 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:37.275087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8e1976de-9baa-48e2-8c0a-ac11360d5991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:37.286542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1358/2741] 10.222.0.134 () {58 vars in 1021 bytes} [Mon Aug 1 17:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:37.313322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736352-628c-48a5-a387-ab66a76788db service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:37.332123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736352-628c-48a5-a387-ab66a76788db service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:37.340985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a435912-ee6c-4ad0-bbcc-e590317c34a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:37.341737 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a435912-ee6c-4ad0-bbcc-e590317c34a2 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:37.342028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a435912-ee6c-4ad0-bbcc-e590317c34a2 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:37.342272 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a435912-ee6c-4ad0-bbcc-e590317c34a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.351678 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a435912-ee6c-4ad0-bbcc-e590317c34a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:37.353268 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a435912-ee6c-4ad0-bbcc-e590317c34a2 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:37.364068 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1384/2742] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:41.485446 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f32952-ef72-4dbd-8432-b4564ca44a96 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:41.486353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f32952-ef72-4dbd-8432-b4564ca44a96 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:41.486353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f32952-ef72-4dbd-8432-b4564ca44a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:41.514434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-35f32952-ef72-4dbd-8432-b4564ca44a96 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:41.516436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-35f32952-ef72-4dbd-8432-b4564ca44a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:41.529971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1359/2743] 10.222.0.134 () {58 vars in 1021 bytes} [Mon Aug 1 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:41.562288 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a435912-ee6c-4ad0-bbcc-e590317c34a2 service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:41.573825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=37 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:41.581531 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a435912-ee6c-4ad0-bbcc-e590317c34a2 service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:41.589300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03366e2c-0b76-4623-b08f-33f190bf5272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:41.590088 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03366e2c-0b76-4623-b08f-33f190bf5272 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:41.590370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03366e2c-0b76-4623-b08f-33f190bf5272 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:41.590672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03366e2c-0b76-4623-b08f-33f190bf5272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:41.604720 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03366e2c-0b76-4623-b08f-33f190bf5272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:41.606325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03366e2c-0b76-4623-b08f-33f190bf5272 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:41.618669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1385/2744] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:51.504032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=18 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:51.613135 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:52.979996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f32952-ef72-4dbd-8432-b4564ca44a96 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:52.994513 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f32952-ef72-4dbd-8432-b4564ca44a96 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:53.000406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e27c7-58d9-4942-8917-38fbc7a16c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:53.001034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e27c7-58d9-4942-8917-38fbc7a16c3f service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:53.001311 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e27c7-58d9-4942-8917-38fbc7a16c3f service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:53.001575 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e27c7-58d9-4942-8917-38fbc7a16c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:53.003686 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1e9e27c7-58d9-4942-8917-38fbc7a16c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:53.017191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e27c7-58d9-4942-8917-38fbc7a16c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:53.018807 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e27c7-58d9-4942-8917-38fbc7a16c3f service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:53.030119 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1360/2745] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:58.075546 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda360b6-5042-40bc-9d33-df99df140fd4 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.076146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda360b6-5042-40bc-9d33-df99df140fd4 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.076146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda360b6-5042-40bc-9d33-df99df140fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.096780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-fda360b6-5042-40bc-9d33-df99df140fd4 None None] MFA Rules not processed for user `e2fbcc9757194e75a93719e34158a020`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:58.098007 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-fda360b6-5042-40bc-9d33-df99df140fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:58.106640 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1386/2746] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:04:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:58.690267 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e27c7-58d9-4942-8917-38fbc7a16c3f service nova] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:58.691799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1e9e27c7-58d9-4942-8917-38fbc7a16c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:58.764339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e27c7-58d9-4942-8917-38fbc7a16c3f service nova] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:58.769481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d5526-5c58-4775-8a4e-e0531315cb8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:58.770098 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5526-5c58-4775-8a4e-e0531315cb8f service placement] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.770376 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5526-5c58-4775-8a4e-e0531315cb8f service placement] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.770651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5526-5c58-4775-8a4e-e0531315cb8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.772744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f56d5526-5c58-4775-8a4e-e0531315cb8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:58.784291 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d5526-5c58-4775-8a4e-e0531315cb8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:58.785848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d5526-5c58-4775-8a4e-e0531315cb8f service placement] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:58.795938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1361/2747] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:06.995273 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda360b6-5042-40bc-9d33-df99df140fd4 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:07.010852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda360b6-5042-40bc-9d33-df99df140fd4 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:07.017363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d070e4-24fa-4a2d-86e4-efae6d649c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:07.018179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d070e4-24fa-4a2d-86e4-efae6d649c1c service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:07.018516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d070e4-24fa-4a2d-86e4-efae6d649c1c service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:07.019156 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d070e4-24fa-4a2d-86e4-efae6d649c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:07.021520 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-50d070e4-24fa-4a2d-86e4-efae6d649c1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:07.035196 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d070e4-24fa-4a2d-86e4-efae6d649c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:07.037083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d070e4-24fa-4a2d-86e4-efae6d649c1c service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:07.050317 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1387/2748] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:08.791863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=38 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:12.361693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380ac9e-47f8-44f6-b3e0-aa4c34ce247f None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:12.362394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380ac9e-47f8-44f6-b3e0-aa4c34ce247f None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:12.362394 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380ac9e-47f8-44f6-b3e0-aa4c34ce247f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:12.385082 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-b380ac9e-47f8-44f6-b3e0-aa4c34ce247f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:12.386289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-b380ac9e-47f8-44f6-b3e0-aa4c34ce247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:12.397065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1362/2749] 10.222.0.134 () {58 vars in 1021 bytes} [Mon Aug 1 17:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:12.422425 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d070e4-24fa-4a2d-86e4-efae6d649c1c service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:12.438583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d070e4-24fa-4a2d-86e4-efae6d649c1c service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:12.445280 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832ff16-796e-4dcb-9b1d-e807a7b1591f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:12.445882 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832ff16-796e-4dcb-9b1d-e807a7b1591f service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:12.446166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832ff16-796e-4dcb-9b1d-e807a7b1591f service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:12.446441 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832ff16-796e-4dcb-9b1d-e807a7b1591f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:12.455484 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832ff16-796e-4dcb-9b1d-e807a7b1591f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:12.457129 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832ff16-796e-4dcb-9b1d-e807a7b1591f service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:12.466904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1388/2750] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:15.646201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21a4bf-a1d4-4d90-9135-090a7ec5e838 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:15.646744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21a4bf-a1d4-4d90-9135-090a7ec5e838 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:15.646744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21a4bf-a1d4-4d90-9135-090a7ec5e838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.668436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-5a21a4bf-a1d4-4d90-9135-090a7ec5e838 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:15.669662 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-5a21a4bf-a1d4-4d90-9135-090a7ec5e838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:15.680533 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1363/2751] 10.222.0.134 () {58 vars in 1021 bytes} [Mon Aug 1 17:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:15.706344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832ff16-796e-4dcb-9b1d-e807a7b1591f service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:15.718155 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832ff16-796e-4dcb-9b1d-e807a7b1591f service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:15.725056 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34b41e-72b2-4de2-8f3c-cff873132f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:15.725679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b41e-72b2-4de2-8f3c-cff873132f65 service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:15.725956 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b41e-72b2-4de2-8f3c-cff873132f65 service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:15.726225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b41e-72b2-4de2-8f3c-cff873132f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.734985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34b41e-72b2-4de2-8f3c-cff873132f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:15.736613 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34b41e-72b2-4de2-8f3c-cff873132f65 service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:15.746502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1389/2752] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:20.811132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1d469-e100-4032-bce9-fabbb531a270 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:20.811649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1d469-e100-4032-bce9-fabbb531a270 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:20.811999 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1d469-e100-4032-bce9-fabbb531a270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:20.835095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-84e1d469-e100-4032-bce9-fabbb531a270 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:20.837023 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-84e1d469-e100-4032-bce9-fabbb531a270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:20.845835 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1364/2753] 10.222.0.134 () {58 vars in 1021 bytes} [Mon Aug 1 17:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:20.875765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34b41e-72b2-4de2-8f3c-cff873132f65 service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:20.889398 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34b41e-72b2-4de2-8f3c-cff873132f65 service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:20.896491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e34d-a691-4182-a645-babc43226e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:20.897303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e34d-a691-4182-a645-babc43226e5d service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:20.897836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e34d-a691-4182-a645-babc43226e5d service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:20.898266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e34d-a691-4182-a645-babc43226e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:20.908808 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03e34d-a691-4182-a645-babc43226e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:20.910470 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03e34d-a691-4182-a645-babc43226e5d service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:20.921809 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1390/2754] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:25.024894 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18751a96-93ae-41c0-9b90-a8034cadab3f None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:25.025501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18751a96-93ae-41c0-9b90-a8034cadab3f None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:25.025501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18751a96-93ae-41c0-9b90-a8034cadab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:25.045580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-18751a96-93ae-41c0-9b90-a8034cadab3f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:25.046810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-18751a96-93ae-41c0-9b90-a8034cadab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:25.055993 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1365/2755] 10.222.0.134 () {58 vars in 1021 bytes} [Mon Aug 1 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:25.077913 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e34d-a691-4182-a645-babc43226e5d service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:25.085764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=28 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:25.094588 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e34d-a691-4182-a645-babc43226e5d service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:25.102277 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0434fcb-ec9a-433b-99c0-0e5a4b4b68ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:25.102926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434fcb-ec9a-433b-99c0-0e5a4b4b68ef service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:25.103370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434fcb-ec9a-433b-99c0-0e5a4b4b68ef service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:25.103709 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434fcb-ec9a-433b-99c0-0e5a4b4b68ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:25.112610 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0434fcb-ec9a-433b-99c0-0e5a4b4b68ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:25.114322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0434fcb-ec9a-433b-99c0-0e5a4b4b68ef service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:25.125315 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1391/2756] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:25.609822 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280c34-3c88-432e-8b4d-55248c51eeb8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:25.610121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280c34-3c88-432e-8b4d-55248c51eeb8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:25.610381 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280c34-3c88-432e-8b4d-55248c51eeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:25.630998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-77280c34-3c88-432e-8b4d-55248c51eeb8 None None] MFA Rules not processed for user `9c00b4f4b424406d8b460e0f489c4703`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:25.632245 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-77280c34-3c88-432e-8b4d-55248c51eeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:25.694605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1366/2757] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:29.231412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2840c-b554-42d5-a10a-4e6cbca58a9f None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:29.231915 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2840c-b554-42d5-a10a-4e6cbca58a9f None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:29.232019 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2840c-b554-42d5-a10a-4e6cbca58a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:29.252170 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-85f2840c-b554-42d5-a10a-4e6cbca58a9f None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:29.253322 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-85f2840c-b554-42d5-a10a-4e6cbca58a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:29.266410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1392/2758] 10.222.0.134 () {58 vars in 1021 bytes} [Mon Aug 1 17:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:29.287386 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77280c34-3c88-432e-8b4d-55248c51eeb8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:29.300177 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77280c34-3c88-432e-8b4d-55248c51eeb8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:29.306144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbf459-526b-4d3e-afc9-4be362556e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:29.306765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbf459-526b-4d3e-afc9-4be362556e13 service nova] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:29.307090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbf459-526b-4d3e-afc9-4be362556e13 service nova] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:29.307367 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbf459-526b-4d3e-afc9-4be362556e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:29.316135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbf459-526b-4d3e-afc9-4be362556e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:29.317745 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbf459-526b-4d3e-afc9-4be362556e13 service nova] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:29.335147 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1367/2759] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:39.246841 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=8 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:39.323434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=43 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:44.391895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2840c-b554-42d5-a10a-4e6cbca58a9f None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:44.409077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2840c-b554-42d5-a10a-4e6cbca58a9f None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:44.415985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb647ea-99d1-457a-a0df-73086756aa8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:44.416733 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb647ea-99d1-457a-a0df-73086756aa8e service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:44.417079 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb647ea-99d1-457a-a0df-73086756aa8e service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:44.417565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb647ea-99d1-457a-a0df-73086756aa8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:44.419781 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-cfb647ea-99d1-457a-a0df-73086756aa8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:44.435537 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb647ea-99d1-457a-a0df-73086756aa8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:44.437492 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb647ea-99d1-457a-a0df-73086756aa8e service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:44.449249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1393/2760] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:54.444993 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=6 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:03.059855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbf459-526b-4d3e-afc9-4be362556e13 service nova] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:03.061968 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-1ffbf459-526b-4d3e-afc9-4be362556e13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:03.077436 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbf459-526b-4d3e-afc9-4be362556e13 service nova] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:03.083682 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df4f15-30d4-465f-82ff-73b64bd4fdf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:03.084303 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df4f15-30d4-465f-82ff-73b64bd4fdf0 service placement] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:03.084588 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df4f15-30d4-465f-82ff-73b64bd4fdf0 service placement] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:03.084857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df4f15-30d4-465f-82ff-73b64bd4fdf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:03.086831 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-87df4f15-30d4-465f-82ff-73b64bd4fdf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:03.099509 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df4f15-30d4-465f-82ff-73b64bd4fdf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:03.101090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df4f15-30d4-465f-82ff-73b64bd4fdf0 service placement] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:03.111784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1368/2761] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:06:03.124824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb647ea-99d1-457a-a0df-73086756aa8e service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:03.136854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb647ea-99d1-457a-a0df-73086756aa8e service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:03.145044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47657f-f22b-46a3-a6cf-ab38020ab2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:03.145793 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47657f-f22b-46a3-a6cf-ab38020ab2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:03.146132 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47657f-f22b-46a3-a6cf-ab38020ab2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:03.146408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47657f-f22b-46a3-a6cf-ab38020ab2a4 admin admin] PATH_INFO: `/v3/users/e2fbcc9757194e75a93719e34158a020` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:03.147641 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47657f-f22b-46a3-a6cf-ab38020ab2a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fbcc9757194e75a93719e34158a020)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:03.149553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47657f-f22b-46a3-a6cf-ab38020ab2a4 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:03.206453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6c47657f-f22b-46a3-a6cf-ab38020ab2a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fbcc9757194e75a93719e34158a020'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:03.216096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6c47657f-f22b-46a3-a6cf-ab38020ab2a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fbcc9757194e75a93719e34158a020'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:03.223834 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6c47657f-f22b-46a3-a6cf-ab38020ab2a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fbcc9757194e75a93719e34158a020'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:03.224515 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6c47657f-f22b-46a3-a6cf-ab38020ab2a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fbcc9757194e75a93719e34158a020'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:03.225149 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-6c47657f-f22b-46a3-a6cf-ab38020ab2a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fbcc9757194e75a93719e34158a020'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:03.243986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1394/2762] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:06:03 2022] DELETE /identity/v3/users/e2fbcc9757194e75a93719e34158a020 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:03.449427 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df4f15-30d4-465f-82ff-73b64bd4fdf0 service placement] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:03.461672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df4f15-30d4-465f-82ff-73b64bd4fdf0 service placement] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:03.520907 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:03.521663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:03.521987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:03.522328 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] PATH_INFO: `/v3/projects/ff52332a4a65491cab25ae4a25dc4a1e` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:03.523774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff52332a4a65491cab25ae4a25dc4a1e)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:03.525808 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:03.574488 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff52332a4a65491cab25ae4a25dc4a1e', 'request_id': 'req-549b3d05-78ef-4368-9a67-8abb041730b7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:03.580959 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff52332a4a65491cab25ae4a25dc4a1e', 'request_id': 'req-549b3d05-78ef-4368-9a67-8abb041730b7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:03.586924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff52332a4a65491cab25ae4a25dc4a1e', 'request_id': 'req-549b3d05-78ef-4368-9a67-8abb041730b7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:03.600600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] The token cache is being invalidate because project ff52332a4a65491cab25ae4a25dc4a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:06:03.600887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:03.601554 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-549b3d05-78ef-4368-9a67-8abb041730b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:03.603160 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1369/2763] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:06:03 2022] DELETE /identity/v3/projects/ff52332a4a65491cab25ae4a25dc4a1e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:03.608300 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4302b85-3f40-465c-9477-9264f0fae7d0 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:03.608654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4302b85-3f40-465c-9477-9264f0fae7d0 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:03.608899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4302b85-3f40-465c-9477-9264f0fae7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:03.629734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-f4302b85-3f40-465c-9477-9264f0fae7d0 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:03.631059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-f4302b85-3f40-465c-9477-9264f0fae7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:03.700140 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1395/2764] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:03.708633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3c6e-7db9-4625-8a9e-fed123da8a07 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:03.708924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3c6e-7db9-4625-8a9e-fed123da8a07 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:03.709201 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3c6e-7db9-4625-8a9e-fed123da8a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:03.732423 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-356c3c6e-7db9-4625-8a9e-fed123da8a07 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:03.733660 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-356c3c6e-7db9-4625-8a9e-fed123da8a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:03.742447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1370/2765] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:06:03.748083 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4302b85-3f40-465c-9477-9264f0fae7d0 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:03.775533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4302b85-3f40-465c-9477-9264f0fae7d0 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:03.783357 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc091e5-9e45-411a-8688-a53fd7b58af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:03.784216 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc091e5-9e45-411a-8688-a53fd7b58af6 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:03.784563 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc091e5-9e45-411a-8688-a53fd7b58af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:03.785198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc091e5-9e45-411a-8688-a53fd7b58af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:03.786254 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc091e5-9e45-411a-8688-a53fd7b58af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:06:03.786634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc091e5-9e45-411a-8688-a53fd7b58af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:03.789048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc091e5-9e45-411a-8688-a53fd7b58af6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:03.805409 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1396/2766] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:06:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:06:03.811033 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c3c6e-7db9-4625-8a9e-fed123da8a07 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:03.825939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c3c6e-7db9-4625-8a9e-fed123da8a07 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:03.832911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51661c8-9c05-43d8-b20f-85f80b52415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:03.833531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51661c8-9c05-43d8-b20f-85f80b52415c admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:03.833811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51661c8-9c05-43d8-b20f-85f80b52415c admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:03.834094 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51661c8-9c05-43d8-b20f-85f80b52415c admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:03.834764 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51661c8-9c05-43d8-b20f-85f80b52415c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:03.836712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51661c8-9c05-43d8-b20f-85f80b52415c admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:03.867485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1371/2767] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:06:03 2022] POST /identity/v3/projects => generated 390 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:06:03.873271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc091e5-9e45-411a-8688-a53fd7b58af6 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:03.884970 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc091e5-9e45-411a-8688-a53fd7b58af6 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:03.942382 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534d870-2acf-4683-8eaf-d8b47efb4fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:03.942994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534d870-2acf-4683-8eaf-d8b47efb4fad admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:03.943306 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534d870-2acf-4683-8eaf-d8b47efb4fad admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:03.943581 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534d870-2acf-4683-8eaf-d8b47efb4fad admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:03.944243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534d870-2acf-4683-8eaf-d8b47efb4fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:03.946157 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534d870-2acf-4683-8eaf-d8b47efb4fad admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:03.954121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:03.970354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1397/2768] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:06:03 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:06:03.974646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51661c8-9c05-43d8-b20f-85f80b52415c admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:03.985586 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51661c8-9c05-43d8-b20f-85f80b52415c admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:03.991834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3adb6-381d-4bf3-aad4-424a948ac08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:03.992481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3adb6-381d-4bf3-aad4-424a948ac08d admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:03.992763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3adb6-381d-4bf3-aad4-424a948ac08d admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:03.993038 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3adb6-381d-4bf3-aad4-424a948ac08d admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:03.993747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3adb6-381d-4bf3-aad4-424a948ac08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:03.995433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3adb6-381d-4bf3-aad4-424a948ac08d admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:04.005920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1372/2769] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:06:03 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:06:04.010121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534d870-2acf-4683-8eaf-d8b47efb4fad admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:04.020945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534d870-2acf-4683-8eaf-d8b47efb4fad admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:04.026607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3f15e-9606-4275-903b-2d5fe595fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:04.027184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3f15e-9606-4275-903b-2d5fe595fc46 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:04.027467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3f15e-9606-4275-903b-2d5fe595fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:04.027741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3f15e-9606-4275-903b-2d5fe595fc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:04.028442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3f15e-9606-4275-903b-2d5fe595fc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:04.030047 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3f15e-9606-4275-903b-2d5fe595fc46 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:04.041752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1398/2770] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:06:04 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:06:04.046214 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3adb6-381d-4bf3-aad4-424a948ac08d admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:04.057498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3adb6-381d-4bf3-aad4-424a948ac08d admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:04.063876 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c29a01-4352-475b-9b96-2015074644c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:04.064721 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c29a01-4352-475b-9b96-2015074644c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:04.064844 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c29a01-4352-475b-9b96-2015074644c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:04.065135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c29a01-4352-475b-9b96-2015074644c1 admin admin] PATH_INFO: `/v3/projects/d58d7d10edac42e0b31be2f7df9b03fc/users/f0b0a2369062498f926f97d24a56168c/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:04.083032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c29a01-4352-475b-9b96-2015074644c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58d7d10edac42e0b31be2f7df9b03fc, user_id=f0b0a2369062498f926f97d24a56168c, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:04.087247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c29a01-4352-475b-9b96-2015074644c1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:04.105740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1373/2771] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:06:04 2022] PUT /identity/v3/projects/d58d7d10edac42e0b31be2f7df9b03fc/users/f0b0a2369062498f926f97d24a56168c/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:04.122086 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dcf30-d362-44bc-982a-7ca9d398c3d9 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:04.122449 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dcf30-d362-44bc-982a-7ca9d398c3d9 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:04.122802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dcf30-d362-44bc-982a-7ca9d398c3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:04.155703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a56dcf30-d362-44bc-982a-7ca9d398c3d9 None None] MFA Rules not processed for user `f0b0a2369062498f926f97d24a56168c`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:04.156989 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a56dcf30-d362-44bc-982a-7ca9d398c3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:04.232340 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1399/2772] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:06:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:04.246938 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c29a01-4352-475b-9b96-2015074644c1 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:04.249975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-44c29a01-4352-475b-9b96-2015074644c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:04.266236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:04.312049 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c29a01-4352-475b-9b96-2015074644c1 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:04.315905 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d217f-227a-4313-b38a-b144953f977f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:04.316517 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d217f-227a-4313-b38a-b144953f977f service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:04.316794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d217f-227a-4313-b38a-b144953f977f service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:04.317066 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d217f-227a-4313-b38a-b144953f977f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:04.325391 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d217f-227a-4313-b38a-b144953f977f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:04.326820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d217f-227a-4313-b38a-b144953f977f service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:04.338081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1374/2773] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:06:14.228990 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:14.333910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=20 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:14.613412 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dcf30-d362-44bc-982a-7ca9d398c3d9 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:14.693408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dcf30-d362-44bc-982a-7ca9d398c3d9 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:14.698873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:14.699548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:14.699821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:14.700089 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] PATH_INFO: `/v3/users/f0b0a2369062498f926f97d24a56168c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:14.701391 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b0a2369062498f926f97d24a56168c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:14.703353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:14.755181 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b0a2369062498f926f97d24a56168c'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:14.765718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b0a2369062498f926f97d24a56168c'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:14.773729 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b0a2369062498f926f97d24a56168c'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:14.774444 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b0a2369062498f926f97d24a56168c'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:14.775133 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b0a2369062498f926f97d24a56168c'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:14.793681 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1400/2774] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:06:14 2022] DELETE /identity/v3/users/f0b0a2369062498f926f97d24a56168c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:14.798983 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679b32d-4ed8-42b6-9e42-637dabc512d8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:14.799274 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679b32d-4ed8-42b6-9e42-637dabc512d8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:14.799529 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679b32d-4ed8-42b6-9e42-637dabc512d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:14.819937 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-6679b32d-4ed8-42b6-9e42-637dabc512d8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:14.821158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6679b32d-4ed8-42b6-9e42-637dabc512d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:14.886854 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1375/2775] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:14.898478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:14.900094 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:14.960773 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62776ef4-848d-4e35-9b81-cdf38e32834c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:14.965072 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70354867-85e5-4c42-a646-ee5d450b7bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:14.965687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70354867-85e5-4c42-a646-ee5d450b7bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:14.965974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70354867-85e5-4c42-a646-ee5d450b7bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:14.966235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70354867-85e5-4c42-a646-ee5d450b7bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:14.975656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70354867-85e5-4c42-a646-ee5d450b7bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:14.977110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70354867-85e5-4c42-a646-ee5d450b7bf5 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:14.987271 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1401/2776] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:06:15.293596 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679b32d-4ed8-42b6-9e42-637dabc512d8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:15.295522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-6679b32d-4ed8-42b6-9e42-637dabc512d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:15.308305 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679b32d-4ed8-42b6-9e42-637dabc512d8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:15.316809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:15.317330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:15.317612 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:15.317885 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] PATH_INFO: `/v3/projects/d58d7d10edac42e0b31be2f7df9b03fc` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:15.319186 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58d7d10edac42e0b31be2f7df9b03fc)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:15.321101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:15.371716 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58d7d10edac42e0b31be2f7df9b03fc', 'request_id': 'req-40dc7834-46d6-4c24-ab52-faed831e6bc7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:15.378088 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58d7d10edac42e0b31be2f7df9b03fc', 'request_id': 'req-40dc7834-46d6-4c24-ab52-faed831e6bc7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:15.383951 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58d7d10edac42e0b31be2f7df9b03fc', 'request_id': 'req-40dc7834-46d6-4c24-ab52-faed831e6bc7'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:15.397725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] The token cache is being invalidate because project d58d7d10edac42e0b31be2f7df9b03fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:06:15.398014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:15.398631 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-40dc7834-46d6-4c24-ab52-faed831e6bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:15.400184 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1376/2777] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:06:15 2022] DELETE /identity/v3/projects/d58d7d10edac42e0b31be2f7df9b03fc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:15.405275 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c8f9-0f3a-41dc-ae7e-aded561f1fa5 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:15.405755 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c8f9-0f3a-41dc-ae7e-aded561f1fa5 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:15.405854 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c8f9-0f3a-41dc-ae7e-aded561f1fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:15.425709 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-3b82c8f9-0f3a-41dc-ae7e-aded561f1fa5 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:15.426904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3b82c8f9-0f3a-41dc-ae7e-aded561f1fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:15.444660 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:15.495164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1402/2778] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:15.503534 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5289be-4326-4d29-98f0-1978311aa2c9 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:15.503808 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5289be-4326-4d29-98f0-1978311aa2c9 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:15.504096 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5289be-4326-4d29-98f0-1978311aa2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:15.524542 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ca5289be-4326-4d29-98f0-1978311aa2c9 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:15.525753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ca5289be-4326-4d29-98f0-1978311aa2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:15.534216 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1377/2779] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:15.538805 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82c8f9-0f3a-41dc-ae7e-aded561f1fa5 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:15.549121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82c8f9-0f3a-41dc-ae7e-aded561f1fa5 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:15.554672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20496-790e-4db7-bfc5-82d7f2a1d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:15.555363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20496-790e-4db7-bfc5-82d7f2a1d98e admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:15.555649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20496-790e-4db7-bfc5-82d7f2a1d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:15.555923 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20496-790e-4db7-bfc5-82d7f2a1d98e admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:15.556629 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c20496-790e-4db7-bfc5-82d7f2a1d98e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:06:15.556939 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c20496-790e-4db7-bfc5-82d7f2a1d98e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:15.558555 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c20496-790e-4db7-bfc5-82d7f2a1d98e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:15.571348 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1403/2780] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:06:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:06:15.575758 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5289be-4326-4d29-98f0-1978311aa2c9 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:15.585608 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5289be-4326-4d29-98f0-1978311aa2c9 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:15.590833 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935da51-390c-4223-add7-503e08f83c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:15.591478 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935da51-390c-4223-add7-503e08f83c8f admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:15.591763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935da51-390c-4223-add7-503e08f83c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:15.592031 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935da51-390c-4223-add7-503e08f83c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:15.592701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935da51-390c-4223-add7-503e08f83c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:15.594606 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935da51-390c-4223-add7-503e08f83c8f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:15.625565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1378/2781] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:06:15 2022] POST /identity/v3/projects => generated 398 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:06:15.630278 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20496-790e-4db7-bfc5-82d7f2a1d98e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:15.641653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20496-790e-4db7-bfc5-82d7f2a1d98e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:15.703591 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a586a5-0655-4de3-a720-634485af5c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:15.704345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a586a5-0655-4de3-a720-634485af5c3d admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:15.704596 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a586a5-0655-4de3-a720-634485af5c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:15.704898 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a586a5-0655-4de3-a720-634485af5c3d admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:15.705554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a586a5-0655-4de3-a720-634485af5c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:15.707526 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a586a5-0655-4de3-a720-634485af5c3d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:15.730670 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1404/2782] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:06:15 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:06:15.734935 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935da51-390c-4223-add7-503e08f83c8f admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:15.745693 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935da51-390c-4223-add7-503e08f83c8f admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:15.751663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54081ce9-016c-494f-bdb3-488e83af083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:15.752287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081ce9-016c-494f-bdb3-488e83af083f admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:15.752584 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081ce9-016c-494f-bdb3-488e83af083f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:15.752849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081ce9-016c-494f-bdb3-488e83af083f admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:15.753549 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54081ce9-016c-494f-bdb3-488e83af083f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:15.755180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54081ce9-016c-494f-bdb3-488e83af083f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:15.765615 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1379/2783] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:06:15 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:06:15.772299 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a586a5-0655-4de3-a720-634485af5c3d admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:15.789011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a586a5-0655-4de3-a720-634485af5c3d admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:15.798472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f243d-6d12-422a-8389-a8bcd1fd36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:15.799158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f243d-6d12-422a-8389-a8bcd1fd36b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:15.799436 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f243d-6d12-422a-8389-a8bcd1fd36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:15.799707 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f243d-6d12-422a-8389-a8bcd1fd36b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:15.800411 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f243d-6d12-422a-8389-a8bcd1fd36b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:15.802231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f243d-6d12-422a-8389-a8bcd1fd36b8 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:15.814096 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1405/2784] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:06:15 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:06:15.818605 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54081ce9-016c-494f-bdb3-488e83af083f admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:15.828991 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54081ce9-016c-494f-bdb3-488e83af083f admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:15.836740 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61899030-b79a-4b51-b982-76f3202c9119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:15.837684 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899030-b79a-4b51-b982-76f3202c9119 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:15.838048 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899030-b79a-4b51-b982-76f3202c9119 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:15.838410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899030-b79a-4b51-b982-76f3202c9119 admin admin] PATH_INFO: `/v3/projects/6a0eed9b9c9b45b08494cf875837ab65/users/85d43105715b4d13a463f5361c60cc84/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:15.861861 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61899030-b79a-4b51-b982-76f3202c9119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0eed9b9c9b45b08494cf875837ab65, user_id=85d43105715b4d13a463f5361c60cc84, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:15.864559 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61899030-b79a-4b51-b982-76f3202c9119 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:15.881447 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1380/2785] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:06:15 2022] PUT /identity/v3/projects/6a0eed9b9c9b45b08494cf875837ab65/users/85d43105715b4d13a463f5361c60cc84/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:15.892803 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76ce24-90d7-43ad-8d0c-203d5c724436 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:15.893093 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76ce24-90d7-43ad-8d0c-203d5c724436 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:15.893379 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76ce24-90d7-43ad-8d0c-203d5c724436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:15.923739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-7c76ce24-90d7-43ad-8d0c-203d5c724436 None None] MFA Rules not processed for user `85d43105715b4d13a463f5361c60cc84`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:15.924981 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7c76ce24-90d7-43ad-8d0c-203d5c724436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:15.998110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1406/2786] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:06:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:16.010900 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61899030-b79a-4b51-b982-76f3202c9119 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:16.012856 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-61899030-b79a-4b51-b982-76f3202c9119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:16.036170 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:16.072857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61899030-b79a-4b51-b982-76f3202c9119 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:16.076964 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020559cc-ee6a-4c35-b888-d7392a4e3a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:16.077581 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020559cc-ee6a-4c35-b888-d7392a4e3a75 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:16.077858 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020559cc-ee6a-4c35-b888-d7392a4e3a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:16.078125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020559cc-ee6a-4c35-b888-d7392a4e3a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:16.087332 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020559cc-ee6a-4c35-b888-d7392a4e3a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:16.088752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020559cc-ee6a-4c35-b888-d7392a4e3a75 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:16.098120 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1381/2787] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:06:21.241631 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76ce24-90d7-43ad-8d0c-203d5c724436 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:21.263237 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:21.312009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76ce24-90d7-43ad-8d0c-203d5c724436 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:21.317065 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:21.317712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:21.317992 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:21.318263 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] PATH_INFO: `/v3/users/85d43105715b4d13a463f5361c60cc84` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:21.319466 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d43105715b4d13a463f5361c60cc84)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:21.321406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:21.373561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d43105715b4d13a463f5361c60cc84'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.382471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d43105715b4d13a463f5361c60cc84'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.389788 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d43105715b4d13a463f5361c60cc84'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.390414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d43105715b4d13a463f5361c60cc84'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.391043 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d43105715b4d13a463f5361c60cc84'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.409673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1407/2788] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:06:21 2022] DELETE /identity/v3/users/85d43105715b4d13a463f5361c60cc84 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:21.414291 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52555175-a3c9-4447-a2e1-2fdc5cc9140b None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:21.414814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52555175-a3c9-4447-a2e1-2fdc5cc9140b None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:21.414814 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52555175-a3c9-4447-a2e1-2fdc5cc9140b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:21.435426 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-52555175-a3c9-4447-a2e1-2fdc5cc9140b None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:21.436643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-52555175-a3c9-4447-a2e1-2fdc5cc9140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:21.503985 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1382/2789] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:21.515214 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:21.517001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:21.578400 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ded7eb-4562-41f6-b492-2e6e2ec5000e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:21.582982 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1df64-67cf-40c9-bede-156dc51eaa10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:21.583697 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1df64-67cf-40c9-bede-156dc51eaa10 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:21.583977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1df64-67cf-40c9-bede-156dc51eaa10 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:21.584248 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1df64-67cf-40c9-bede-156dc51eaa10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:21.594137 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1df64-67cf-40c9-bede-156dc51eaa10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:21.595949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1df64-67cf-40c9-bede-156dc51eaa10 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:21.606627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1408/2790] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:06:21.893331 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52555175-a3c9-4447-a2e1-2fdc5cc9140b None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:21.894920 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-52555175-a3c9-4447-a2e1-2fdc5cc9140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:21.911598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52555175-a3c9-4447-a2e1-2fdc5cc9140b None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:21.917768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:21.918421 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:21.918691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:21.918941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] PATH_INFO: `/v3/projects/6a0eed9b9c9b45b08494cf875837ab65` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:21.920406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0eed9b9c9b45b08494cf875837ab65)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:21.922346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:21.971422 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0eed9b9c9b45b08494cf875837ab65', 'request_id': 'req-e41fbdc0-7473-4084-9140-b8dde8429fbd'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.978051 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0eed9b9c9b45b08494cf875837ab65', 'request_id': 'req-e41fbdc0-7473-4084-9140-b8dde8429fbd'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.984409 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0eed9b9c9b45b08494cf875837ab65', 'request_id': 'req-e41fbdc0-7473-4084-9140-b8dde8429fbd'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.999796 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] The token cache is being invalidate because project 6a0eed9b9c9b45b08494cf875837ab65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:06:22.000087 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:22.001032 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:22.002573 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1383/2791] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:06:21 2022] DELETE /identity/v3/projects/6a0eed9b9c9b45b08494cf875837ab65 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:31.601991 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:31.996697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:59.951609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1df64-67cf-40c9-bede-156dc51eaa10 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:59.953113 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-3bd1df64-67cf-40c9-bede-156dc51eaa10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:00.050489 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1df64-67cf-40c9-bede-156dc51eaa10 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:00.124542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b409-c140-4737-ac29-bce9ea346dee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9728f2fe7b5a40cd9f8ead5cf99af581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:00.125175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b409-c140-4737-ac29-bce9ea346dee service nova] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:00.125463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b409-c140-4737-ac29-bce9ea346dee service nova] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:00.125739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b409-c140-4737-ac29-bce9ea346dee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:00.127564 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-eee4b409-c140-4737-ac29-bce9ea346dee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:00.192346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4b409-c140-4737-ac29-bce9ea346dee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:00.194028 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4b409-c140-4737-ac29-bce9ea346dee service nova] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:00.203953 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1409/2792] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:07:10.199210 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=84 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:16.337600 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:16.339166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:16.412941 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fbdc0-7473-4084-9140-b8dde8429fbd admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:16.418337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4cd93-7291-4999-9c94-9faa7c0dcb0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:16.419074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4cd93-7291-4999-9c94-9faa7c0dcb0a service placement] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:16.419405 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4cd93-7291-4999-9c94-9faa7c0dcb0a service placement] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:16.419672 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4cd93-7291-4999-9c94-9faa7c0dcb0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:16.421473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-43f4cd93-7291-4999-9c94-9faa7c0dcb0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:16.434670 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4cd93-7291-4999-9c94-9faa7c0dcb0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:16.436364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4cd93-7291-4999-9c94-9faa7c0dcb0a service placement] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:16.447487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1384/2793] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:07:21.923656 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b409-c140-4737-ac29-bce9ea346dee service nova] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:21.925107 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-eee4b409-c140-4737-ac29-bce9ea346dee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:21.982865 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b409-c140-4737-ac29-bce9ea346dee service nova] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:21.987286 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1256f1d-fded-4949-932e-3a2105322716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:21.987896 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256f1d-fded-4949-932e-3a2105322716 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:21.988173 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256f1d-fded-4949-932e-3a2105322716 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:21.988442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256f1d-fded-4949-932e-3a2105322716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:21.990858 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d1256f1d-fded-4949-932e-3a2105322716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:22.066511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1256f1d-fded-4949-932e-3a2105322716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:22.067904 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1256f1d-fded-4949-932e-3a2105322716 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:22.078030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1410/2794] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:07:25.348313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4cd93-7291-4999-9c94-9faa7c0dcb0a service placement] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:25.349924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-43f4cd93-7291-4999-9c94-9faa7c0dcb0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:25.364413 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4cd93-7291-4999-9c94-9faa7c0dcb0a service placement] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:25.369754 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b721c5b-ef13-4546-aae0-2223adc169ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:25.370396 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721c5b-ef13-4546-aae0-2223adc169ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:25.370847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721c5b-ef13-4546-aae0-2223adc169ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:25.371149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721c5b-ef13-4546-aae0-2223adc169ad admin admin] PATH_INFO: `/v3/users/9c00b4f4b424406d8b460e0f489c4703` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:25.372591 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b721c5b-ef13-4546-aae0-2223adc169ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c00b4f4b424406d8b460e0f489c4703)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:25.374670 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b721c5b-ef13-4546-aae0-2223adc169ad admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:25.425222 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3b721c5b-ef13-4546-aae0-2223adc169ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c00b4f4b424406d8b460e0f489c4703'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:25.425868 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3b721c5b-ef13-4546-aae0-2223adc169ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c00b4f4b424406d8b460e0f489c4703'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:25.438398 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3b721c5b-ef13-4546-aae0-2223adc169ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c00b4f4b424406d8b460e0f489c4703'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:25.439168 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3b721c5b-ef13-4546-aae0-2223adc169ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c00b4f4b424406d8b460e0f489c4703'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:25.446481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3b721c5b-ef13-4546-aae0-2223adc169ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c00b4f4b424406d8b460e0f489c4703'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:25.460539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1385/2795] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:07:25 2022] DELETE /identity/v3/users/9c00b4f4b424406d8b460e0f489c4703 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:07:25.652071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1256f1d-fded-4949-932e-3a2105322716 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:25.662994 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1256f1d-fded-4949-932e-3a2105322716 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:25.723363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:25.724008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:25.724281 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:25.724549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] PATH_INFO: `/v3/projects/eb8ecf20c2244c1581f3db04d5c6fccf` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:25.725748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8ecf20c2244c1581f3db04d5c6fccf)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:25.727716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:25.785064 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8ecf20c2244c1581f3db04d5c6fccf', 'request_id': 'req-22617887-cc3c-4069-ae89-4b399e8196f5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:25.787859 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:25.795825 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8ecf20c2244c1581f3db04d5c6fccf', 'request_id': 'req-22617887-cc3c-4069-ae89-4b399e8196f5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:25.805213 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8ecf20c2244c1581f3db04d5c6fccf', 'request_id': 'req-22617887-cc3c-4069-ae89-4b399e8196f5'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:25.820303 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] The token cache is being invalidate because project eb8ecf20c2244c1581f3db04d5c6fccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:07:25.820545 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:25.821319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-22617887-cc3c-4069-ae89-4b399e8196f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:25.822980 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1411/2796] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:07:25 2022] DELETE /identity/v3/projects/eb8ecf20c2244c1581f3db04d5c6fccf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:07:25.828262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce315527-6295-4b20-a5a3-b483a048798a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:25.828555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce315527-6295-4b20-a5a3-b483a048798a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:25.828834 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce315527-6295-4b20-a5a3-b483a048798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:25.850558 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-ce315527-6295-4b20-a5a3-b483a048798a None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:25.851820 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ce315527-6295-4b20-a5a3-b483a048798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:25.915775 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1386/2797] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:25.924077 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeacefb-e004-4db3-a7a3-bec5077a2725 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:25.924364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeacefb-e004-4db3-a7a3-bec5077a2725 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:25.924634 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeacefb-e004-4db3-a7a3-bec5077a2725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:25.945576 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-cbeacefb-e004-4db3-a7a3-bec5077a2725 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:25.946756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-cbeacefb-e004-4db3-a7a3-bec5077a2725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:25.956000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1412/2798] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:25.960633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce315527-6295-4b20-a5a3-b483a048798a None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:25.965826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:25.972972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce315527-6295-4b20-a5a3-b483a048798a None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:25.979846 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71da2d-6509-4ad2-bd87-3e512fbc71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:25.980463 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71da2d-6509-4ad2-bd87-3e512fbc71cd admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:25.980739 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71da2d-6509-4ad2-bd87-3e512fbc71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:25.981015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71da2d-6509-4ad2-bd87-3e512fbc71cd admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:25.981738 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71da2d-6509-4ad2-bd87-3e512fbc71cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:07:25.982041 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71da2d-6509-4ad2-bd87-3e512fbc71cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:25.983695 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71da2d-6509-4ad2-bd87-3e512fbc71cd admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:25.995551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1387/2799] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:07:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:07:26.000057 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeacefb-e004-4db3-a7a3-bec5077a2725 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:26.009552 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeacefb-e004-4db3-a7a3-bec5077a2725 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:26.015832 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79511a82-4c7d-4f49-b384-08578e86cb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:26.016442 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79511a82-4c7d-4f49-b384-08578e86cb4b admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:26.016724 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79511a82-4c7d-4f49-b384-08578e86cb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:26.016999 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79511a82-4c7d-4f49-b384-08578e86cb4b admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:26.017673 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79511a82-4c7d-4f49-b384-08578e86cb4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:26.019637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79511a82-4c7d-4f49-b384-08578e86cb4b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:26.051361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1413/2800] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:07:25 2022] POST /identity/v3/projects => generated 368 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:07:26.057967 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71da2d-6509-4ad2-bd87-3e512fbc71cd admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:26.073191 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71da2d-6509-4ad2-bd87-3e512fbc71cd admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:26.131860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4356fb6-d778-4b5e-9f9b-7c78bbc2e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:26.132487 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4356fb6-d778-4b5e-9f9b-7c78bbc2e1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:26.132767 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4356fb6-d778-4b5e-9f9b-7c78bbc2e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:26.133212 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4356fb6-d778-4b5e-9f9b-7c78bbc2e1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:26.134062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4356fb6-d778-4b5e-9f9b-7c78bbc2e1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:26.136512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4356fb6-d778-4b5e-9f9b-7c78bbc2e1b8 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:26.161789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1388/2801] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:07:26 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:07:26.165347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79511a82-4c7d-4f49-b384-08578e86cb4b admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:26.178530 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79511a82-4c7d-4f49-b384-08578e86cb4b admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:26.183778 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224b212-463b-4b2d-b4e1-5d47c9543be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:26.184483 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b212-463b-4b2d-b4e1-5d47c9543be2 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:26.184722 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b212-463b-4b2d-b4e1-5d47c9543be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:26.184987 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b212-463b-4b2d-b4e1-5d47c9543be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:26.185738 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224b212-463b-4b2d-b4e1-5d47c9543be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:26.187375 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224b212-463b-4b2d-b4e1-5d47c9543be2 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:26.198754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1414/2802] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:07:26 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:07:26.203402 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4356fb6-d778-4b5e-9f9b-7c78bbc2e1b8 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:26.214424 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4356fb6-d778-4b5e-9f9b-7c78bbc2e1b8 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:26.220085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180b887-f1b3-4b56-ac8a-004fd32e2a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:26.220703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180b887-f1b3-4b56-ac8a-004fd32e2a00 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:26.221664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180b887-f1b3-4b56-ac8a-004fd32e2a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:26.221949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180b887-f1b3-4b56-ac8a-004fd32e2a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:26.222657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180b887-f1b3-4b56-ac8a-004fd32e2a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:26.224350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180b887-f1b3-4b56-ac8a-004fd32e2a00 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:26.235917 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1389/2803] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:07:26 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:07:26.240274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224b212-463b-4b2d-b4e1-5d47c9543be2 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:26.251264 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224b212-463b-4b2d-b4e1-5d47c9543be2 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:26.256824 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6651d1-7ffd-42f6-9ce7-f187dc4e0db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:26.257482 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6651d1-7ffd-42f6-9ce7-f187dc4e0db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:26.257749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6651d1-7ffd-42f6-9ce7-f187dc4e0db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:26.258031 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6651d1-7ffd-42f6-9ce7-f187dc4e0db3 admin admin] PATH_INFO: `/v3/projects/1c73666af5e64b3bbac90d6f84ce9243/users/0342fe745e484bf98aa7fa95e842c7ff/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:26.273464 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6651d1-7ffd-42f6-9ce7-f187dc4e0db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c73666af5e64b3bbac90d6f84ce9243, user_id=0342fe745e484bf98aa7fa95e842c7ff, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:26.276164 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6651d1-7ffd-42f6-9ce7-f187dc4e0db3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:26.291709 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1415/2804] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:07:26 2022] PUT /identity/v3/projects/1c73666af5e64b3bbac90d6f84ce9243/users/0342fe745e484bf98aa7fa95e842c7ff/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:07:26.302651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dc07c-b197-4c5a-896d-d81f044d14e8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:26.302956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dc07c-b197-4c5a-896d-d81f044d14e8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:26.303249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dc07c-b197-4c5a-896d-d81f044d14e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:26.333799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-710dc07c-b197-4c5a-896d-d81f044d14e8 None None] MFA Rules not processed for user `0342fe745e484bf98aa7fa95e842c7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:26.334975 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-710dc07c-b197-4c5a-896d-d81f044d14e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:26.409388 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1390/2805] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:07:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:26.422852 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6651d1-7ffd-42f6-9ce7-f187dc4e0db3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:26.425532 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9b6651d1-7ffd-42f6-9ce7-f187dc4e0db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:26.489344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6651d1-7ffd-42f6-9ce7-f187dc4e0db3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:26.493436 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a124ee7-c458-49aa-8d13-87ac55b1b905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:26.494175 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a124ee7-c458-49aa-8d13-87ac55b1b905 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:26.494459 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a124ee7-c458-49aa-8d13-87ac55b1b905 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:26.494730 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a124ee7-c458-49aa-8d13-87ac55b1b905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:26.504728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a124ee7-c458-49aa-8d13-87ac55b1b905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:26.506203 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a124ee7-c458-49aa-8d13-87ac55b1b905 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:26.516197 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1416/2806] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:07:35.050969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dc07c-b197-4c5a-896d-d81f044d14e8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:35.120692 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:35.125576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dc07c-b197-4c5a-896d-d81f044d14e8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:35.131072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:35.131746 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:35.132024 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:35.132339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] PATH_INFO: `/v3/users/0342fe745e484bf98aa7fa95e842c7ff` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:35.133508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0342fe745e484bf98aa7fa95e842c7ff)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:35.135508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:35.186449 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0342fe745e484bf98aa7fa95e842c7ff'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:35.187151 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0342fe745e484bf98aa7fa95e842c7ff'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:35.198883 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0342fe745e484bf98aa7fa95e842c7ff'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:35.199626 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0342fe745e484bf98aa7fa95e842c7ff'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:35.206267 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0342fe745e484bf98aa7fa95e842c7ff'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:35.219485 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1391/2807] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:07:35 2022] DELETE /identity/v3/users/0342fe745e484bf98aa7fa95e842c7ff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:07:35.224117 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deff17-09df-4670-b2cb-adb0b2f04c77 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:35.224632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deff17-09df-4670-b2cb-adb0b2f04c77 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:35.224732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deff17-09df-4670-b2cb-adb0b2f04c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:35.244099 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-d1deff17-09df-4670-b2cb-adb0b2f04c77 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:35.245316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d1deff17-09df-4670-b2cb-adb0b2f04c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:35.305549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1417/2808] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:35.316289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:35.318723 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:35.382096 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cb543-ea35-446d-a351-af2e957ce647 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:35.388062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1015b22-8e7b-467b-ae6d-5ee7a46f2569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:35.388547 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1015b22-8e7b-467b-ae6d-5ee7a46f2569 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:35.388826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1015b22-8e7b-467b-ae6d-5ee7a46f2569 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:35.389101 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1015b22-8e7b-467b-ae6d-5ee7a46f2569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:35.399638 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1015b22-8e7b-467b-ae6d-5ee7a46f2569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:35.401081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1015b22-8e7b-467b-ae6d-5ee7a46f2569 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:35.411323 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1392/2809] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:07:35.708966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1deff17-09df-4670-b2cb-adb0b2f04c77 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:35.710901 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d1deff17-09df-4670-b2cb-adb0b2f04c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:35.724715 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1deff17-09df-4670-b2cb-adb0b2f04c77 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:35.729848 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:35.730575 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:35.731145 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:35.731548 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] PATH_INFO: `/v3/projects/1c73666af5e64b3bbac90d6f84ce9243` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:35.732979 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c73666af5e64b3bbac90d6f84ce9243)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:35.734988 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:35.753336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:35.788030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c73666af5e64b3bbac90d6f84ce9243', 'request_id': 'req-b6c3bb3a-af08-44cb-a2ed-302366be2d81'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:35.795550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c73666af5e64b3bbac90d6f84ce9243', 'request_id': 'req-b6c3bb3a-af08-44cb-a2ed-302366be2d81'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:35.801405 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c73666af5e64b3bbac90d6f84ce9243', 'request_id': 'req-b6c3bb3a-af08-44cb-a2ed-302366be2d81'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:35.813539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] The token cache is being invalidate because project 1c73666af5e64b3bbac90d6f84ce9243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:07:35.813764 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:35.814478 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-b6c3bb3a-af08-44cb-a2ed-302366be2d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:07:35.816150 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1418/2810] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:07:35 2022] DELETE /identity/v3/projects/1c73666af5e64b3bbac90d6f84ce9243 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:07:35.821219 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc34e4-3188-4c92-81ee-016b563b9cb8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:35.821508 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc34e4-3188-4c92-81ee-016b563b9cb8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:35.821784 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc34e4-3188-4c92-81ee-016b563b9cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:35.843567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-32dc34e4-3188-4c92-81ee-016b563b9cb8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:35.844770 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-32dc34e4-3188-4c92-81ee-016b563b9cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:35.908691 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1393/2811] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:35.922195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0279a12-6751-4b6f-b7d0-42d9f63ddfb3 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:35.922499 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0279a12-6751-4b6f-b7d0-42d9f63ddfb3 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:35.922774 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0279a12-6751-4b6f-b7d0-42d9f63ddfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:35.950533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-d0279a12-6751-4b6f-b7d0-42d9f63ddfb3 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:35.951840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d0279a12-6751-4b6f-b7d0-42d9f63ddfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:35.961370 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1419/2812] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:07:35.966156 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc34e4-3188-4c92-81ee-016b563b9cb8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:35.976490 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc34e4-3188-4c92-81ee-016b563b9cb8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:35.982476 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113601c5-f006-4a8f-ace9-bb3b30bda60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:35.983144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113601c5-f006-4a8f-ace9-bb3b30bda60b admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:35.983420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113601c5-f006-4a8f-ace9-bb3b30bda60b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:35.984329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113601c5-f006-4a8f-ace9-bb3b30bda60b admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:35.985062 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113601c5-f006-4a8f-ace9-bb3b30bda60b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:07:35.985366 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113601c5-f006-4a8f-ace9-bb3b30bda60b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:35.986987 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113601c5-f006-4a8f-ace9-bb3b30bda60b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:35.999474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1394/2813] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:07:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:07:36.003945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0279a12-6751-4b6f-b7d0-42d9f63ddfb3 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.013533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0279a12-6751-4b6f-b7d0-42d9f63ddfb3 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:36.019506 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c181-0d5e-487b-be9f-559dd987b2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:36.020111 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c181-0d5e-487b-be9f-559dd987b2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.020383 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c181-0d5e-487b-be9f-559dd987b2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.020644 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c181-0d5e-487b-be9f-559dd987b2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.021295 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c181-0d5e-487b-be9f-559dd987b2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:36.023390 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c181-0d5e-487b-be9f-559dd987b2e3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:36.053997 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1420/2814] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:07:36 2022] POST /identity/v3/projects => generated 372 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:07:36.060711 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113601c5-f006-4a8f-ace9-bb3b30bda60b admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.071359 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113601c5-f006-4a8f-ace9-bb3b30bda60b admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:36.075585 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:36.133235 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715adb-6858-4be3-9ab6-535c24135dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:36.133849 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715adb-6858-4be3-9ab6-535c24135dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.134146 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715adb-6858-4be3-9ab6-535c24135dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.134410 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715adb-6858-4be3-9ab6-535c24135dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.135110 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0715adb-6858-4be3-9ab6-535c24135dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:36.137420 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0715adb-6858-4be3-9ab6-535c24135dd7 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:36.161467 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1395/2815] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:07:36 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:07:36.165718 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c181-0d5e-487b-be9f-559dd987b2e3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.176687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c181-0d5e-487b-be9f-559dd987b2e3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:36.182609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54e801-b31a-4e89-9ff9-ee59fe57a2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:36.183282 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54e801-b31a-4e89-9ff9-ee59fe57a2dd admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.183560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54e801-b31a-4e89-9ff9-ee59fe57a2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.183846 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54e801-b31a-4e89-9ff9-ee59fe57a2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.184677 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54e801-b31a-4e89-9ff9-ee59fe57a2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:36.186287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54e801-b31a-4e89-9ff9-ee59fe57a2dd admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:36.197075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1421/2816] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:07:36 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:07:36.201355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715adb-6858-4be3-9ab6-535c24135dd7 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.211949 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715adb-6858-4be3-9ab6-535c24135dd7 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:36.217733 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb13beb-26de-4a53-a0b2-60846b84ea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:36.218350 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb13beb-26de-4a53-a0b2-60846b84ea63 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.218632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb13beb-26de-4a53-a0b2-60846b84ea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.218903 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb13beb-26de-4a53-a0b2-60846b84ea63 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.219709 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb13beb-26de-4a53-a0b2-60846b84ea63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:36.221342 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb13beb-26de-4a53-a0b2-60846b84ea63 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:36.232241 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1396/2817] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:07:36 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:07:36.236434 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54e801-b31a-4e89-9ff9-ee59fe57a2dd admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.246768 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54e801-b31a-4e89-9ff9-ee59fe57a2dd admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:36.251946 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4ad68-a32e-41bc-872d-1b61604719d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:36.252607 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4ad68-a32e-41bc-872d-1b61604719d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.252886 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4ad68-a32e-41bc-872d-1b61604719d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.253157 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4ad68-a32e-41bc-872d-1b61604719d5 admin admin] PATH_INFO: `/v3/projects/37b5de84e78b45f2bcfc406e693b252a/users/ab966a4a5dad4dd0a72d6589d5a91675/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.268833 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4ad68-a32e-41bc-872d-1b61604719d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b5de84e78b45f2bcfc406e693b252a, user_id=ab966a4a5dad4dd0a72d6589d5a91675, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:36.271598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4ad68-a32e-41bc-872d-1b61604719d5 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:36.286726 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1422/2818] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:07:36 2022] PUT /identity/v3/projects/37b5de84e78b45f2bcfc406e693b252a/users/ab966a4a5dad4dd0a72d6589d5a91675/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:07:36.297378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78146d0b-957f-4f6f-81f4-5ea3f22f7ab8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.297799 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78146d0b-957f-4f6f-81f4-5ea3f22f7ab8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.298089 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78146d0b-957f-4f6f-81f4-5ea3f22f7ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.329847 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-78146d0b-957f-4f6f-81f4-5ea3f22f7ab8 None None] MFA Rules not processed for user `ab966a4a5dad4dd0a72d6589d5a91675`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:36.331140 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-78146d0b-957f-4f6f-81f4-5ea3f22f7ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:36.402881 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1397/2819] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:07:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:36.407503 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4ad68-a32e-41bc-872d-1b61604719d5 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.476926 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4ad68-a32e-41bc-872d-1b61604719d5 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:36.482123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e3f29-ade7-4cdd-88ec-7e532bb874e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:36.482734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e3f29-ade7-4cdd-88ec-7e532bb874e3 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.483023 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e3f29-ade7-4cdd-88ec-7e532bb874e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.483323 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e3f29-ade7-4cdd-88ec-7e532bb874e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.483985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e3f29-ade7-4cdd-88ec-7e532bb874e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:36.485914 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e3f29-ade7-4cdd-88ec-7e532bb874e3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:36.515600 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1423/2820] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:07:36 2022] POST /identity/v3/projects => generated 374 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:07:36.519760 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78146d0b-957f-4f6f-81f4-5ea3f22f7ab8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.531656 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78146d0b-957f-4f6f-81f4-5ea3f22f7ab8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:36.590440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b646946-0d3a-41ab-8ef7-571248862789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:36.591003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b646946-0d3a-41ab-8ef7-571248862789 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.591320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b646946-0d3a-41ab-8ef7-571248862789 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.591593 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b646946-0d3a-41ab-8ef7-571248862789 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.592253 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b646946-0d3a-41ab-8ef7-571248862789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:36.594165 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b646946-0d3a-41ab-8ef7-571248862789 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:36.622655 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1398/2821] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:07:36 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:07:36.629171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e3f29-ade7-4cdd-88ec-7e532bb874e3 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.641929 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e3f29-ade7-4cdd-88ec-7e532bb874e3 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:36.647500 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8654d-3a5c-424f-8487-82deeda04974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:36.648121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8654d-3a5c-424f-8487-82deeda04974 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.648402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8654d-3a5c-424f-8487-82deeda04974 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.648674 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8654d-3a5c-424f-8487-82deeda04974 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.649376 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8654d-3a5c-424f-8487-82deeda04974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:36.651050 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8654d-3a5c-424f-8487-82deeda04974 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:36.662801 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1424/2822] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:07:36 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:07:36.666939 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b646946-0d3a-41ab-8ef7-571248862789 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.673714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:36.677981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b646946-0d3a-41ab-8ef7-571248862789 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:36.684910 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19e8c7-4fb3-4fb6-9e89-5353ebb15142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:36.685576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19e8c7-4fb3-4fb6-9e89-5353ebb15142 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.685862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19e8c7-4fb3-4fb6-9e89-5353ebb15142 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.686144 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19e8c7-4fb3-4fb6-9e89-5353ebb15142 admin admin] PATH_INFO: `/v3/projects/b9b0817ff1ca4cf1867eebe1970865c5/users/9f5d9f6357c44a5790cb7a18d5faaa00/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.703471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19e8c7-4fb3-4fb6-9e89-5353ebb15142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b0817ff1ca4cf1867eebe1970865c5, user_id=9f5d9f6357c44a5790cb7a18d5faaa00, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:36.706138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19e8c7-4fb3-4fb6-9e89-5353ebb15142 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:36.725018 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1399/2823] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:07:36 2022] PUT /identity/v3/projects/b9b0817ff1ca4cf1867eebe1970865c5/users/9f5d9f6357c44a5790cb7a18d5faaa00/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:07:36.729791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8654d-3a5c-424f-8487-82deeda04974 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.740708 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8654d-3a5c-424f-8487-82deeda04974 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:36.750417 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:36.800471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ac639-5884-402d-b070-a472f8da673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:36.801087 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ac639-5884-402d-b070-a472f8da673b admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.801365 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ac639-5884-402d-b070-a472f8da673b admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.801615 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ac639-5884-402d-b070-a472f8da673b admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.802311 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ac639-5884-402d-b070-a472f8da673b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:36.803943 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ac639-5884-402d-b070-a472f8da673b admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:36.814217 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1425/2824] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:07:36 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:07:36.820401 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19e8c7-4fb3-4fb6-9e89-5353ebb15142 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.831728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19e8c7-4fb3-4fb6-9e89-5353ebb15142 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:36.837931 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88820954-b825-4d22-9988-029b908d91fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:36.838598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820954-b825-4d22-9988-029b908d91fb admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.838877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820954-b825-4d22-9988-029b908d91fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.839202 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820954-b825-4d22-9988-029b908d91fb admin admin] PATH_INFO: `/v3/projects/b9b0817ff1ca4cf1867eebe1970865c5/users/9f5d9f6357c44a5790cb7a18d5faaa00/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.841996 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88820954-b825-4d22-9988-029b908d91fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b0817ff1ca4cf1867eebe1970865c5, user_id=9f5d9f6357c44a5790cb7a18d5faaa00, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:36.844623 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88820954-b825-4d22-9988-029b908d91fb admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:36.856486 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1400/2825] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:07:36 2022] PUT /identity/v3/projects/b9b0817ff1ca4cf1867eebe1970865c5/users/9f5d9f6357c44a5790cb7a18d5faaa00/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:07:36.866869 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9ecbe-8fae-49e1-9bf2-787c506bb3f7 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:36.867187 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9ecbe-8fae-49e1-9bf2-787c506bb3f7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:36.867463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9ecbe-8fae-49e1-9bf2-787c506bb3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:36.896134 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-8aa9ecbe-8fae-49e1-9bf2-787c506bb3f7 None None] MFA Rules not processed for user `9f5d9f6357c44a5790cb7a18d5faaa00`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:36.897371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-8aa9ecbe-8fae-49e1-9bf2-787c506bb3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:36.975750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1426/2826] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:07:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:36.987555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88820954-b825-4d22-9988-029b908d91fb admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:36.989494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-88820954-b825-4d22-9988-029b908d91fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:37.051408 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88820954-b825-4d22-9988-029b908d91fb admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:37.056497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe2ffa-849f-4dac-8b08-330d23910016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:37.057115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe2ffa-849f-4dac-8b08-330d23910016 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:37.057392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe2ffa-849f-4dac-8b08-330d23910016 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:37.057659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe2ffa-849f-4dac-8b08-330d23910016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:37.068652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe2ffa-849f-4dac-8b08-330d23910016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:37.070090 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe2ffa-849f-4dac-8b08-330d23910016 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:37.080551 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1401/2827] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:07:37.168383 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9ecbe-8fae-49e1-9bf2-787c506bb3f7 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:37.178655 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9ecbe-8fae-49e1-9bf2-787c506bb3f7 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:37.183502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1e59a-5b2c-45f7-b2c0-6adb05a300d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:37.184176 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e59a-5b2c-45f7-b2c0-6adb05a300d6 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:37.184471 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e59a-5b2c-45f7-b2c0-6adb05a300d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:37.184745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e59a-5b2c-45f7-b2c0-6adb05a300d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:37.244017 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1e59a-5b2c-45f7-b2c0-6adb05a300d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:37.245542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1e59a-5b2c-45f7-b2c0-6adb05a300d6 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:37.256105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1427/2828] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:07:47.075710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:47.251221 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=85 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:07.284127 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe2ffa-849f-4dac-8b08-330d23910016 service cinder] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:07.350538 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe2ffa-849f-4dac-8b08-330d23910016 service cinder] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:07.356129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:07.356763 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:07.357034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:07.357306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] PATH_INFO: `/v3/users/ab966a4a5dad4dd0a72d6589d5a91675` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:07.358565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab966a4a5dad4dd0a72d6589d5a91675)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:07.360565 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:07.410158 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab966a4a5dad4dd0a72d6589d5a91675'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:07.410823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab966a4a5dad4dd0a72d6589d5a91675'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:07.423034 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab966a4a5dad4dd0a72d6589d5a91675'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:07.423646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab966a4a5dad4dd0a72d6589d5a91675'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:07.430863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab966a4a5dad4dd0a72d6589d5a91675'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:07.446339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1402/2829] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:08:07 2022] DELETE /identity/v3/users/ab966a4a5dad4dd0a72d6589d5a91675 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:07.452257 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df2ef4-86f5-4785-9421-45bed1ef0fef None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:07.452811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df2ef4-86f5-4785-9421-45bed1ef0fef None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:07.452811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df2ef4-86f5-4785-9421-45bed1ef0fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:07.473256 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-14df2ef4-86f5-4785-9421-45bed1ef0fef None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:07.474469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-14df2ef4-86f5-4785-9421-45bed1ef0fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:07.537389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1428/2830] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:07.548138 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:07.550337 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:07.614766 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9cd98-e6ee-4b68-90ad-c1981b2c3941 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:07.618812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b30d0-9e9a-462e-9545-7de469144298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:07.619458 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b30d0-9e9a-462e-9545-7de469144298 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:07.619735 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b30d0-9e9a-462e-9545-7de469144298 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:07.620006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b30d0-9e9a-462e-9545-7de469144298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:07.629661 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b30d0-9e9a-462e-9545-7de469144298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:07.631213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b30d0-9e9a-462e-9545-7de469144298 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:07.640702 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1403/2831] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:07.948262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df2ef4-86f5-4785-9421-45bed1ef0fef None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:07.949804 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-14df2ef4-86f5-4785-9421-45bed1ef0fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:07.963587 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df2ef4-86f5-4785-9421-45bed1ef0fef None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:07.969851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:07.970836 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:07.971163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:07.971435 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] PATH_INFO: `/v3/projects/37b5de84e78b45f2bcfc406e693b252a` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:07.972784 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37b5de84e78b45f2bcfc406e693b252a)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:07.974811 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:08.025683 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37b5de84e78b45f2bcfc406e693b252a', 'request_id': 'req-537dcf8e-c526-4b83-b48d-067897c768b1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.034679 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37b5de84e78b45f2bcfc406e693b252a', 'request_id': 'req-537dcf8e-c526-4b83-b48d-067897c768b1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.040456 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37b5de84e78b45f2bcfc406e693b252a', 'request_id': 'req-537dcf8e-c526-4b83-b48d-067897c768b1'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.051866 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] The token cache is being invalidate because project 37b5de84e78b45f2bcfc406e693b252a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:08:08.052147 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.052769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.054969 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1429/2832] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:08:07 2022] DELETE /identity/v3/projects/37b5de84e78b45f2bcfc406e693b252a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:08.059141 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b30d0-9e9a-462e-9545-7de469144298 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:08.069149 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b30d0-9e9a-462e-9545-7de469144298 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:08.088258 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:08.127173 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645f16a-dfe2-48ff-9346-de5c52f961fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:08.127789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645f16a-dfe2-48ff-9346-de5c52f961fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:08.128105 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645f16a-dfe2-48ff-9346-de5c52f961fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:08.128378 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645f16a-dfe2-48ff-9346-de5c52f961fc admin admin] PATH_INFO: `/v3/users/9f5d9f6357c44a5790cb7a18d5faaa00` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:08.129537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645f16a-dfe2-48ff-9346-de5c52f961fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5d9f6357c44a5790cb7a18d5faaa00)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:08.131498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645f16a-dfe2-48ff-9346-de5c52f961fc admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:08.182379 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d645f16a-dfe2-48ff-9346-de5c52f961fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5d9f6357c44a5790cb7a18d5faaa00'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.183057 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d645f16a-dfe2-48ff-9346-de5c52f961fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5d9f6357c44a5790cb7a18d5faaa00'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.194837 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d645f16a-dfe2-48ff-9346-de5c52f961fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5d9f6357c44a5790cb7a18d5faaa00'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.195577 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d645f16a-dfe2-48ff-9346-de5c52f961fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5d9f6357c44a5790cb7a18d5faaa00'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.202213 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-d645f16a-dfe2-48ff-9346-de5c52f961fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5d9f6357c44a5790cb7a18d5faaa00'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.218479 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1404/2833] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:08:08 2022] DELETE /identity/v3/users/9f5d9f6357c44a5790cb7a18d5faaa00 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:08.518432 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:08.520087 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:08.533888 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dcf8e-c526-4b83-b48d-067897c768b1 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:08.600211 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:08.600782 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:08.601067 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:08.601344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] PATH_INFO: `/v3/projects/b9b0817ff1ca4cf1867eebe1970865c5` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:08.602553 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b0817ff1ca4cf1867eebe1970865c5)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:08.604489 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:08.640440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:08.659016 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b0817ff1ca4cf1867eebe1970865c5', 'request_id': 'req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.667517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b0817ff1ca4cf1867eebe1970865c5', 'request_id': 'req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.673251 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b0817ff1ca4cf1867eebe1970865c5', 'request_id': 'req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.684682 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] The token cache is being invalidate because project b9b0817ff1ca4cf1867eebe1970865c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:08:08.684971 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.685620 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-c91f1a58-82a5-4ab4-bcc9-162bed02de5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:08.687190 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1430/2834] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:08:08 2022] DELETE /identity/v3/projects/b9b0817ff1ca4cf1867eebe1970865c5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:08:08.692262 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a7fe-a052-4427-9f58-82278501ffdd None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:08.692791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a7fe-a052-4427-9f58-82278501ffdd None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:08.692791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a7fe-a052-4427-9f58-82278501ffdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:08.712946 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-f1c4a7fe-a052-4427-9f58-82278501ffdd None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:08.714162 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-f1c4a7fe-a052-4427-9f58-82278501ffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:08.779491 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1405/2835] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:08.787765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75bb96-5890-45d3-aa0e-45f1a6d43ec1 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:08.788071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75bb96-5890-45d3-aa0e-45f1a6d43ec1 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:08.788347 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75bb96-5890-45d3-aa0e-45f1a6d43ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:08.810095 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-0e75bb96-5890-45d3-aa0e-45f1a6d43ec1 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:08.811359 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0e75bb96-5890-45d3-aa0e-45f1a6d43ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:08.821872 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1431/2836] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:08.826434 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a7fe-a052-4427-9f58-82278501ffdd None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:08.837081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a7fe-a052-4427-9f58-82278501ffdd None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:08.843338 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e8a89-2e18-4498-b0d7-447a2c5522d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:08.843956 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e8a89-2e18-4498-b0d7-447a2c5522d4 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:08.844325 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e8a89-2e18-4498-b0d7-447a2c5522d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:08.844537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e8a89-2e18-4498-b0d7-447a2c5522d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:08.845238 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e8a89-2e18-4498-b0d7-447a2c5522d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:08:08.845541 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e8a89-2e18-4498-b0d7-447a2c5522d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:08.847177 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e8a89-2e18-4498-b0d7-447a2c5522d4 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:08.859567 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1406/2837] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:08:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:08:08.864180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75bb96-5890-45d3-aa0e-45f1a6d43ec1 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:08.873712 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75bb96-5890-45d3-aa0e-45f1a6d43ec1 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:08.879143 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dd8a0-b234-4898-bd49-22263147dbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:08.879752 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dd8a0-b234-4898-bd49-22263147dbcb admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:08.880059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dd8a0-b234-4898-bd49-22263147dbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:08.880344 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dd8a0-b234-4898-bd49-22263147dbcb admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:08.881006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dd8a0-b234-4898-bd49-22263147dbcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:08.882909 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dd8a0-b234-4898-bd49-22263147dbcb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:08.918399 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1432/2838] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:08:08 2022] POST /identity/v3/projects => generated 370 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:08:08.924526 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e8a89-2e18-4498-b0d7-447a2c5522d4 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:08.935310 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e8a89-2e18-4498-b0d7-447a2c5522d4 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:08.961922 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:08.993524 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051ecf4-b82f-446b-a2dd-7e1dbf8f7e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:08.994182 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051ecf4-b82f-446b-a2dd-7e1dbf8f7e15 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:08.994465 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051ecf4-b82f-446b-a2dd-7e1dbf8f7e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:08.994744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051ecf4-b82f-446b-a2dd-7e1dbf8f7e15 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:08.995471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051ecf4-b82f-446b-a2dd-7e1dbf8f7e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:08.997406 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051ecf4-b82f-446b-a2dd-7e1dbf8f7e15 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:09.023356 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1407/2839] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:08:08 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:08:09.027797 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dd8a0-b234-4898-bd49-22263147dbcb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:09.039075 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dd8a0-b234-4898-bd49-22263147dbcb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:09.044606 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285343d-3ee6-4965-8d52-218d41a03f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:09.045215 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285343d-3ee6-4965-8d52-218d41a03f00 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.045507 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285343d-3ee6-4965-8d52-218d41a03f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.045771 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285343d-3ee6-4965-8d52-218d41a03f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.046463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285343d-3ee6-4965-8d52-218d41a03f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:09.048485 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285343d-3ee6-4965-8d52-218d41a03f00 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:09.059844 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1433/2840] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:09 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:09.064359 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051ecf4-b82f-446b-a2dd-7e1dbf8f7e15 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:09.075918 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051ecf4-b82f-446b-a2dd-7e1dbf8f7e15 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:09.081522 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac4aff-cb67-49a7-9cd1-c3898742feb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:09.082129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac4aff-cb67-49a7-9cd1-c3898742feb5 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.082407 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac4aff-cb67-49a7-9cd1-c3898742feb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.082677 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac4aff-cb67-49a7-9cd1-c3898742feb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.083473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac4aff-cb67-49a7-9cd1-c3898742feb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:09.084998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac4aff-cb67-49a7-9cd1-c3898742feb5 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:09.096052 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1408/2841] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:09 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:09.100302 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285343d-3ee6-4965-8d52-218d41a03f00 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:09.110731 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285343d-3ee6-4965-8d52-218d41a03f00 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:09.115240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932829f2-1ae3-4d10-8d92-3f09c067466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:09.115870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932829f2-1ae3-4d10-8d92-3f09c067466e admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.116146 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932829f2-1ae3-4d10-8d92-3f09c067466e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.116414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932829f2-1ae3-4d10-8d92-3f09c067466e admin admin] PATH_INFO: `/v3/projects/ce653ab3b53f43718d99eecc6a416b65/users/74db3182dd7a48a3a61760ce55c9c876/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.133439 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932829f2-1ae3-4d10-8d92-3f09c067466e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce653ab3b53f43718d99eecc6a416b65, user_id=74db3182dd7a48a3a61760ce55c9c876, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:09.136202 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932829f2-1ae3-4d10-8d92-3f09c067466e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:09.153045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1434/2842] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:08:09 2022] PUT /identity/v3/projects/ce653ab3b53f43718d99eecc6a416b65/users/74db3182dd7a48a3a61760ce55c9c876/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:09.165797 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a10c0-0123-4e64-9995-b9d976a2cc87 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.166116 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a10c0-0123-4e64-9995-b9d976a2cc87 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.166435 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a10c0-0123-4e64-9995-b9d976a2cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.197001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-8d6a10c0-0123-4e64-9995-b9d976a2cc87 None None] MFA Rules not processed for user `74db3182dd7a48a3a61760ce55c9c876`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:09.198233 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-8d6a10c0-0123-4e64-9995-b9d976a2cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:09.264440 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1409/2843] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:09.269465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932829f2-1ae3-4d10-8d92-3f09c067466e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:09.339604 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932829f2-1ae3-4d10-8d92-3f09c067466e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:09.345502 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87d4d2-f020-4a76-9bba-402165cff5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:09.346115 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87d4d2-f020-4a76-9bba-402165cff5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.346395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87d4d2-f020-4a76-9bba-402165cff5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.346663 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87d4d2-f020-4a76-9bba-402165cff5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.347366 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87d4d2-f020-4a76-9bba-402165cff5b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:09.349373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87d4d2-f020-4a76-9bba-402165cff5b1 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:09.382721 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1435/2844] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:08:09 2022] POST /identity/v3/projects => generated 372 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:08:09.388356 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a10c0-0123-4e64-9995-b9d976a2cc87 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:09.399863 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a10c0-0123-4e64-9995-b9d976a2cc87 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:09.461040 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006a0f9-aeef-4edf-af93-07b4112b20d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:09.461703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006a0f9-aeef-4edf-af93-07b4112b20d1 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.461984 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006a0f9-aeef-4edf-af93-07b4112b20d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.462257 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006a0f9-aeef-4edf-af93-07b4112b20d1 admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.462981 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006a0f9-aeef-4edf-af93-07b4112b20d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:09.464944 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006a0f9-aeef-4edf-af93-07b4112b20d1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:09.489111 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1410/2845] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:08:09 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:08:09.493517 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87d4d2-f020-4a76-9bba-402165cff5b1 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:09.504672 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87d4d2-f020-4a76-9bba-402165cff5b1 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:09.510006 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a5e34-3283-41f2-8ec6-5850ad3f206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:09.510627 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a5e34-3283-41f2-8ec6-5850ad3f206f admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.510942 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a5e34-3283-41f2-8ec6-5850ad3f206f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.511249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a5e34-3283-41f2-8ec6-5850ad3f206f admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.511959 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a5e34-3283-41f2-8ec6-5850ad3f206f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:09.513609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a5e34-3283-41f2-8ec6-5850ad3f206f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:09.525084 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1436/2846] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:09 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:09.529545 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006a0f9-aeef-4edf-af93-07b4112b20d1 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:09.540776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006a0f9-aeef-4edf-af93-07b4112b20d1 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:09.546228 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a768399-d824-4f88-976e-637668a5b1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:09.546889 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768399-d824-4f88-976e-637668a5b1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.547203 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768399-d824-4f88-976e-637668a5b1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.547501 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768399-d824-4f88-976e-637668a5b1bd admin admin] PATH_INFO: `/v3/projects/1923f363f87945e99113559b5f2af3d2/users/2ca714a79fed409bb0ea060c246de64f/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.565189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a768399-d824-4f88-976e-637668a5b1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1923f363f87945e99113559b5f2af3d2, user_id=2ca714a79fed409bb0ea060c246de64f, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:09.567871 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a768399-d824-4f88-976e-637668a5b1bd admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:09.584155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1411/2847] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:08:09 2022] PUT /identity/v3/projects/1923f363f87945e99113559b5f2af3d2/users/2ca714a79fed409bb0ea060c246de64f/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:09.588780 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a5e34-3283-41f2-8ec6-5850ad3f206f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:09.604646 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a5e34-3283-41f2-8ec6-5850ad3f206f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:09.628389 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:09.673274 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291129af-8a33-40db-921a-fe1ddcc53710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:09.673813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291129af-8a33-40db-921a-fe1ddcc53710 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.674092 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291129af-8a33-40db-921a-fe1ddcc53710 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.674363 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291129af-8a33-40db-921a-fe1ddcc53710 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.675090 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291129af-8a33-40db-921a-fe1ddcc53710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:09.676695 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291129af-8a33-40db-921a-fe1ddcc53710 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:09.687761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1437/2848] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:09 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:09.694260 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a768399-d824-4f88-976e-637668a5b1bd admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:09.700014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:09.705794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a768399-d824-4f88-976e-637668a5b1bd admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:09.711722 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faabf8-0639-4c57-b27e-8fe3367aa751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:09.712950 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faabf8-0639-4c57-b27e-8fe3367aa751 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.713236 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faabf8-0639-4c57-b27e-8fe3367aa751 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.713512 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faabf8-0639-4c57-b27e-8fe3367aa751 admin admin] PATH_INFO: `/v3/projects/1923f363f87945e99113559b5f2af3d2/users/2ca714a79fed409bb0ea060c246de64f/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.715742 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faabf8-0639-4c57-b27e-8fe3367aa751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1923f363f87945e99113559b5f2af3d2, user_id=2ca714a79fed409bb0ea060c246de64f, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:09.718404 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faabf8-0639-4c57-b27e-8fe3367aa751 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:09.729657 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1412/2849] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:08:09 2022] PUT /identity/v3/projects/1923f363f87945e99113559b5f2af3d2/users/2ca714a79fed409bb0ea060c246de64f/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:09.740552 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7dbc0-29d9-426b-b916-efcc8cb8f4d7 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.740977 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7dbc0-29d9-426b-b916-efcc8cb8f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.741327 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7dbc0-29d9-426b-b916-efcc8cb8f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.772284 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-26e7dbc0-29d9-426b-b916-efcc8cb8f4d7 None None] MFA Rules not processed for user `2ca714a79fed409bb0ea060c246de64f`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:09.773565 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-26e7dbc0-29d9-426b-b916-efcc8cb8f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:09.862180 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1438/2850] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:09.874006 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faabf8-0639-4c57-b27e-8fe3367aa751 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:09.876132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-75faabf8-0639-4c57-b27e-8fe3367aa751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:09.948096 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faabf8-0639-4c57-b27e-8fe3367aa751 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:09.952027 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44056664-7b00-4481-be8f-300361354a5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:09.952649 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056664-7b00-4481-be8f-300361354a5f service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:09.952925 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056664-7b00-4481-be8f-300361354a5f service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:09.953195 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056664-7b00-4481-be8f-300361354a5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:09.968044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44056664-7b00-4481-be8f-300361354a5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:09.970273 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44056664-7b00-4481-be8f-300361354a5f service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:09.980229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1413/2851] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:10.419651 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7dbc0-29d9-426b-b916-efcc8cb8f4d7 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:10.489384 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7dbc0-29d9-426b-b916-efcc8cb8f4d7 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:10.495123 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:10.495816 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:10.496080 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:10.496355 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] PATH_INFO: `/v3/users/74db3182dd7a48a3a61760ce55c9c876` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:10.497763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74db3182dd7a48a3a61760ce55c9c876)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:10.499783 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:10.553586 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74db3182dd7a48a3a61760ce55c9c876'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:10.555312 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:10.564560 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74db3182dd7a48a3a61760ce55c9c876'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:10.572009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74db3182dd7a48a3a61760ce55c9c876'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:10.572660 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74db3182dd7a48a3a61760ce55c9c876'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:10.573282 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74db3182dd7a48a3a61760ce55c9c876'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:10.591121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1439/2852] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:08:10 2022] DELETE /identity/v3/users/74db3182dd7a48a3a61760ce55c9c876 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:10.595954 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85ef4e-46c5-4384-92a1-56467f7d59af None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:10.596354 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85ef4e-46c5-4384-92a1-56467f7d59af None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:10.596696 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85ef4e-46c5-4384-92a1-56467f7d59af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:10.616306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-fb85ef4e-46c5-4384-92a1-56467f7d59af None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:10.617531 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fb85ef4e-46c5-4384-92a1-56467f7d59af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:10.680725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1414/2853] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:10.695687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:10.697191 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:10.764157 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b78309-6032-4e6f-a3da-14feb479a323 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:10.768847 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e0dbf-9e2a-4aa9-a745-61d9dfa02f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:10.769467 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e0dbf-9e2a-4aa9-a745-61d9dfa02f59 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:10.769745 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e0dbf-9e2a-4aa9-a745-61d9dfa02f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:10.770020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e0dbf-9e2a-4aa9-a745-61d9dfa02f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:10.780330 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e0dbf-9e2a-4aa9-a745-61d9dfa02f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:10.782062 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e0dbf-9e2a-4aa9-a745-61d9dfa02f59 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:10.792397 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1440/2854] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:11.077668 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85ef4e-46c5-4384-92a1-56467f7d59af None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:11.083689 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-fb85ef4e-46c5-4384-92a1-56467f7d59af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:11.098306 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85ef4e-46c5-4384-92a1-56467f7d59af None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:11.103725 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:11.104328 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:11.104625 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:11.104955 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] PATH_INFO: `/v3/projects/ce653ab3b53f43718d99eecc6a416b65` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:11.106053 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce653ab3b53f43718d99eecc6a416b65)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:11.108015 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:11.162085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce653ab3b53f43718d99eecc6a416b65', 'request_id': 'req-80063423-31fe-4a9a-8f8f-45b7d705acf1'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.171412 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce653ab3b53f43718d99eecc6a416b65', 'request_id': 'req-80063423-31fe-4a9a-8f8f-45b7d705acf1'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.177894 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce653ab3b53f43718d99eecc6a416b65', 'request_id': 'req-80063423-31fe-4a9a-8f8f-45b7d705acf1'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.192598 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] The token cache is being invalidate because project ce653ab3b53f43718d99eecc6a416b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:08:11.192887 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.193543 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.195130 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1415/2855] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:08:11 2022] DELETE /identity/v3/projects/ce653ab3b53f43718d99eecc6a416b65 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:11.199253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e0dbf-9e2a-4aa9-a745-61d9dfa02f59 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:11.209395 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e0dbf-9e2a-4aa9-a745-61d9dfa02f59 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:11.269199 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffe66e-e2ce-4cac-b804-62714451ba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:11.269754 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffe66e-e2ce-4cac-b804-62714451ba63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:11.270060 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffe66e-e2ce-4cac-b804-62714451ba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:11.270336 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffe66e-e2ce-4cac-b804-62714451ba63 admin admin] PATH_INFO: `/v3/users/2ca714a79fed409bb0ea060c246de64f` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:11.271577 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffe66e-e2ce-4cac-b804-62714451ba63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca714a79fed409bb0ea060c246de64f)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:11.273511 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffe66e-e2ce-4cac-b804-62714451ba63 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:11.323732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d0ffe66e-e2ce-4cac-b804-62714451ba63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca714a79fed409bb0ea060c246de64f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.332908 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d0ffe66e-e2ce-4cac-b804-62714451ba63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca714a79fed409bb0ea060c246de64f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.340101 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d0ffe66e-e2ce-4cac-b804-62714451ba63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca714a79fed409bb0ea060c246de64f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.340748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d0ffe66e-e2ce-4cac-b804-62714451ba63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca714a79fed409bb0ea060c246de64f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.341353 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d0ffe66e-e2ce-4cac-b804-62714451ba63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca714a79fed409bb0ea060c246de64f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.346791 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:11.360687 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1441/2856] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:08:11 2022] DELETE /identity/v3/users/2ca714a79fed409bb0ea060c246de64f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:11.649569 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:11.651121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:11.666341 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063423-31fe-4a9a-8f8f-45b7d705acf1 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:11.680714 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:11.729539 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:11.730196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:11.730473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:11.730747 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] PATH_INFO: `/v3/projects/1923f363f87945e99113559b5f2af3d2` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:11.732145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1923f363f87945e99113559b5f2af3d2)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:11.734081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:11.788633 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1923f363f87945e99113559b5f2af3d2', 'request_id': 'req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.797701 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1923f363f87945e99113559b5f2af3d2', 'request_id': 'req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.804065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1923f363f87945e99113559b5f2af3d2', 'request_id': 'req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.818753 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] The token cache is being invalidate because project 1923f363f87945e99113559b5f2af3d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:08:11.818969 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.819658 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-6dbc9558-1b51-46cf-8f97-1e2058de0c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:11.821183 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1416/2857] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:08:11 2022] DELETE /identity/v3/projects/1923f363f87945e99113559b5f2af3d2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:11.826346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a327c-6317-4d98-9808-3f99b934f3f4 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:11.826851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a327c-6317-4d98-9808-3f99b934f3f4 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:11.826851 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a327c-6317-4d98-9808-3f99b934f3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:11.847666 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-bd7a327c-6317-4d98-9808-3f99b934f3f4 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:11.848899 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-bd7a327c-6317-4d98-9808-3f99b934f3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:11.931014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1442/2858] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:11.939555 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f9a48-fa4b-49da-a34a-4b19be04a2aa None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:11.939845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f9a48-fa4b-49da-a34a-4b19be04a2aa None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:11.940125 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f9a48-fa4b-49da-a34a-4b19be04a2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:11.960772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-cc1f9a48-fa4b-49da-a34a-4b19be04a2aa None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:11.962026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-cc1f9a48-fa4b-49da-a34a-4b19be04a2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:11.971810 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1417/2859] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:11.976211 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a327c-6317-4d98-9808-3f99b934f3f4 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:11.986657 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a327c-6317-4d98-9808-3f99b934f3f4 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:11.992330 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cded7-50c2-4270-a4f8-ff4fddff698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:11.992978 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cded7-50c2-4270-a4f8-ff4fddff698c admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:11.993253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cded7-50c2-4270-a4f8-ff4fddff698c admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:11.993522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cded7-50c2-4270-a4f8-ff4fddff698c admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:11.994231 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cded7-50c2-4270-a4f8-ff4fddff698c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:08:11.994535 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cded7-50c2-4270-a4f8-ff4fddff698c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:11.996201 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cded7-50c2-4270-a4f8-ff4fddff698c admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.008628 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1443/2860] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:08:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:08:12.015229 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f9a48-fa4b-49da-a34a-4b19be04a2aa None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:12.030218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f9a48-fa4b-49da-a34a-4b19be04a2aa None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:12.036989 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ace3-a84a-47e4-8335-a3277bcecc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:12.037602 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ace3-a84a-47e4-8335-a3277bcecc60 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.037884 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ace3-a84a-47e4-8335-a3277bcecc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.038155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ace3-a84a-47e4-8335-a3277bcecc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.038821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ace3-a84a-47e4-8335-a3277bcecc60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:12.040768 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ace3-a84a-47e4-8335-a3277bcecc60 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.073652 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1418/2861] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:08:12 2022] POST /identity/v3/projects => generated 380 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:08:12.078035 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cded7-50c2-4270-a4f8-ff4fddff698c admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:12.092740 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cded7-50c2-4270-a4f8-ff4fddff698c admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:12.153061 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e2b20-e459-43ca-9e0d-2b4bc05eb8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:12.154039 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e2b20-e459-43ca-9e0d-2b4bc05eb8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.154468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e2b20-e459-43ca-9e0d-2b4bc05eb8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.154912 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e2b20-e459-43ca-9e0d-2b4bc05eb8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.156030 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e2b20-e459-43ca-9e0d-2b4bc05eb8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:12.158446 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e2b20-e459-43ca-9e0d-2b4bc05eb8f4 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.184329 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1444/2862] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:08:12 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:08:12.189135 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ace3-a84a-47e4-8335-a3277bcecc60 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:12.200329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ace3-a84a-47e4-8335-a3277bcecc60 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:12.205823 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3469358-0095-4f62-bc35-9e5a11885364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:12.206433 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3469358-0095-4f62-bc35-9e5a11885364 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.206713 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3469358-0095-4f62-bc35-9e5a11885364 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.206972 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3469358-0095-4f62-bc35-9e5a11885364 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.207712 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3469358-0095-4f62-bc35-9e5a11885364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:12.209312 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3469358-0095-4f62-bc35-9e5a11885364 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.220129 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1419/2863] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:12 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:12.224522 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e2b20-e459-43ca-9e0d-2b4bc05eb8f4 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:12.236001 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e2b20-e459-43ca-9e0d-2b4bc05eb8f4 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:12.241071 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a3103-71cd-4247-a951-2b56f09393a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:12.241686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a3103-71cd-4247-a951-2b56f09393a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.241966 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a3103-71cd-4247-a951-2b56f09393a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.242236 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a3103-71cd-4247-a951-2b56f09393a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.242975 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a3103-71cd-4247-a951-2b56f09393a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:12.244584 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a3103-71cd-4247-a951-2b56f09393a3 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.256222 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1445/2864] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:12 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:12.262681 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3469358-0095-4f62-bc35-9e5a11885364 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:12.278791 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3469358-0095-4f62-bc35-9e5a11885364 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:12.287330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64697eb-3b46-4bf3-a65f-1e45f34742f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:12.288009 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64697eb-3b46-4bf3-a65f-1e45f34742f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.288320 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64697eb-3b46-4bf3-a65f-1e45f34742f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.288624 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64697eb-3b46-4bf3-a65f-1e45f34742f0 admin admin] PATH_INFO: `/v3/projects/ec5826d721914c8ba34a5c096188bde7/users/6c2d5072d0e74466b2b47aae80390f27/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.313092 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64697eb-3b46-4bf3-a65f-1e45f34742f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5826d721914c8ba34a5c096188bde7, user_id=6c2d5072d0e74466b2b47aae80390f27, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:12.315811 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64697eb-3b46-4bf3-a65f-1e45f34742f0 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.332774 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1420/2865] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:08:12 2022] PUT /identity/v3/projects/ec5826d721914c8ba34a5c096188bde7/users/6c2d5072d0e74466b2b47aae80390f27/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:12.344787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482378-b845-4c7c-abae-43b5d7b271b5 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.345074 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482378-b845-4c7c-abae-43b5d7b271b5 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.345346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3482378-b845-4c7c-abae-43b5d7b271b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.374416 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-a3482378-b845-4c7c-abae-43b5d7b271b5 None None] MFA Rules not processed for user `6c2d5072d0e74466b2b47aae80390f27`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:12.376354 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-a3482378-b845-4c7c-abae-43b5d7b271b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:12.434361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:12.461445 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1446/2866] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:12.466218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64697eb-3b46-4bf3-a65f-1e45f34742f0 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:12.514068 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:12.534093 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64697eb-3b46-4bf3-a65f-1e45f34742f0 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:12.539025 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2b66-5dd4-4c86-af76-d7b809371ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:12.539651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2b66-5dd4-4c86-af76-d7b809371ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.539934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2b66-5dd4-4c86-af76-d7b809371ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.540210 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2b66-5dd4-4c86-af76-d7b809371ee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.540886 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2b66-5dd4-4c86-af76-d7b809371ee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:12.542801 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2b66-5dd4-4c86-af76-d7b809371ee9 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.573050 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1421/2867] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:08:12 2022] POST /identity/v3/projects => generated 380 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:08:12.577871 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3482378-b845-4c7c-abae-43b5d7b271b5 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:12.589481 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3482378-b845-4c7c-abae-43b5d7b271b5 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:12.648686 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bb876-b95f-49b2-b303-9a6f0f63ecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:12.649310 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb876-b95f-49b2-b303-9a6f0f63ecaf admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.649598 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb876-b95f-49b2-b303-9a6f0f63ecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.649873 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb876-b95f-49b2-b303-9a6f0f63ecaf admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.650539 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bb876-b95f-49b2-b303-9a6f0f63ecaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:12.652542 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bb876-b95f-49b2-b303-9a6f0f63ecaf admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.676734 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1447/2868] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:08:12 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:08:12.681196 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2b66-5dd4-4c86-af76-d7b809371ee9 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:12.692142 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2b66-5dd4-4c86-af76-d7b809371ee9 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:12.696788 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e15b1-2239-4225-84b6-673398e13a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:12.697537 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e15b1-2239-4225-84b6-673398e13a95 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.697845 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e15b1-2239-4225-84b6-673398e13a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.698121 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e15b1-2239-4225-84b6-673398e13a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.698857 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e15b1-2239-4225-84b6-673398e13a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:12.700498 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e15b1-2239-4225-84b6-673398e13a95 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.711798 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1422/2869] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:12 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:12.716059 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bb876-b95f-49b2-b303-9a6f0f63ecaf admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:12.727307 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bb876-b95f-49b2-b303-9a6f0f63ecaf admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:12.734242 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485ed6c-6739-4d78-bfb9-9f9ac87cdc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:12.735225 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485ed6c-6739-4d78-bfb9-9f9ac87cdc21 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.735541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485ed6c-6739-4d78-bfb9-9f9ac87cdc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.735881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485ed6c-6739-4d78-bfb9-9f9ac87cdc21 admin admin] PATH_INFO: `/v3/projects/0df9253dfae348cfb9cf6f184fb73317/users/47b12ba5ceb541e693884a26ccdde4b7/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.752709 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485ed6c-6739-4d78-bfb9-9f9ac87cdc21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df9253dfae348cfb9cf6f184fb73317, user_id=47b12ba5ceb541e693884a26ccdde4b7, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:12.755594 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485ed6c-6739-4d78-bfb9-9f9ac87cdc21 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.772051 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1448/2870] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:08:12 2022] PUT /identity/v3/projects/0df9253dfae348cfb9cf6f184fb73317/users/47b12ba5ceb541e693884a26ccdde4b7/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:12.777948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e15b1-2239-4225-84b6-673398e13a95 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:12.790663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e15b1-2239-4225-84b6-673398e13a95 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:12.856097 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daa754-ac09-4cd0-844b-c4be67d686b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:12.856865 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa754-ac09-4cd0-844b-c4be67d686b1 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.857279 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa754-ac09-4cd0-844b-c4be67d686b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.857694 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa754-ac09-4cd0-844b-c4be67d686b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.858761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daa754-ac09-4cd0-844b-c4be67d686b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:12.861352 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daa754-ac09-4cd0-844b-c4be67d686b1 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.876346 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1423/2871] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:12 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:08:12.881045 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485ed6c-6739-4d78-bfb9-9f9ac87cdc21 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:12.892703 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485ed6c-6739-4d78-bfb9-9f9ac87cdc21 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:12.898103 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae786b0-9330-4976-9d35-a7ee0ae350db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:12.898835 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae786b0-9330-4976-9d35-a7ee0ae350db admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.899154 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae786b0-9330-4976-9d35-a7ee0ae350db admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.899430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae786b0-9330-4976-9d35-a7ee0ae350db admin admin] PATH_INFO: `/v3/projects/0df9253dfae348cfb9cf6f184fb73317/users/47b12ba5ceb541e693884a26ccdde4b7/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.901498 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae786b0-9330-4976-9d35-a7ee0ae350db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df9253dfae348cfb9cf6f184fb73317, user_id=47b12ba5ceb541e693884a26ccdde4b7, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:12.904179 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae786b0-9330-4976-9d35-a7ee0ae350db admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:12.915763 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1449/2872] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:08:12 2022] PUT /identity/v3/projects/0df9253dfae348cfb9cf6f184fb73317/users/47b12ba5ceb541e693884a26ccdde4b7/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:12.927314 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3d6a-f4f5-4045-b875-4bb30504f808 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:12.927632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3d6a-f4f5-4045-b875-4bb30504f808 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:12.927911 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3d6a-f4f5-4045-b875-4bb30504f808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:12.956751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-66ef3d6a-f4f5-4045-b875-4bb30504f808 None None] MFA Rules not processed for user `47b12ba5ceb541e693884a26ccdde4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:12.957960 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-66ef3d6a-f4f5-4045-b875-4bb30504f808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:13.038765 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1424/2873] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:13.050562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae786b0-9330-4976-9d35-a7ee0ae350db admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:13.052614 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7ae786b0-9330-4976-9d35-a7ee0ae350db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:13.115986 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae786b0-9330-4976-9d35-a7ee0ae350db admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:13.120120 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759b86a-99da-4f45-af07-5fdebc586fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:13.120732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b86a-99da-4f45-af07-5fdebc586fdc service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:13.121009 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b86a-99da-4f45-af07-5fdebc586fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:13.121276 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b86a-99da-4f45-af07-5fdebc586fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:13.181457 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:13.192088 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759b86a-99da-4f45-af07-5fdebc586fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:13.193535 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759b86a-99da-4f45-af07-5fdebc586fdc service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:13.202690 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1450/2874] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:14.594039 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef3d6a-f4f5-4045-b875-4bb30504f808 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:14.595855 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-66ef3d6a-f4f5-4045-b875-4bb30504f808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:14.609651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef3d6a-f4f5-4045-b875-4bb30504f808 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:14.614576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbdf55-0d2f-4103-9db3-5f4b4a9cd067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:14.615223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdf55-0d2f-4103-9db3-5f4b4a9cd067 service cinder] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:14.615502 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdf55-0d2f-4103-9db3-5f4b4a9cd067 service cinder] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:14.615776 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdf55-0d2f-4103-9db3-5f4b4a9cd067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:14.625430 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbdf55-0d2f-4103-9db3-5f4b4a9cd067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:14.626907 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbdf55-0d2f-4103-9db3-5f4b4a9cd067 service cinder] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:14.636675 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1425/2875] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:18.654685 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759b86a-99da-4f45-af07-5fdebc586fdc service cinder] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:18.719579 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759b86a-99da-4f45-af07-5fdebc586fdc service cinder] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:18.724556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:18.725195 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:18.725477 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:18.725750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] PATH_INFO: `/v3/users/6c2d5072d0e74466b2b47aae80390f27` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:18.726927 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2d5072d0e74466b2b47aae80390f27)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:18.728882 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:18.787326 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2d5072d0e74466b2b47aae80390f27'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:18.797177 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2d5072d0e74466b2b47aae80390f27'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:18.804765 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2d5072d0e74466b2b47aae80390f27'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:18.805451 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2d5072d0e74466b2b47aae80390f27'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:18.806117 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2d5072d0e74466b2b47aae80390f27'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:18.824648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1451/2876] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:08:18 2022] DELETE /identity/v3/users/6c2d5072d0e74466b2b47aae80390f27 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:18.829414 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c83ea-284e-4119-bd54-5c4b32af15fb None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:18.829977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c83ea-284e-4119-bd54-5c4b32af15fb None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:18.829977 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c83ea-284e-4119-bd54-5c4b32af15fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:18.849998 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-558c83ea-284e-4119-bd54-5c4b32af15fb None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:18.851249 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-558c83ea-284e-4119-bd54-5c4b32af15fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:18.871643 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:18.918882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1426/2877] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:18.930654 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:18.932350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:19.001918 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3959dfe-1848-41b2-863f-662bd6554d15 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:19.006632 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74afb1-1fda-494b-865c-0cf362f7d476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:19.007292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74afb1-1fda-494b-865c-0cf362f7d476 service neutron] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:19.007567 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74afb1-1fda-494b-865c-0cf362f7d476 service neutron] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:19.007835 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74afb1-1fda-494b-865c-0cf362f7d476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:19.018008 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74afb1-1fda-494b-865c-0cf362f7d476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:19.019538 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74afb1-1fda-494b-865c-0cf362f7d476 service neutron] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:19.029599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1452/2878] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:19.318471 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c83ea-284e-4119-bd54-5c4b32af15fb None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:19.319966 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-558c83ea-284e-4119-bd54-5c4b32af15fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:19.332609 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c83ea-284e-4119-bd54-5c4b32af15fb None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:19.338800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:19.339497 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:19.339783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:19.340064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] PATH_INFO: `/v3/projects/ec5826d721914c8ba34a5c096188bde7` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:19.341285 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5826d721914c8ba34a5c096188bde7)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:19.343924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:19.395224 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5826d721914c8ba34a5c096188bde7', 'request_id': 'req-bcad0551-2e78-419e-a5eb-201a8200e966'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:19.402355 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5826d721914c8ba34a5c096188bde7', 'request_id': 'req-bcad0551-2e78-419e-a5eb-201a8200e966'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:19.408505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5826d721914c8ba34a5c096188bde7', 'request_id': 'req-bcad0551-2e78-419e-a5eb-201a8200e966'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:19.421932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] The token cache is being invalidate because project ec5826d721914c8ba34a5c096188bde7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:08:19.422224 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:19.423141 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:19.424743 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1427/2879] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:08:19 2022] DELETE /identity/v3/projects/ec5826d721914c8ba34a5c096188bde7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:19.429186 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74afb1-1fda-494b-865c-0cf362f7d476 service neutron] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:19.439756 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74afb1-1fda-494b-865c-0cf362f7d476 service neutron] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:19.448192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:19.500879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f0d04-c1e1-464a-8c45-40558af78799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:19.501533 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0d04-c1e1-464a-8c45-40558af78799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:19.501819 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0d04-c1e1-464a-8c45-40558af78799 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:19.502098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0d04-c1e1-464a-8c45-40558af78799 admin admin] PATH_INFO: `/v3/users/47b12ba5ceb541e693884a26ccdde4b7` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:19.503319 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f0d04-c1e1-464a-8c45-40558af78799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b12ba5ceb541e693884a26ccdde4b7)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:19.505266 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f0d04-c1e1-464a-8c45-40558af78799 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:19.553525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-db2f0d04-c1e1-464a-8c45-40558af78799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b12ba5ceb541e693884a26ccdde4b7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:19.561183 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-db2f0d04-c1e1-464a-8c45-40558af78799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b12ba5ceb541e693884a26ccdde4b7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:19.568772 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-db2f0d04-c1e1-464a-8c45-40558af78799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b12ba5ceb541e693884a26ccdde4b7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:19.569525 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-db2f0d04-c1e1-464a-8c45-40558af78799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b12ba5ceb541e693884a26ccdde4b7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:19.570140 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-db2f0d04-c1e1-464a-8c45-40558af78799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b12ba5ceb541e693884a26ccdde4b7'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:19.587562 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1453/2880] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:08:19 2022] DELETE /identity/v3/users/47b12ba5ceb541e693884a26ccdde4b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:08:19.867677 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:19.869353 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:19.883181 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad0551-2e78-419e-a5eb-201a8200e966 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:19.945821 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:19.946464 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:19.946757 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:19.947065 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] PATH_INFO: `/v3/projects/0df9253dfae348cfb9cf6f184fb73317` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:19.948251 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df9253dfae348cfb9cf6f184fb73317)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:19.950176 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:20.015971 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df9253dfae348cfb9cf6f184fb73317', 'request_id': 'req-a16c7262-73ad-49a3-9caa-91b6ea80f35f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:20.017580 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:20.025330 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df9253dfae348cfb9cf6f184fb73317', 'request_id': 'req-a16c7262-73ad-49a3-9caa-91b6ea80f35f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:20.031647 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df9253dfae348cfb9cf6f184fb73317', 'request_id': 'req-a16c7262-73ad-49a3-9caa-91b6ea80f35f'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:20.046313 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] The token cache is being invalidate because project 0df9253dfae348cfb9cf6f184fb73317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:08:20.046603 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:20.047247 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-a16c7262-73ad-49a3-9caa-91b6ea80f35f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:20.048860 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1428/2881] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:08:19 2022] DELETE /identity/v3/projects/0df9253dfae348cfb9cf6f184fb73317 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:20.055556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fb8a0-92b7-45c8-b0bd-7550b7ce613e None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.056044 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fb8a0-92b7-45c8-b0bd-7550b7ce613e None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.056167 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fb8a0-92b7-45c8-b0bd-7550b7ce613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.076577 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-819fb8a0-92b7-45c8-b0bd-7550b7ce613e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:20.077716 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-819fb8a0-92b7-45c8-b0bd-7550b7ce613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:20.144220 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1454/2882] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:20.152505 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38972e4-e1a5-4cf8-a479-d11714c9375e None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.152795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38972e4-e1a5-4cf8-a479-d11714c9375e None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.153074 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38972e4-e1a5-4cf8-a479-d11714c9375e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.174744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d38972e4-e1a5-4cf8-a479-d11714c9375e None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:20.176083 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d38972e4-e1a5-4cf8-a479-d11714c9375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:20.184932 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1429/2883] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:20.191583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fb8a0-92b7-45c8-b0bd-7550b7ce613e None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:20.205364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fb8a0-92b7-45c8-b0bd-7550b7ce613e None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:20.210516 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145d63a-3f9f-480c-af79-b37f567b208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:20.211174 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145d63a-3f9f-480c-af79-b37f567b208e admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.211453 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145d63a-3f9f-480c-af79-b37f567b208e admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.211728 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145d63a-3f9f-480c-af79-b37f567b208e admin admin] PATH_INFO: `/v3/domains` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.212469 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145d63a-3f9f-480c-af79-b37f567b208e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:08:20.212761 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145d63a-3f9f-480c-af79-b37f567b208e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:20.214373 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145d63a-3f9f-480c-af79-b37f567b208e admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:20.228681 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1455/2884] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:08:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:08:20.232815 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38972e4-e1a5-4cf8-a479-d11714c9375e None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:20.246772 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38972e4-e1a5-4cf8-a479-d11714c9375e None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:20.253915 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334af01-ca5f-4fa3-96df-3461cae0c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:20.254544 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334af01-ca5f-4fa3-96df-3461cae0c0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.254826 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334af01-ca5f-4fa3-96df-3461cae0c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.255132 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334af01-ca5f-4fa3-96df-3461cae0c0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.255808 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334af01-ca5f-4fa3-96df-3461cae0c0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:20.257715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334af01-ca5f-4fa3-96df-3461cae0c0b6 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:20.288010 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1430/2885] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:08:20 2022] POST /identity/v3/projects => generated 380 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:08:20.292786 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145d63a-3f9f-480c-af79-b37f567b208e admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:20.303916 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145d63a-3f9f-480c-af79-b37f567b208e admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:20.316748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:20.368121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95985b2-3ab8-49b9-a59c-e8094b8ad523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:20.368653 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95985b2-3ab8-49b9-a59c-e8094b8ad523 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.368933 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95985b2-3ab8-49b9-a59c-e8094b8ad523 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.369207 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95985b2-3ab8-49b9-a59c-e8094b8ad523 admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.369879 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95985b2-3ab8-49b9-a59c-e8094b8ad523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:20.371840 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95985b2-3ab8-49b9-a59c-e8094b8ad523 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:20.395750 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1456/2886] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:08:20 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:08:20.400013 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334af01-ca5f-4fa3-96df-3461cae0c0b6 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:20.411075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334af01-ca5f-4fa3-96df-3461cae0c0b6 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:20.416728 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ea99a-1e73-486f-8210-063f2e3fa2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:20.417362 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ea99a-1e73-486f-8210-063f2e3fa2da admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.417646 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ea99a-1e73-486f-8210-063f2e3fa2da admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.417924 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ea99a-1e73-486f-8210-063f2e3fa2da admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.418670 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ea99a-1e73-486f-8210-063f2e3fa2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:20.420339 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ea99a-1e73-486f-8210-063f2e3fa2da admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:20.432044 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1431/2887] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:20 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:20.436440 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95985b2-3ab8-49b9-a59c-e8094b8ad523 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:20.448414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95985b2-3ab8-49b9-a59c-e8094b8ad523 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:20.454234 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76594452-1e7e-4d67-8911-cd3553f208dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:20.454881 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76594452-1e7e-4d67-8911-cd3553f208dc admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.455216 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76594452-1e7e-4d67-8911-cd3553f208dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.455491 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76594452-1e7e-4d67-8911-cd3553f208dc admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.456192 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76594452-1e7e-4d67-8911-cd3553f208dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:20.457868 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76594452-1e7e-4d67-8911-cd3553f208dc admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:20.469760 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1457/2888] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:20 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:20.475919 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ea99a-1e73-486f-8210-063f2e3fa2da admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:20.486680 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ea99a-1e73-486f-8210-063f2e3fa2da admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:20.492095 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362e260-89ea-441d-ab3a-432c457ae5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:20.492752 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362e260-89ea-441d-ab3a-432c457ae5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.493029 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362e260-89ea-441d-ab3a-432c457ae5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.493300 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362e260-89ea-441d-ab3a-432c457ae5ea admin admin] PATH_INFO: `/v3/projects/53c64a9d5a644795a1df20062a1279d4/users/f66ed9f7b1974073a717f2f32485f9d4/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.510812 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362e260-89ea-441d-ab3a-432c457ae5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c64a9d5a644795a1df20062a1279d4, user_id=f66ed9f7b1974073a717f2f32485f9d4, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:20.513503 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362e260-89ea-441d-ab3a-432c457ae5ea admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:20.528748 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1432/2889] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:08:20 2022] PUT /identity/v3/projects/53c64a9d5a644795a1df20062a1279d4/users/f66ed9f7b1974073a717f2f32485f9d4/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:20.540554 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d936c2f-8da8-481a-a356-ae7e654ab4cb None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.540843 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d936c2f-8da8-481a-a356-ae7e654ab4cb None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.541121 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d936c2f-8da8-481a-a356-ae7e654ab4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.573510 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-7d936c2f-8da8-481a-a356-ae7e654ab4cb None None] MFA Rules not processed for user `f66ed9f7b1974073a717f2f32485f9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:20.574733 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7d936c2f-8da8-481a-a356-ae7e654ab4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:20.641184 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1458/2890] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:20.648011 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362e260-89ea-441d-ab3a-432c457ae5ea admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:20.722114 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362e260-89ea-441d-ab3a-432c457ae5ea admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:20.727990 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd9a2a-b9ed-45fc-9adc-32c1e013e56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:20.728601 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd9a2a-b9ed-45fc-9adc-32c1e013e56b admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.728877 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd9a2a-b9ed-45fc-9adc-32c1e013e56b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.729145 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd9a2a-b9ed-45fc-9adc-32c1e013e56b admin admin] PATH_INFO: `/v3/projects` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.729832 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd9a2a-b9ed-45fc-9adc-32c1e013e56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:20.731909 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd9a2a-b9ed-45fc-9adc-32c1e013e56b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:20.762718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1433/2891] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:08:20 2022] POST /identity/v3/projects => generated 380 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:08:20.767163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d936c2f-8da8-481a-a356-ae7e654ab4cb None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:20.777957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d936c2f-8da8-481a-a356-ae7e654ab4cb None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:20.840402 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda7d5c-747d-4b07-8747-ec53d26f309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:20.841015 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda7d5c-747d-4b07-8747-ec53d26f309f admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.841291 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda7d5c-747d-4b07-8747-ec53d26f309f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.841561 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda7d5c-747d-4b07-8747-ec53d26f309f admin admin] PATH_INFO: `/v3/users` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.842410 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda7d5c-747d-4b07-8747-ec53d26f309f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:20.844515 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda7d5c-747d-4b07-8747-ec53d26f309f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:20.866637 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1459/2892] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:08:20 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:08:20.870761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd9a2a-b9ed-45fc-9adc-32c1e013e56b admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:20.881703 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd9a2a-b9ed-45fc-9adc-32c1e013e56b admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:20.887357 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82afb0-7e56-42a4-aa7d-2171ce23414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:20.888001 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82afb0-7e56-42a4-aa7d-2171ce23414a admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.888280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82afb0-7e56-42a4-aa7d-2171ce23414a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.888552 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82afb0-7e56-42a4-aa7d-2171ce23414a admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.889244 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82afb0-7e56-42a4-aa7d-2171ce23414a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:20.890829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82afb0-7e56-42a4-aa7d-2171ce23414a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:20.903818 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1434/2893] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:20 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:20.908252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda7d5c-747d-4b07-8747-ec53d26f309f admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:20.919261 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda7d5c-747d-4b07-8747-ec53d26f309f admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:20.924769 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b6af-d0ff-453a-a7a8-7678f2c562c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:20.925463 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b6af-d0ff-453a-a7a8-7678f2c562c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:20.925739 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b6af-d0ff-453a-a7a8-7678f2c562c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:20.926011 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b6af-d0ff-453a-a7a8-7678f2c562c7 admin admin] PATH_INFO: `/v3/projects/0fa8d154cea34845ab23c13bb6f40fb2/users/fc873c24d9004c43814719e4c9b3d1bf/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:20.938713 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:20.942541 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284b6af-d0ff-453a-a7a8-7678f2c562c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa8d154cea34845ab23c13bb6f40fb2, user_id=fc873c24d9004c43814719e4c9b3d1bf, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:20.945381 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284b6af-d0ff-453a-a7a8-7678f2c562c7 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:20.958920 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1460/2894] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:08:20 2022] PUT /identity/v3/projects/0fa8d154cea34845ab23c13bb6f40fb2/users/fc873c24d9004c43814719e4c9b3d1bf/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:20.962962 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82afb0-7e56-42a4-aa7d-2171ce23414a admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:20.973280 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82afb0-7e56-42a4-aa7d-2171ce23414a admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:21.022644 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:21.039035 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b609e-f657-42bf-9468-475b67df973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:21.039666 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b609e-f657-42bf-9468-475b67df973b admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:21.039947 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b609e-f657-42bf-9468-475b67df973b admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:21.040223 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b609e-f657-42bf-9468-475b67df973b admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:21.040921 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b609e-f657-42bf-9468-475b67df973b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:21.042571 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b609e-f657-42bf-9468-475b67df973b admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:21.053792 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1435/2895] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:20 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:21.058406 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b6af-d0ff-453a-a7a8-7678f2c562c7 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:21.069957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b6af-d0ff-453a-a7a8-7678f2c562c7 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:21.076549 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fa94b-29fa-453a-a5f7-45b18c79847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:21.077211 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fa94b-29fa-453a-a5f7-45b18c79847a admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:21.077490 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fa94b-29fa-453a-a5f7-45b18c79847a admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:21.077762 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fa94b-29fa-453a-a5f7-45b18c79847a admin admin] PATH_INFO: `/v3/projects/0fa8d154cea34845ab23c13bb6f40fb2/users/fc873c24d9004c43814719e4c9b3d1bf/roles/390e487a45f74246ba84773e8760bc7c` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:21.080260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fa94b-29fa-453a-a5f7-45b18c79847a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa8d154cea34845ab23c13bb6f40fb2, user_id=fc873c24d9004c43814719e4c9b3d1bf, role_id=390e487a45f74246ba84773e8760bc7c)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:21.083243 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fa94b-29fa-453a-a5f7-45b18c79847a admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:21.095741 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1461/2896] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:08:21 2022] PUT /identity/v3/projects/0fa8d154cea34845ab23c13bb6f40fb2/users/fc873c24d9004c43814719e4c9b3d1bf/roles/390e487a45f74246ba84773e8760bc7c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:21.106392 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e8597-2ee2-454d-ac89-9cf59e69a73a None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:21.106685 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e8597-2ee2-454d-ac89-9cf59e69a73a None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:21.106988 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e8597-2ee2-454d-ac89-9cf59e69a73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:21.135271 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-a99e8597-2ee2-454d-ac89-9cf59e69a73a None None] MFA Rules not processed for user `fc873c24d9004c43814719e4c9b3d1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:21.136494 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-a99e8597-2ee2-454d-ac89-9cf59e69a73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:21.208468 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1436/2897] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:21.219960 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fa94b-29fa-453a-a5f7-45b18c79847a admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:21.222249 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-7c7fa94b-29fa-453a-a5f7-45b18c79847a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:21.281940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fa94b-29fa-453a-a5f7-45b18c79847a admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:21.286583 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8050c-a646-46bf-98ef-6463b3adcc95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:21.287235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8050c-a646-46bf-98ef-6463b3adcc95 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:21.287514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8050c-a646-46bf-98ef-6463b3adcc95 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:21.287787 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8050c-a646-46bf-98ef-6463b3adcc95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:21.297915 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8050c-a646-46bf-98ef-6463b3adcc95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:21.299514 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8050c-a646-46bf-98ef-6463b3adcc95 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:21.309458 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1462/2898] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:21.701218 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e8597-2ee2-454d-ac89-9cf59e69a73a None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:21.773085 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e8597-2ee2-454d-ac89-9cf59e69a73a None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:21.780965 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:21.781948 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:21.782227 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:21.782510 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] PATH_INFO: `/v3/users/f66ed9f7b1974073a717f2f32485f9d4` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:21.783843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66ed9f7b1974073a717f2f32485f9d4)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:21.785761 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:21.846664 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66ed9f7b1974073a717f2f32485f9d4'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:21.847517 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66ed9f7b1974073a717f2f32485f9d4'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:21.859045 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66ed9f7b1974073a717f2f32485f9d4'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:21.859744 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66ed9f7b1974073a717f2f32485f9d4'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:21.864955 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:21.869080 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66ed9f7b1974073a717f2f32485f9d4'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:21.883710 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1437/2899] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:08:21 2022] DELETE /identity/v3/users/f66ed9f7b1974073a717f2f32485f9d4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:21.888667 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a9835-e514-43b0-83af-84bbe941e289 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:21.888951 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a9835-e514-43b0-83af-84bbe941e289 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:21.889230 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a9835-e514-43b0-83af-84bbe941e289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:21.910439 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-cb0a9835-e514-43b0-83af-84bbe941e289 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:21.911732 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-cb0a9835-e514-43b0-83af-84bbe941e289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:21.979802 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1463/2900] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:08:21.993299 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:21.995429 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:22.055659 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400e70a-9053-43dd-8c93-7b547f2701c3 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:22.059481 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db24bf0-2b1b-40d9-927c-fe470f6e46fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:22.060099 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db24bf0-2b1b-40d9-927c-fe470f6e46fc service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:22.060382 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db24bf0-2b1b-40d9-927c-fe470f6e46fc service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:22.060663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db24bf0-2b1b-40d9-927c-fe470f6e46fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:22.070180 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db24bf0-2b1b-40d9-927c-fe470f6e46fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:22.071654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db24bf0-2b1b-40d9-927c-fe470f6e46fc service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:22.081072 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1438/2901] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:22.381260 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a9835-e514-43b0-83af-84bbe941e289 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:22.382748 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-cb0a9835-e514-43b0-83af-84bbe941e289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:22.397775 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a9835-e514-43b0-83af-84bbe941e289 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:22.403226 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:22.403928 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:22.404198 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:22.404599 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] PATH_INFO: `/v3/projects/53c64a9d5a644795a1df20062a1279d4` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:22.405944 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c64a9d5a644795a1df20062a1279d4)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:22.408283 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:22.459361 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c64a9d5a644795a1df20062a1279d4', 'request_id': 'req-ec557088-f0e9-4cf6-a282-46d288672db0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:22.470235 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c64a9d5a644795a1df20062a1279d4', 'request_id': 'req-ec557088-f0e9-4cf6-a282-46d288672db0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:22.475945 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c64a9d5a644795a1df20062a1279d4', 'request_id': 'req-ec557088-f0e9-4cf6-a282-46d288672db0'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:22.487287 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] The token cache is being invalidate because project 53c64a9d5a644795a1df20062a1279d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:08:22.487570 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:22.488292 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:22.489900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1464/2902] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:08:22 2022] DELETE /identity/v3/projects/53c64a9d5a644795a1df20062a1279d4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:22.494060 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db24bf0-2b1b-40d9-927c-fe470f6e46fc service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:22.506592 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db24bf0-2b1b-40d9-927c-fe470f6e46fc service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:22.566786 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58544603-57f9-483a-9aee-7877b766176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:22.567455 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544603-57f9-483a-9aee-7877b766176f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:22.567741 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544603-57f9-483a-9aee-7877b766176f admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:22.568014 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544603-57f9-483a-9aee-7877b766176f admin admin] PATH_INFO: `/v3/users/fc873c24d9004c43814719e4c9b3d1bf` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:22.569293 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58544603-57f9-483a-9aee-7877b766176f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc873c24d9004c43814719e4c9b3d1bf)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:22.571187 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58544603-57f9-483a-9aee-7877b766176f admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:22.628107 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-58544603-57f9-483a-9aee-7877b766176f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc873c24d9004c43814719e4c9b3d1bf'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:22.628790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-58544603-57f9-483a-9aee-7877b766176f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc873c24d9004c43814719e4c9b3d1bf'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:22.640854 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-58544603-57f9-483a-9aee-7877b766176f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc873c24d9004c43814719e4c9b3d1bf'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:22.641789 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-58544603-57f9-483a-9aee-7877b766176f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc873c24d9004c43814719e4c9b3d1bf'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:22.650075 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-58544603-57f9-483a-9aee-7877b766176f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc873c24d9004c43814719e4c9b3d1bf'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:22.666003 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1439/2903] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:08:22 2022] DELETE /identity/v3/users/fc873c24d9004c43814719e4c9b3d1bf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:22.962106 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:22.963649 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:22.973806 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:22.978110 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557088-f0e9-4cf6-a282-46d288672db0 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:23.038800 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:23.039470 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.039749 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.040020 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] PATH_INFO: `/v3/projects/0fa8d154cea34845ab23c13bb6f40fb2` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.041158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa8d154cea34845ab23c13bb6f40fb2)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:23.043108 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:23.091053 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa8d154cea34845ab23c13bb6f40fb2', 'request_id': 'req-ad84497e-f1c2-4580-9d08-637f1842953f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:23.102573 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa8d154cea34845ab23c13bb6f40fb2', 'request_id': 'req-ad84497e-f1c2-4580-9d08-637f1842953f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:23.108529 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa8d154cea34845ab23c13bb6f40fb2', 'request_id': 'req-ad84497e-f1c2-4580-9d08-637f1842953f'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:23.120000 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] The token cache is being invalidate because project 0fa8d154cea34845ab23c13bb6f40fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:08:23.120316 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:23.120949 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-ad84497e-f1c2-4580-9d08-637f1842953f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:23.122472 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1465/2904] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:08:22 2022] DELETE /identity/v3/projects/0fa8d154cea34845ab23c13bb6f40fb2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:23.127783 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a840a-c431-468d-8c04-049212e911a8 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.128329 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a840a-c431-468d-8c04-049212e911a8 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.128460 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a840a-c431-468d-8c04-049212e911a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.149882 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-e43a840a-c431-468d-8c04-049212e911a8 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:23.151155 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-e43a840a-c431-468d-8c04-049212e911a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:23.157415 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:23.213651 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1440/2905] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:23.223137 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa04e5-8c0e-45c7-831f-cf24bd64a48c None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.223468 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa04e5-8c0e-45c7-831f-cf24bd64a48c None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.223747 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa04e5-8c0e-45c7-831f-cf24bd64a48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.244940 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-0ffa04e5-8c0e-45c7-831f-cf24bd64a48c None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:23.246166 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-0ffa04e5-8c0e-45c7-831f-cf24bd64a48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:23.254985 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1466/2906] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:23.259364 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a840a-c431-468d-8c04-049212e911a8 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:23.269304 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a840a-c431-468d-8c04-049212e911a8 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:23.274115 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8af0e8-4e28-4bd1-9f04-f45f3ff52664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:23.274718 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af0e8-4e28-4bd1-9f04-f45f3ff52664 admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.274994 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af0e8-4e28-4bd1-9f04-f45f3ff52664 admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.275287 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af0e8-4e28-4bd1-9f04-f45f3ff52664 admin admin] PATH_INFO: `/v3/domains` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.275986 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8af0e8-4e28-4bd1-9f04-f45f3ff52664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:08:23.276289 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8af0e8-4e28-4bd1-9f04-f45f3ff52664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:23.277875 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8af0e8-4e28-4bd1-9f04-f45f3ff52664 admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:23.289862 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1441/2907] 10.222.0.124 () {58 vars in 1158 bytes} [Mon Aug 1 17:08:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:08:23.294334 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa04e5-8c0e-45c7-831f-cf24bd64a48c None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:23.304253 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa04e5-8c0e-45c7-831f-cf24bd64a48c None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:23.309465 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459ea0-ffdc-4ec7-8ad3-aa643b250209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:23.310122 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459ea0-ffdc-4ec7-8ad3-aa643b250209 admin admin] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.310380 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459ea0-ffdc-4ec7-8ad3-aa643b250209 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.310648 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de459ea0-ffdc-4ec7-8ad3-aa643b250209 admin admin] PATH_INFO: `/v3/projects` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.311350 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de459ea0-ffdc-4ec7-8ad3-aa643b250209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:23.313298 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de459ea0-ffdc-4ec7-8ad3-aa643b250209 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:23.347377 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1467/2908] 10.222.0.124 () {60 vars in 1158 bytes} [Mon Aug 1 17:08:23 2022] POST /identity/v3/projects => generated 384 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:08:23.351653 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8af0e8-4e28-4bd1-9f04-f45f3ff52664 admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:23.362912 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8af0e8-4e28-4bd1-9f04-f45f3ff52664 admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:23.422790 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5782c0-8d50-4ba8-b4c9-5ce2a39dd98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:23.423563 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5782c0-8d50-4ba8-b4c9-5ce2a39dd98c admin admin] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.423848 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5782c0-8d50-4ba8-b4c9-5ce2a39dd98c admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.424128 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5782c0-8d50-4ba8-b4c9-5ce2a39dd98c admin admin] PATH_INFO: `/v3/users` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.424794 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5782c0-8d50-4ba8-b4c9-5ce2a39dd98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:23.426715 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5782c0-8d50-4ba8-b4c9-5ce2a39dd98c admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:23.449648 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1442/2909] 10.222.0.124 () {60 vars in 1149 bytes} [Mon Aug 1 17:08:23 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:08:23.453974 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459ea0-ffdc-4ec7-8ad3-aa643b250209 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:23.464900 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de459ea0-ffdc-4ec7-8ad3-aa643b250209 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:23.470408 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092b579-bdc3-4ab3-85a8-2ee712b39789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:23.471048 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092b579-bdc3-4ab3-85a8-2ee712b39789 admin admin] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.471345 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092b579-bdc3-4ab3-85a8-2ee712b39789 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.471609 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092b579-bdc3-4ab3-85a8-2ee712b39789 admin admin] PATH_INFO: `/v3/roles` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.472321 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092b579-bdc3-4ab3-85a8-2ee712b39789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:23.473917 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092b579-bdc3-4ab3-85a8-2ee712b39789 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:23.484550 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1468/2910] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:23 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:23.488976 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5782c0-8d50-4ba8-b4c9-5ce2a39dd98c admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:23.499697 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5782c0-8d50-4ba8-b4c9-5ce2a39dd98c admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:23.504654 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf98ea6-bd87-46ea-9c08-dcc24812382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:23.505327 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf98ea6-bd87-46ea-9c08-dcc24812382a admin admin] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.505609 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf98ea6-bd87-46ea-9c08-dcc24812382a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.505934 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf98ea6-bd87-46ea-9c08-dcc24812382a admin admin] PATH_INFO: `/v3/roles` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.506751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf98ea6-bd87-46ea-9c08-dcc24812382a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:23.508340 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf98ea6-bd87-46ea-9c08-dcc24812382a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:23.519800 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1443/2911] 10.222.0.124 () {58 vars in 1127 bytes} [Mon Aug 1 17:08:23 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:08:23.524042 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092b579-bdc3-4ab3-85a8-2ee712b39789 admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:23.534612 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092b579-bdc3-4ab3-85a8-2ee712b39789 admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:23.540163 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b363ffe-6069-4b62-a823-eaf61a1c9bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:23.540821 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b363ffe-6069-4b62-a823-eaf61a1c9bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.541098 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b363ffe-6069-4b62-a823-eaf61a1c9bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.541365 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b363ffe-6069-4b62-a823-eaf61a1c9bdb admin admin] PATH_INFO: `/v3/projects/53e4a76a1c284613bae29cc8d126c532/users/46766355a6804ca08815fc800b14e1b1/roles/a1ce48deeb3148e28049f10600de5fbe` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.556650 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b363ffe-6069-4b62-a823-eaf61a1c9bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e4a76a1c284613bae29cc8d126c532, user_id=46766355a6804ca08815fc800b14e1b1, role_id=a1ce48deeb3148e28049f10600de5fbe)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:23.559346 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b363ffe-6069-4b62-a823-eaf61a1c9bdb admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:23.576240 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1469/2912] 10.222.0.124 () {60 vars in 1488 bytes} [Mon Aug 1 17:08:23 2022] PUT /identity/v3/projects/53e4a76a1c284613bae29cc8d126c532/users/46766355a6804ca08815fc800b14e1b1/roles/a1ce48deeb3148e28049f10600de5fbe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:08:23.593453 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13979-3bc6-4ab5-96d6-614ed3b87020 None None] REQUEST_METHOD: `POST` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.594473 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13979-3bc6-4ab5-96d6-614ed3b87020 None None] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.594980 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13979-3bc6-4ab5-96d6-614ed3b87020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.625833 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.auth.core [None req-d0f13979-3bc6-4ab5-96d6-614ed3b87020 None None] MFA Rules not processed for user `46766355a6804ca08815fc800b14e1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:23.627081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-d0f13979-3bc6-4ab5-96d6-614ed3b87020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:23.700751 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1444/2913] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:23.712415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b363ffe-6069-4b62-a823-eaf61a1c9bdb admin admin] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:23.714285 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-5b363ffe-6069-4b62-a823-eaf61a1c9bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:23.755262 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:23.782556 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b363ffe-6069-4b62-a823-eaf61a1c9bdb admin admin] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:23.786669 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3116f4-9b71-40ce-b0d6-6aa6f778e327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0c157c2bd44a0089f5efb058be372b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:23.787325 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3116f4-9b71-40ce-b0d6-6aa6f778e327 service cinder] REQUEST_METHOD: `GET` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.787608 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3116f4-9b71-40ce-b0d6-6aa6f778e327 service cinder] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.787882 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3116f4-9b71-40ce-b0d6-6aa6f778e327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.797014 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3116f4-9b71-40ce-b0d6-6aa6f778e327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:23.798895 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3116f4-9b71-40ce-b0d6-6aa6f778e327 service cinder] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:23.808289 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1470/2914] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:23.834532 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f13979-3bc6-4ab5-96d6-614ed3b87020 None None] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:23.843632 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:23.901439 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f13979-3bc6-4ab5-96d6-614ed3b87020 None None] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:23.907166 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:23.907816 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.908081 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.908377 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] PATH_INFO: `/v3/users/46766355a6804ca08815fc800b14e1b1` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.909679 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46766355a6804ca08815fc800b14e1b1)` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:23.911663 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:23.973211 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46766355a6804ca08815fc800b14e1b1'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:23.973926 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46766355a6804ca08815fc800b14e1b1'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:23.986064 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46766355a6804ca08815fc800b14e1b1'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:23.986843 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46766355a6804ca08815fc800b14e1b1'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:23.993930 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.notifications [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46766355a6804ca08815fc800b14e1b1'} {{(pid=92121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:24.020688 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1445/2915] 10.222.0.124 () {58 vars in 1229 bytes} [Mon Aug 1 17:08:23 2022] DELETE /identity/v3/users/46766355a6804ca08815fc800b14e1b1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:24.026418 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e09e2-07b0-4a8b-a7b4-44a6d8450b18 None None] REQUEST_METHOD: `POST` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:24.026855 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e09e2-07b0-4a8b-a7b4-44a6d8450b18 None None] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:24.027371 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e09e2-07b0-4a8b-a7b4-44a6d8450b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:24.050414 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.auth.core [None req-9d5e09e2-07b0-4a8b-a7b4-44a6d8450b18 None None] MFA Rules not processed for user `92fdc7d8d37b46dea64f38c142a071b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:24.051675 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9d5e09e2-07b0-4a8b-a7b4-44a6d8450b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:24.116813 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1471/2916] 10.222.0.124 () {58 vars in 963 bytes} [Mon Aug 1 17:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:24.126861 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:24.128576 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:24.198369 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5058d5-e138-4e73-9fce-1fbdf610be0a admin admin] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:24.212061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc1164-94dd-49a5-953d-2f08f5c56288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe4d6c32064d79835c415d9fc02cfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:24.212061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1164-94dd-49a5-953d-2f08f5c56288 service neutron] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:24.212061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1164-94dd-49a5-953d-2f08f5c56288 service neutron] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:24.212061 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1164-94dd-49a5-953d-2f08f5c56288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:24.220594 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc1164-94dd-49a5-953d-2f08f5c56288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:24.222070 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc1164-94dd-49a5-953d-2f08f5c56288 service neutron] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:24.232189 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1446/2917] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:08:24.529626 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e09e2-07b0-4a8b-a7b4-44a6d8450b18 None None] Authenticating user token {{(pid=92120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:24.531171 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.fernet_utils [None req-9d5e09e2-07b0-4a8b-a7b4-44a6d8450b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:24.544427 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e09e2-07b0-4a8b-a7b4-44a6d8450b18 None None] Validating token access rules against request {{(pid=92120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:24.550105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fdc7d8d37b46dea64f38c142a071b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587d85cd8aa24181b672e7ee967eed1e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:24.550789 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:24.551105 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:24.551430 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] PATH_INFO: `/v3/projects/53e4a76a1c284613bae29cc8d126c532` {{(pid=92120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:24.552957 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e4a76a1c284613bae29cc8d126c532)` {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:24.554870 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] RBAC: Authorization granted {{(pid=92120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:24.603998 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e4a76a1c284613bae29cc8d126c532', 'request_id': 'req-3ec922f6-6199-4af7-acad-aadfca4a2cb6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:24.613168 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e4a76a1c284613bae29cc8d126c532', 'request_id': 'req-3ec922f6-6199-4af7-acad-aadfca4a2cb6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:24.619158 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e4a76a1c284613bae29cc8d126c532', 'request_id': 'req-3ec922f6-6199-4af7-acad-aadfca4a2cb6'} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:24.630936 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] The token cache is being invalidate because project 53e4a76a1c284613bae29cc8d126c532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:08:24.631252 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:24.631907 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG keystone.notifications [None req-3ec922f6-6199-4af7-acad-aadfca4a2cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:08:24.633415 dv-cinder-849890-2-smb devstack@keystone.service[92120]: [pid: 92120|app: 0|req: 1472/2918] 10.222.0.124 () {58 vars in 1238 bytes} [Mon Aug 1 17:08:24 2022] DELETE /identity/v3/projects/53e4a76a1c284613bae29cc8d126c532 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:08:34.228026 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=76,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:34.627364 dv-cinder-849890-2-smb devstack@keystone.service[92120]: DEBUG dbcounter [-] [92120] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:34.614474 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc1164-94dd-49a5-953d-2f08f5c56288 service neutron] Authenticating user token {{(pid=92121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:34.616296 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-7ccc1164-94dd-49a5-953d-2f08f5c56288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:34.781850 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc1164-94dd-49a5-953d-2f08f5c56288 service neutron] Validating token access rules against request {{(pid=92121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:34.848902 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d37abe-7702-498a-b28c-6f4283bffae4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6deeea314be545609b0fe4dd786b3b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81add21b39eb44c8b974a25c04a8d06a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:34.849521 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d37abe-7702-498a-b28c-6f4283bffae4 service placement] REQUEST_METHOD: `GET` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:34.849809 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d37abe-7702-498a-b28c-6f4283bffae4 service placement] SCRIPT_NAME: `/identity` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:34.850077 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d37abe-7702-498a-b28c-6f4283bffae4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:34.852317 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.fernet_utils [None req-74d37abe-7702-498a-b28c-6f4283bffae4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:34.865829 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d37abe-7702-498a-b28c-6f4283bffae4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:34.867454 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d37abe-7702-498a-b28c-6f4283bffae4 service placement] RBAC: Authorization granted {{(pid=92121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:34.877840 dv-cinder-849890-2-smb devstack@keystone.service[92121]: [pid: 92121|app: 0|req: 1447/2919] 10.222.0.124 () {60 vars in 1370 bytes} [Mon Aug 1 17:12:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:12:44.873795 dv-cinder-849890-2-smb devstack@keystone.service[92121]: DEBUG dbcounter [-] [92121] Writing DB stats keystone:SELECT=89 {{(pid=92121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}